2026-02-26T03:00:06.626 INFO:root:teuthology version: 1.2.4.dev11+g6e3d0419c 2026-02-26T03:00:06.652 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-26T03:00:06.738 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-26_02:22:56-crimson-rados-main-distro-debug-trial/71141 branch: main description: crimson-rados/objectstore_tool/{0-crimson_install clusters/fixed-1-num-threads-3 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/seastore-segmented tasks/crimson_obejctstore_tool} email: null first_in_suite: false flavor: debug job_id: '71141' kernel: branch: distro kdb: true sha1: distro last_in_suite: false machine_type: trial name: shraddhaag-2026-02-26_02:22:56-crimson-rados-main-distro-debug-trial no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd pool default crimson: true osd: crimson cpu num: 3 crimson osd obc lru size: 10 debug ms: 20 debug osd: 20 debug seastore: 20 debug seastore backref: 20 debug seastore cache: 20 debug seastore cleaner: 20 debug seastore device: 20 debug seastore epm: 20 debug seastore fixedkv tree: 20 debug seastore journal: 20 debug seastore lba: 20 debug seastore odata: 20 debug seastore omap: 20 debug seastore onode: 20 debug seastore t: 20 debug seastore tm: 20 osd objectstore: seastore seastore cachepin size pershard: 64M seastore max concurrent transactions: 8 crimson_compat: true flavor: debug log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - but it is still running - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(OBJECT_ - for optimal performance sha1: abffb617683951511fccf3c3cab6e219f2ec83a8 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: debug sha1: abffb617683951511fccf3c3cab6e219f2ec83a8 workunit: branch: main env: CRIMSON_COMPAT: '1' sha1: 1f87b69b1a8041112e26ae0ea3c0a2a0fd14d996 owner: scheduled_shraddhaag@soko04.front.sepia.ceph.com priority: 101 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - osd.3 - client.0 seed: 5117 sha1: abffb617683951511fccf3c3cab6e219f2ec83a8 sleep_before_teardown: 0 suite: crimson-rados suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph_1f87b69b1a8041112e26ae0ea3c0a2a0fd14d996/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph.git suite_sha1: 1f87b69b1a8041112e26ae0ea3c0a2a0fd14d996 targets: trial086.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFzLQ+FYcHHEfCmaFhBrcEvCWXKjPerr+rd8rp1wgifljnpypm/n2+T+h+1Aeefjd2NuqoyVbafkuf7cx2HK3d0= tasks: - install: extra_packages: deb: - ceph-osd-crimson - ceph-osd-crimson-dbg rpm: - ceph-osd-crimson - ceph-osd-crimson-debuginfo - pexec: all: - sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson - install: null - ceph: conf: mon: mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 paxos service trim min: 10 osd: debug monc: 20 - ceph_objectstore_tool: crimson_objectstore_tool: true objects: 5 pgnum: 8 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 6e3d0419ccca0e75a03e08feb708946e198236f4 timestamp: 2026-02-26_02:22:56 tube: trial user: shraddhaag verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.904699 2026-02-26T03:00:06.738 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_1f87b69b1a8041112e26ae0ea3c0a2a0fd14d996/qa; will attempt to use it 2026-02-26T03:00:06.739 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_1f87b69b1a8041112e26ae0ea3c0a2a0fd14d996/qa/tasks 2026-02-26T03:00:06.739 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-26T03:00:06.741 INFO:teuthology.task.internal:Checking packages... 2026-02-26T03:00:06.741 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'debug' and ceph hash 'abffb617683951511fccf3c3cab6e219f2ec83a8' 2026-02-26T03:00:06.741 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-26T03:00:06.741 INFO:teuthology.packaging:ref: None 2026-02-26T03:00:06.741 INFO:teuthology.packaging:tag: None 2026-02-26T03:00:06.741 INFO:teuthology.packaging:branch: main 2026-02-26T03:00:06.741 INFO:teuthology.packaging:sha1: abffb617683951511fccf3c3cab6e219f2ec83a8 2026-02-26T03:00:06.741 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&ref=main 2026-02-26T03:00:06.867 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5593.g63656871 2026-02-26T03:00:06.869 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-26T03:00:06.881 INFO:teuthology.task.internal:no buildpackages task found 2026-02-26T03:00:06.881 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-26T03:00:06.894 INFO:teuthology.task.internal:Saving configuration 2026-02-26T03:00:06.900 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-26T03:00:06.912 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-26T03:00:06.992 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial086.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/shraddhaag-2026-02-26_02:22:56-crimson-rados-main-distro-debug-trial/71141', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-26 02:56:42.687572', 'locked_by': 'scheduled_shraddhaag@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFzLQ+FYcHHEfCmaFhBrcEvCWXKjPerr+rd8rp1wgifljnpypm/n2+T+h+1Aeefjd2NuqoyVbafkuf7cx2HK3d0='} 2026-02-26T03:00:06.992 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-26T03:00:07.004 INFO:teuthology.task.internal:roles: ubuntu@trial086.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2026-02-26T03:00:07.004 INFO:teuthology.run_tasks:Running task console_log... 2026-02-26T03:00:07.092 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7d6ae95e4180>, signals=[15]) 2026-02-26T03:00:07.092 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-26T03:00:07.103 INFO:teuthology.task.internal:Opening connections... 2026-02-26T03:00:07.103 DEBUG:teuthology.task.internal:connecting to ubuntu@trial086.front.sepia.ceph.com 2026-02-26T03:00:07.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-26T03:00:07.166 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-26T03:00:07.178 DEBUG:teuthology.orchestra.run.trial086:> uname -m 2026-02-26T03:00:07.240 INFO:teuthology.orchestra.run.trial086.stdout:x86_64 2026-02-26T03:00:07.240 DEBUG:teuthology.orchestra.run.trial086:> cat /etc/os-release 2026-02-26T03:00:07.297 INFO:teuthology.orchestra.run.trial086.stdout:NAME="CentOS Stream" 2026-02-26T03:00:07.297 INFO:teuthology.orchestra.run.trial086.stdout:VERSION="9" 2026-02-26T03:00:07.297 INFO:teuthology.orchestra.run.trial086.stdout:ID="centos" 2026-02-26T03:00:07.297 INFO:teuthology.orchestra.run.trial086.stdout:ID_LIKE="rhel fedora" 2026-02-26T03:00:07.298 INFO:teuthology.orchestra.run.trial086.stdout:VERSION_ID="9" 2026-02-26T03:00:07.298 INFO:teuthology.orchestra.run.trial086.stdout:PLATFORM_ID="platform:el9" 2026-02-26T03:00:07.298 INFO:teuthology.orchestra.run.trial086.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-26T03:00:07.298 INFO:teuthology.orchestra.run.trial086.stdout:ANSI_COLOR="0;31" 2026-02-26T03:00:07.298 INFO:teuthology.orchestra.run.trial086.stdout:LOGO="fedora-logo-icon" 2026-02-26T03:00:07.298 INFO:teuthology.orchestra.run.trial086.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-26T03:00:07.298 INFO:teuthology.orchestra.run.trial086.stdout:HOME_URL="https://centos.org/" 2026-02-26T03:00:07.298 INFO:teuthology.orchestra.run.trial086.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-26T03:00:07.298 INFO:teuthology.orchestra.run.trial086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-26T03:00:07.298 INFO:teuthology.orchestra.run.trial086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-26T03:00:07.299 INFO:teuthology.lock.ops:Updating trial086.front.sepia.ceph.com on lock server 2026-02-26T03:00:07.382 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-26T03:00:07.394 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-26T03:00:07.405 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-26T03:00:07.405 DEBUG:teuthology.orchestra.run.trial086:> test '!' -e /home/ubuntu/cephtest 2026-02-26T03:00:07.420 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-26T03:00:07.432 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-26T03:00:07.432 DEBUG:teuthology.orchestra.run.trial086:> test -z $(ls -A /var/lib/ceph) 2026-02-26T03:00:07.477 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-26T03:00:07.563 INFO:teuthology.run_tasks:Running task kernel... 2026-02-26T03:00:07.583 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': True, 'sha1': 'distro'} 2026-02-26T03:00:07.583 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, timeout 300 2026-02-26T03:00:07.583 DEBUG:teuthology.orchestra.run.trial086:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-26T03:00:07.597 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-26T03:00:07.598 DEBUG:teuthology.orchestra.run.trial086:> uname -r 2026-02-26T03:00:07.652 INFO:teuthology.orchestra.run.trial086.stdout:5.14.0-681.el9.x86_64 2026-02-26T03:00:07.653 INFO:teuthology.task.kernel:Running kernel on trial086: 5.14.0-681.el9.x86_64 2026-02-26T03:00:07.653 DEBUG:teuthology.orchestra.run.trial086:> sudo yum install -y kernel 2026-02-26T03:00:11.030 INFO:teuthology.orchestra.run.trial086.stdout:CentOS Stream 9 - BaseOS 3.0 MB/s | 8.9 MB 00:02 2026-02-26T03:00:14.277 INFO:teuthology.orchestra.run.trial086.stdout:CentOS Stream 9 - AppStream 9.9 MB/s | 27 MB 00:02 2026-02-26T03:00:25.505 INFO:teuthology.orchestra.run.trial086.stdout:CentOS Stream 9 - CRB 921 kB/s | 8.0 MB 00:08 2026-02-26T03:00:26.325 INFO:teuthology.orchestra.run.trial086.stdout:CentOS Stream 9 - Extras packages 244 kB/s | 20 kB 00:00 2026-02-26T03:00:27.601 INFO:teuthology.orchestra.run.trial086.stdout:Extra Packages for Enterprise Linux 17 MB/s | 20 MB 00:01 2026-02-26T03:00:30.762 INFO:teuthology.orchestra.run.trial086.stdout:lab-extras 2.8 MB/s | 50 kB 00:00 2026-02-26T03:00:31.783 INFO:teuthology.orchestra.run.trial086.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-26T03:00:31.783 INFO:teuthology.orchestra.run.trial086.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-26T03:00:31.803 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:00:31.803 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-26T03:00:31.804 INFO:teuthology.orchestra.run.trial086.stdout: Package Architecture Version Repository Size 2026-02-26T03:00:31.804 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-26T03:00:31.804 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-26T03:00:31.804 INFO:teuthology.orchestra.run.trial086.stdout: kernel x86_64 5.14.0-686.el9 baseos 901 k 2026-02-26T03:00:31.804 INFO:teuthology.orchestra.run.trial086.stdout:Installing dependencies: 2026-02-26T03:00:31.804 INFO:teuthology.orchestra.run.trial086.stdout: kernel-core x86_64 5.14.0-686.el9 baseos 17 M 2026-02-26T03:00:31.804 INFO:teuthology.orchestra.run.trial086.stdout: kernel-modules x86_64 5.14.0-686.el9 baseos 40 M 2026-02-26T03:00:31.804 INFO:teuthology.orchestra.run.trial086.stdout: kernel-modules-core x86_64 5.14.0-686.el9 baseos 31 M 2026-02-26T03:00:31.804 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:00:31.804 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-26T03:00:31.804 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-26T03:00:31.804 INFO:teuthology.orchestra.run.trial086.stdout:Install 4 Packages 2026-02-26T03:00:31.804 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:00:31.804 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 89 M 2026-02-26T03:00:31.804 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 135 M 2026-02-26T03:00:31.804 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-26T03:00:33.386 INFO:teuthology.orchestra.run.trial086.stdout:(1/4): kernel-5.14.0-686.el9.x86_64.rpm 592 kB/s | 901 kB 00:01 2026-02-26T03:00:46.064 INFO:teuthology.orchestra.run.trial086.stdout:(2/4): kernel-core-5.14.0-686.el9.x86_64.rpm 1.2 MB/s | 17 MB 00:14 2026-02-26T03:01:08.576 INFO:teuthology.orchestra.run.trial086.stdout:(3/4): kernel-modules-core-5.14.0-686.el9.x86_6 902 kB/s | 31 MB 00:35 2026-02-26T03:01:18.021 INFO:teuthology.orchestra.run.trial086.stdout:(4/4): kernel-modules-5.14.0-686.el9.x86_64.rpm 884 kB/s | 40 MB 00:46 2026-02-26T03:01:18.023 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-26T03:01:18.023 INFO:teuthology.orchestra.run.trial086.stdout:Total 1.9 MB/s | 89 MB 00:46 2026-02-26T03:01:18.214 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-26T03:01:18.420 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-26T03:01:18.420 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-26T03:01:18.802 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-26T03:01:18.802 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-26T03:01:19.918 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-26T03:01:20.211 INFO:teuthology.orchestra.run.trial086.stdout: Installing : kernel-modules-core-5.14.0-686.el9.x86_64 1/4 2026-02-26T03:01:20.233 INFO:teuthology.orchestra.run.trial086.stdout: Installing : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-26T03:01:22.790 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-26T03:01:22.823 INFO:teuthology.orchestra.run.trial086.stdout: Installing : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-26T03:01:25.864 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-26T03:01:25.870 INFO:teuthology.orchestra.run.trial086.stdout: Installing : kernel-5.14.0-686.el9.x86_64 4/4 2026-02-26T03:01:29.112 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-26T03:01:46.544 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 4/4 2026-02-26T03:01:46.565 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 4/4 2026-02-26T03:01:46.750 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: kernel-5.14.0-686.el9.x86_64 4/4 2026-02-26T03:01:46.750 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : kernel-5.14.0-686.el9.x86_64 1/4 2026-02-26T03:01:46.750 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-26T03:01:46.750 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-26T03:01:46.807 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-26T03:01:46.807 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:01:46.807 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-26T03:01:46.807 INFO:teuthology.orchestra.run.trial086.stdout: kernel-5.14.0-686.el9.x86_64 2026-02-26T03:01:46.807 INFO:teuthology.orchestra.run.trial086.stdout: kernel-core-5.14.0-686.el9.x86_64 2026-02-26T03:01:46.807 INFO:teuthology.orchestra.run.trial086.stdout: kernel-modules-5.14.0-686.el9.x86_64 2026-02-26T03:01:46.808 INFO:teuthology.orchestra.run.trial086.stdout: kernel-modules-core-5.14.0-686.el9.x86_64 2026-02-26T03:01:46.808 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:01:46.808 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:01:46.866 DEBUG:teuthology.orchestra.run.trial086:> rpm -q kernel | sort -rV | head -n 1 2026-02-26T03:01:46.897 INFO:teuthology.orchestra.run.trial086.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-26T03:01:46.897 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-26T03:01:46.897 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-681.el9.x86_64 Expected: 5.14.0-686.el9.x86_64 2026-02-26T03:01:46.897 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-26T03:01:46.897 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-26T03:01:46.898 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-26T03:01:46.898 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial086.front.sepia.ceph.com, path=None, version=distro) 2026-02-26T03:01:46.898 DEBUG:teuthology.orchestra.run.trial086:> rpm -q kernel | sort -rV | head -n 1 2026-02-26T03:01:46.961 INFO:teuthology.orchestra.run.trial086.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-26T03:01:46.962 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-26T03:01:46.963 DEBUG:teuthology.orchestra.run.trial086:> sudo rpm -qi grub2-tools 2026-02-26T03:01:47.031 INFO:teuthology.orchestra.run.trial086.stdout:Name : grub2-tools 2026-02-26T03:01:47.031 INFO:teuthology.orchestra.run.trial086.stdout:Epoch : 1 2026-02-26T03:01:47.031 INFO:teuthology.orchestra.run.trial086.stdout:Version : 2.06 2026-02-26T03:01:47.031 INFO:teuthology.orchestra.run.trial086.stdout:Release : 120.el9 2026-02-26T03:01:47.032 INFO:teuthology.orchestra.run.trial086.stdout:Architecture: x86_64 2026-02-26T03:01:47.032 INFO:teuthology.orchestra.run.trial086.stdout:Install Date: Wed 18 Feb 2026 05:18:42 PM UTC 2026-02-26T03:01:47.032 INFO:teuthology.orchestra.run.trial086.stdout:Group : Unspecified 2026-02-26T03:01:47.032 INFO:teuthology.orchestra.run.trial086.stdout:Size : 9108611 2026-02-26T03:01:47.032 INFO:teuthology.orchestra.run.trial086.stdout:License : GPLv3+ 2026-02-26T03:01:47.032 INFO:teuthology.orchestra.run.trial086.stdout:Signature : RSA/SHA256, Thu 04 Dec 2025 09:42:59 AM UTC, Key ID 05b555b38483c65d 2026-02-26T03:01:47.032 INFO:teuthology.orchestra.run.trial086.stdout:Source RPM : grub2-2.06-120.el9.src.rpm 2026-02-26T03:01:47.032 INFO:teuthology.orchestra.run.trial086.stdout:Build Date : Wed 03 Dec 2025 12:10:38 PM UTC 2026-02-26T03:01:47.032 INFO:teuthology.orchestra.run.trial086.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-26T03:01:47.032 INFO:teuthology.orchestra.run.trial086.stdout:Packager : builder@centos.org 2026-02-26T03:01:47.032 INFO:teuthology.orchestra.run.trial086.stdout:Vendor : CentOS 2026-02-26T03:01:47.032 INFO:teuthology.orchestra.run.trial086.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-26T03:01:47.032 INFO:teuthology.orchestra.run.trial086.stdout:Summary : Support tools for GRUB. 2026-02-26T03:01:47.033 INFO:teuthology.orchestra.run.trial086.stdout:Description : 2026-02-26T03:01:47.033 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:01:47.033 INFO:teuthology.orchestra.run.trial086.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-26T03:01:47.033 INFO:teuthology.orchestra.run.trial086.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-26T03:01:47.033 INFO:teuthology.orchestra.run.trial086.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-26T03:01:47.033 INFO:teuthology.orchestra.run.trial086.stdout:hardware devices. 2026-02-26T03:01:47.033 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:01:47.033 INFO:teuthology.orchestra.run.trial086.stdout:This subpackage provides tools for support of all platforms. 2026-02-26T03:01:47.035 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-26T03:01:47.035 INFO:teuthology.task.kernel:Updating grub on trial086 to boot 5.14.0-686.el9.x86_64 2026-02-26T03:01:47.035 DEBUG:teuthology.orchestra.run.trial086:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-26T03:01:47.099 INFO:teuthology.orchestra.run.trial086.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-26T03:01:47.101 DEBUG:teuthology.orchestra.run.trial086:> sudo command -v grubby && echo yes || echo no 2026-02-26T03:01:47.165 INFO:teuthology.orchestra.run.trial086.stdout:/sbin/grubby 2026-02-26T03:01:47.167 INFO:teuthology.orchestra.run.trial086.stdout:yes 2026-02-26T03:01:47.167 DEBUG:teuthology.orchestra.run.trial086:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-686.el9.x86_64" | head -n 1 2026-02-26T03:01:47.231 INFO:teuthology.orchestra.run.trial086.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64.conf 2026-02-26T03:01:47.232 DEBUG:teuthology.orchestra.run.trial086:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64 2026-02-26T03:01:47.306 DEBUG:teuthology.orchestra.run.trial086:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-26T03:01:47.514 INFO:teuthology.orchestra.run.trial086.stderr:Generating grub configuration file ... 2026-02-26T03:01:47.583 INFO:teuthology.orchestra.run.trial086.stderr:Found linux image: /boot/vmlinuz-5.14.0-686.el9.x86_64 2026-02-26T03:01:47.590 INFO:teuthology.orchestra.run.trial086.stderr:Found initrd image: /boot/initramfs-5.14.0-686.el9.x86_64.img 2026-02-26T03:01:47.841 INFO:teuthology.orchestra.run.trial086.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-26T03:01:47.848 INFO:teuthology.orchestra.run.trial086.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-26T03:01:47.883 INFO:teuthology.orchestra.run.trial086.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-26T03:01:47.889 INFO:teuthology.orchestra.run.trial086.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-26T03:01:47.922 INFO:teuthology.orchestra.run.trial086.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-26T03:01:47.929 INFO:teuthology.orchestra.run.trial086.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-26T03:01:47.952 INFO:teuthology.orchestra.run.trial086.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-26T03:01:47.959 INFO:teuthology.orchestra.run.trial086.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-26T03:01:48.045 INFO:teuthology.orchestra.run.trial086.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-26T03:01:48.053 INFO:teuthology.orchestra.run.trial086.stderr:done 2026-02-26T03:01:48.055 DEBUG:teuthology.orchestra.run.trial086:> test -d /sys/firmware/efi 2026-02-26T03:01:48.072 DEBUG:teuthology.orchestra.run.trial086:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-26T03:01:48.138 INFO:teuthology.orchestra.run.trial086.stdout:/boot/efi/EFI/BOOT 2026-02-26T03:01:48.139 INFO:teuthology.orchestra.run.trial086.stdout:/boot/efi/EFI/centos 2026-02-26T03:01:48.140 DEBUG:teuthology.orchestra.run.trial086:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-26T03:01:48.208 INFO:teuthology.orchestra.run.trial086.stdout:no 2026-02-26T03:01:48.208 DEBUG:teuthology.orchestra.run.trial086:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-26T03:01:48.273 INFO:teuthology.orchestra.run.trial086.stdout:yes 2026-02-26T03:01:48.273 DEBUG:teuthology.orchestra.run.trial086:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-26T03:01:48.339 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial086 2026-02-26T03:01:48.339 DEBUG:teuthology.orchestra.run.trial086:> sudo bash -c ' 2026-02-26T03:01:48.339 DEBUG:teuthology.orchestra.run.trial086:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-26T03:01:48.339 DEBUG:teuthology.orchestra.run.trial086:> ' 2026-02-26T03:02:18.383 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-26T03:02:18.384 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial086.front.sepia.ceph.com' 2026-02-26T03:02:18.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-26T03:03:18.447 DEBUG:teuthology.orchestra.remote:timed out 2026-02-26T03:03:27.456 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial086.front.sepia.ceph.com' 2026-02-26T03:03:27.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-26T03:03:27.589 DEBUG:teuthology.orchestra.run.trial086:> true 2026-02-26T03:03:27.743 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial086.front.sepia.ceph.com' 2026-02-26T03:03:27.744 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-686.el9.x86_64"... 2026-02-26T03:03:27.744 DEBUG:teuthology.orchestra.run.trial086:> uname -r 2026-02-26T03:03:27.799 INFO:teuthology.orchestra.run.trial086.stdout:5.14.0-686.el9.x86_64 2026-02-26T03:03:27.799 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-686.el9.x86_64 vs 5.14.0-686.el9.x86_64 2026-02-26T03:03:27.799 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-26T03:03:27.800 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-26T03:03:28.801 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-26T03:03:28.801 DEBUG:teuthology.orchestra.run.trial086:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-26T03:03:28.831 INFO:teuthology.orchestra.run.trial086.stdout:ttyS1 2026-02-26T03:03:28.855 DEBUG:teuthology.parallel:result is None 2026-02-26T03:03:28.855 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-26T03:03:28.866 INFO:teuthology.task.internal:Creating test directory... 2026-02-26T03:03:28.866 DEBUG:teuthology.orchestra.run.trial086:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-26T03:03:28.911 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-26T03:03:28.925 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-26T03:03:28.939 INFO:teuthology.task.internal:Creating archive directory... 2026-02-26T03:03:28.939 DEBUG:teuthology.orchestra.run.trial086:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-26T03:03:28.973 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-26T03:03:28.985 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-26T03:03:28.985 DEBUG:teuthology.orchestra.run.trial086:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-26T03:03:29.032 INFO:teuthology.orchestra.run.trial086.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-26T03:03:29.041 INFO:teuthology.orchestra.run.trial086.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-26T03:03:29.043 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-26T03:03:29.058 INFO:teuthology.task.internal:Configuring sudo... 2026-02-26T03:03:29.058 DEBUG:teuthology.orchestra.run.trial086:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-26T03:03:29.108 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-26T03:03:29.122 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-26T03:03:29.122 DEBUG:teuthology.orchestra.run.trial086:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-26T03:03:29.164 DEBUG:teuthology.orchestra.run.trial086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-26T03:03:29.322 DEBUG:teuthology.orchestra.run.trial086:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-26T03:03:29.347 DEBUG:teuthology.orchestra.run.trial086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-26T03:03:29.493 DEBUG:teuthology.orchestra.run.trial086:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-26T03:03:29.521 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-26T03:03:29.521 DEBUG:teuthology.orchestra.run.trial086:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-26T03:03:29.590 DEBUG:teuthology.orchestra.run.trial086:> sudo service rsyslog restart 2026-02-26T03:03:29.658 INFO:teuthology.orchestra.run.trial086.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-26T03:03:30.048 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-26T03:03:30.065 INFO:teuthology.task.internal:Starting timer... 2026-02-26T03:03:30.066 INFO:teuthology.run_tasks:Running task pcp... 2026-02-26T03:03:30.088 INFO:teuthology.run_tasks:Running task selinux... 2026-02-26T03:03:30.107 DEBUG:teuthology.orchestra.run.trial086:> sudo service auditd rotate 2026-02-26T03:03:30.137 INFO:teuthology.orchestra.run.trial086.stdout:Rotating logs: 2026-02-26T03:03:30.140 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-26T03:03:30.140 DEBUG:teuthology.orchestra.run.trial086:> /usr/sbin/getenforce 2026-02-26T03:03:30.195 INFO:teuthology.orchestra.run.trial086.stdout:Permissive 2026-02-26T03:03:30.195 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial086.front.sepia.ceph.com': 'permissive'} 2026-02-26T03:03:30.195 DEBUG:teuthology.orchestra.run.trial086:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-26T03:03:30.259 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-26T03:03:30.260 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-26T03:03:30.260 DEBUG:teuthology.orchestra.run.trial086:> sudo /usr/sbin/setenforce permissive 2026-02-26T03:03:30.324 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-26T03:03:30.338 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-26T03:03:30.349 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-26T03:03:30.350 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial086.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-26T03:08:21.087 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial086.front.sepia.ceph.com')] 2026-02-26T03:08:21.088 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial086.front.sepia.ceph.com' 2026-02-26T03:08:21.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-26T03:08:21.197 DEBUG:teuthology.orchestra.run.trial086:> true 2026-02-26T03:08:21.271 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial086.front.sepia.ceph.com' 2026-02-26T03:08:21.272 INFO:teuthology.run_tasks:Running task clock... 2026-02-26T03:08:21.284 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-26T03:08:21.284 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-26T03:08:21.285 DEBUG:teuthology.orchestra.run.trial086:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-26T03:08:21.338 INFO:teuthology.orchestra.run.trial086.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-26T03:08:21.350 INFO:teuthology.orchestra.run.trial086.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-26T03:08:21.370 INFO:teuthology.orchestra.run.trial086.stderr:sudo: ntpd: command not found 2026-02-26T03:08:21.380 INFO:teuthology.orchestra.run.trial086.stdout:506 Cannot talk to daemon 2026-02-26T03:08:21.391 INFO:teuthology.orchestra.run.trial086.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-26T03:08:21.402 INFO:teuthology.orchestra.run.trial086.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-26T03:08:21.447 INFO:teuthology.orchestra.run.trial086.stderr:bash: line 1: ntpq: command not found 2026-02-26T03:08:21.449 INFO:teuthology.orchestra.run.trial086.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-26T03:08:21.449 INFO:teuthology.orchestra.run.trial086.stdout:=============================================================================== 2026-02-26T03:08:21.450 INFO:teuthology.run_tasks:Running task install... 2026-02-26T03:08:21.464 DEBUG:teuthology.task.install:project ceph 2026-02-26T03:08:21.465 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'debug', 'sha1': 'abffb617683951511fccf3c3cab6e219f2ec83a8'}} 2026-02-26T03:08:21.465 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'flavor': 'debug', 'sha1': 'abffb617683951511fccf3c3cab6e219f2ec83a8'} 2026-02-26T03:08:21.465 INFO:teuthology.task.install:Using flavor: debug 2026-02-26T03:08:21.475 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-26T03:08:21.475 INFO:teuthology.task.install:extra packages: {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']} 2026-02-26T03:08:21.476 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'abffb617683951511fccf3c3cab6e219f2ec83a8', 'tag': None, 'wait_for_package': False} 2026-02-26T03:08:21.476 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=abffb617683951511fccf3c3cab6e219f2ec83a8 2026-02-26T03:08:21.637 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-shraddhaag-peering-bug/abffb617683951511fccf3c3cab6e219f2ec83a8/centos/9/flavors/debug/ 2026-02-26T03:08:21.637 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5312.gabffb617 2026-02-26T03:08:21.991 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-shraddhaag-peering-bug/abffb617683951511fccf3c3cab6e219f2ec83a8/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-shraddhaag-peering-bug/abffb617683951511fccf3c3cab6e219f2ec83a8/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-shraddhaag-peering-bug/abffb617683951511fccf3c3cab6e219f2ec83a8/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-26T03:08:21.991 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-26T03:08:21.991 DEBUG:teuthology.orchestra.run.trial086:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-26T03:08:22.017 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-osd-crimson, ceph-osd-crimson-debuginfo on remote rpm x86_64 2026-02-26T03:08:22.018 DEBUG:teuthology.orchestra.run.trial086:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-26T03:08:22.082 DEBUG:teuthology.orchestra.run.trial086:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-26T03:08:22.155 DEBUG:teuthology.orchestra.run.trial086:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-26T03:08:22.218 INFO:teuthology.orchestra.run.trial086.stdout:check_obsoletes = 1 2026-02-26T03:08:22.220 DEBUG:teuthology.orchestra.run.trial086:> sudo yum clean all 2026-02-26T03:08:22.368 INFO:teuthology.orchestra.run.trial086.stdout:41 files removed 2026-02-26T03:08:22.381 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-radosgw 2026-02-26T03:08:23.143 INFO:teuthology.orchestra.run.trial086.stdout:ceph packages for x86_64 153 kB/s | 94 kB 00:00 2026-02-26T03:08:23.656 INFO:teuthology.orchestra.run.trial086.stdout:ceph noarch packages 50 kB/s | 24 kB 00:00 2026-02-26T03:08:23.986 INFO:teuthology.orchestra.run.trial086.stdout:ceph source packages 6.8 kB/s | 2.1 kB 00:00 2026-02-26T03:08:25.075 INFO:teuthology.orchestra.run.trial086.stdout:CentOS Stream 9 - BaseOS 8.3 MB/s | 8.9 MB 00:01 2026-02-26T03:08:28.265 INFO:teuthology.orchestra.run.trial086.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-26T03:08:33.956 INFO:teuthology.orchestra.run.trial086.stdout:CentOS Stream 9 - CRB 2.4 MB/s | 8.0 MB 00:03 2026-02-26T03:08:34.890 INFO:teuthology.orchestra.run.trial086.stdout:CentOS Stream 9 - Extras packages 107 kB/s | 20 kB 00:00 2026-02-26T03:08:36.098 INFO:teuthology.orchestra.run.trial086.stdout:Extra Packages for Enterprise Linux 18 MB/s | 20 MB 00:01 2026-02-26T03:08:39.322 INFO:teuthology.orchestra.run.trial086.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-26T03:08:40.559 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:08:40.561 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-26T03:08:40.561 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repository Size 2026-02-26T03:08:40.561 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-26T03:08:40.561 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-26T03:08:40.561 INFO:teuthology.orchestra.run.trial086.stdout: ceph-radosgw x86_64 2:20.3.0-5312.gabffb617.el9 ceph 11 M 2026-02-26T03:08:40.561 INFO:teuthology.orchestra.run.trial086.stdout:Upgrading: 2026-02-26T03:08:40.561 INFO:teuthology.orchestra.run.trial086.stdout: librados2 x86_64 2:20.3.0-5312.gabffb617.el9 ceph 3.3 M 2026-02-26T03:08:40.561 INFO:teuthology.orchestra.run.trial086.stdout: librbd1 x86_64 2:20.3.0-5312.gabffb617.el9 ceph 2.7 M 2026-02-26T03:08:40.561 INFO:teuthology.orchestra.run.trial086.stdout:Installing dependencies: 2026-02-26T03:08:40.562 INFO:teuthology.orchestra.run.trial086.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-26T03:08:40.562 INFO:teuthology.orchestra.run.trial086.stdout: ceph-base x86_64 2:20.3.0-5312.gabffb617.el9 ceph 5.1 M 2026-02-26T03:08:40.562 INFO:teuthology.orchestra.run.trial086.stdout: ceph-common x86_64 2:20.3.0-5312.gabffb617.el9 ceph 21 M 2026-02-26T03:08:40.562 INFO:teuthology.orchestra.run.trial086.stdout: ceph-selinux x86_64 2:20.3.0-5312.gabffb617.el9 ceph 25 k 2026-02-26T03:08:40.562 INFO:teuthology.orchestra.run.trial086.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-26T03:08:40.562 INFO:teuthology.orchestra.run.trial086.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-26T03:08:40.562 INFO:teuthology.orchestra.run.trial086.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-26T03:08:40.562 INFO:teuthology.orchestra.run.trial086.stdout: libcephfs2 x86_64 2:20.3.0-5312.gabffb617.el9 ceph 859 k 2026-02-26T03:08:40.562 INFO:teuthology.orchestra.run.trial086.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-26T03:08:40.562 INFO:teuthology.orchestra.run.trial086.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-26T03:08:40.562 INFO:teuthology.orchestra.run.trial086.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-26T03:08:40.562 INFO:teuthology.orchestra.run.trial086.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-26T03:08:40.563 INFO:teuthology.orchestra.run.trial086.stdout: libradosstriper1 x86_64 2:20.3.0-5312.gabffb617.el9 ceph 263 k 2026-02-26T03:08:40.563 INFO:teuthology.orchestra.run.trial086.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-26T03:08:40.563 INFO:teuthology.orchestra.run.trial086.stdout: librgw2 x86_64 2:20.3.0-5312.gabffb617.el9 ceph 5.6 M 2026-02-26T03:08:40.563 INFO:teuthology.orchestra.run.trial086.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-26T03:08:40.563 INFO:teuthology.orchestra.run.trial086.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-26T03:08:40.563 INFO:teuthology.orchestra.run.trial086.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-26T03:08:40.563 INFO:teuthology.orchestra.run.trial086.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-26T03:08:40.563 INFO:teuthology.orchestra.run.trial086.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-26T03:08:40.563 INFO:teuthology.orchestra.run.trial086.stdout: python3-ceph-argparse x86_64 2:20.3.0-5312.gabffb617.el9 ceph 45 k 2026-02-26T03:08:40.563 INFO:teuthology.orchestra.run.trial086.stdout: python3-ceph-common x86_64 2:20.3.0-5312.gabffb617.el9 ceph 185 k 2026-02-26T03:08:40.563 INFO:teuthology.orchestra.run.trial086.stdout: python3-cephfs x86_64 2:20.3.0-5312.gabffb617.el9 ceph 203 k 2026-02-26T03:08:40.564 INFO:teuthology.orchestra.run.trial086.stdout: python3-rados x86_64 2:20.3.0-5312.gabffb617.el9 ceph 324 k 2026-02-26T03:08:40.564 INFO:teuthology.orchestra.run.trial086.stdout: python3-rbd x86_64 2:20.3.0-5312.gabffb617.el9 ceph 305 k 2026-02-26T03:08:40.564 INFO:teuthology.orchestra.run.trial086.stdout: python3-rgw x86_64 2:20.3.0-5312.gabffb617.el9 ceph 100 k 2026-02-26T03:08:40.564 INFO:teuthology.orchestra.run.trial086.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-26T03:08:40.564 INFO:teuthology.orchestra.run.trial086.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-26T03:08:40.564 INFO:teuthology.orchestra.run.trial086.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-26T03:08:40.564 INFO:teuthology.orchestra.run.trial086.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-26T03:08:40.564 INFO:teuthology.orchestra.run.trial086.stdout:Installing weak dependencies: 2026-02-26T03:08:40.564 INFO:teuthology.orchestra.run.trial086.stdout: libcephfs-daemon x86_64 2:20.3.0-5312.gabffb617.el9 ceph 37 k 2026-02-26T03:08:40.564 INFO:teuthology.orchestra.run.trial086.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5312.gabffb617.el9 ceph 26 k 2026-02-26T03:08:40.564 INFO:teuthology.orchestra.run.trial086.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-26T03:08:40.565 INFO:teuthology.orchestra.run.trial086.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-26T03:08:40.565 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:08:40.565 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-26T03:08:40.565 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-26T03:08:40.565 INFO:teuthology.orchestra.run.trial086.stdout:Install 35 Packages 2026-02-26T03:08:40.565 INFO:teuthology.orchestra.run.trial086.stdout:Upgrade 2 Packages 2026-02-26T03:08:40.565 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:08:40.566 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 61 M 2026-02-26T03:08:40.566 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-26T03:08:42.593 INFO:teuthology.orchestra.run.trial086.stdout:(1/37): ceph-base-20.3.0-5312.gabffb617.el9.x86 3.3 MB/s | 5.1 MB 00:01 2026-02-26T03:08:42.640 INFO:teuthology.orchestra.run.trial086.stdout:(2/37): ceph-selinux-20.3.0-5312.gabffb617.el9. 533 kB/s | 25 kB 00:00 2026-02-26T03:08:42.695 INFO:teuthology.orchestra.run.trial086.stdout:(3/37): libcephfs-daemon-20.3.0-5312.gabffb617. 680 kB/s | 37 kB 00:00 2026-02-26T03:08:42.756 INFO:teuthology.orchestra.run.trial086.stdout:(4/37): libcephfs-proxy2-20.3.0-5312.gabffb617. 418 kB/s | 26 kB 00:00 2026-02-26T03:08:42.962 INFO:teuthology.orchestra.run.trial086.stdout:(5/37): libcephfs2-20.3.0-5312.gabffb617.el9.x8 4.1 MB/s | 859 kB 00:00 2026-02-26T03:08:43.055 INFO:teuthology.orchestra.run.trial086.stdout:(6/37): libradosstriper1-20.3.0-5312.gabffb617. 2.8 MB/s | 263 kB 00:00 2026-02-26T03:08:44.058 INFO:teuthology.orchestra.run.trial086.stdout:(7/37): ceph-radosgw-20.3.0-5312.gabffb617.el9. 3.7 MB/s | 11 MB 00:03 2026-02-26T03:08:44.135 INFO:teuthology.orchestra.run.trial086.stdout:(8/37): ceph-common-20.3.0-5312.gabffb617.el9.x 6.7 MB/s | 21 MB 00:03 2026-02-26T03:08:44.136 INFO:teuthology.orchestra.run.trial086.stdout:(9/37): python3-ceph-argparse-20.3.0-5312.gabff 580 kB/s | 45 kB 00:00 2026-02-26T03:08:44.184 INFO:teuthology.orchestra.run.trial086.stdout:(10/37): python3-ceph-common-20.3.0-5312.gabffb 3.7 MB/s | 185 kB 00:00 2026-02-26T03:08:44.202 INFO:teuthology.orchestra.run.trial086.stdout:(11/37): python3-cephfs-20.3.0-5312.gabffb617.e 3.0 MB/s | 203 kB 00:00 2026-02-26T03:08:44.241 INFO:teuthology.orchestra.run.trial086.stdout:(12/37): librgw2-20.3.0-5312.gabffb617.el9.x86_ 4.7 MB/s | 5.6 MB 00:01 2026-02-26T03:08:44.241 INFO:teuthology.orchestra.run.trial086.stdout:(13/37): python3-rados-20.3.0-5312.gabffb617.el 5.5 MB/s | 324 kB 00:00 2026-02-26T03:08:44.297 INFO:teuthology.orchestra.run.trial086.stdout:(14/37): python3-rbd-20.3.0-5312.gabffb617.el9. 3.1 MB/s | 305 kB 00:00 2026-02-26T03:08:44.297 INFO:teuthology.orchestra.run.trial086.stdout:(15/37): python3-rgw-20.3.0-5312.gabffb617.el9. 1.7 MB/s | 100 kB 00:00 2026-02-26T03:08:44.798 INFO:teuthology.orchestra.run.trial086.stdout:(16/37): mailcap-2.1.49-5.el9.noarch.rpm 60 kB/s | 33 kB 00:00 2026-02-26T03:08:44.951 INFO:teuthology.orchestra.run.trial086.stdout:(17/37): boost-program-options-1.75.0-13.el9.x8 682 kB/s | 104 kB 00:00 2026-02-26T03:08:45.058 INFO:teuthology.orchestra.run.trial086.stdout:(18/37): libnbd-1.20.3-4.el9.x86_64.rpm 1.5 MB/s | 164 kB 00:00 2026-02-26T03:08:45.096 INFO:teuthology.orchestra.run.trial086.stdout:(19/37): pciutils-3.7.0-7.el9.x86_64.rpm 117 kB/s | 93 kB 00:00 2026-02-26T03:08:45.107 INFO:teuthology.orchestra.run.trial086.stdout:(20/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.2 MB/s | 160 kB 00:00 2026-02-26T03:08:45.171 INFO:teuthology.orchestra.run.trial086.stdout:(21/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 598 kB/s | 45 kB 00:00 2026-02-26T03:08:45.277 INFO:teuthology.orchestra.run.trial086.stdout:(22/37): librdkafka-1.6.1-102.el9.x86_64.rpm 3.8 MB/s | 662 kB 00:00 2026-02-26T03:08:45.325 INFO:teuthology.orchestra.run.trial086.stdout:(23/37): qatlib-25.08.0-2.el9.x86_64.rpm 4.9 MB/s | 240 kB 00:00 2026-02-26T03:08:45.326 INFO:teuthology.orchestra.run.trial086.stdout:(24/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.8 MB/s | 292 kB 00:00 2026-02-26T03:08:45.347 INFO:teuthology.orchestra.run.trial086.stdout:(25/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 3.1 MB/s | 66 kB 00:00 2026-02-26T03:08:45.349 INFO:teuthology.orchestra.run.trial086.stdout:(26/37): qatlib-service-25.08.0-2.el9.x86_64.rp 1.5 MB/s | 37 kB 00:00 2026-02-26T03:08:45.510 INFO:teuthology.orchestra.run.trial086.stdout:(27/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.9 MB/s | 308 kB 00:00 2026-02-26T03:08:45.534 INFO:teuthology.orchestra.run.trial086.stdout:(28/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 1.0 MB/s | 25 kB 00:00 2026-02-26T03:08:45.560 INFO:teuthology.orchestra.run.trial086.stdout:(29/37): liboath-2.6.12-1.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2026-02-26T03:08:45.586 INFO:teuthology.orchestra.run.trial086.stdout:(30/37): libunwind-1.6.2-1.el9.x86_64.rpm 2.5 MB/s | 67 kB 00:00 2026-02-26T03:08:45.628 INFO:teuthology.orchestra.run.trial086.stdout:(31/37): libarrow-9.0.0-15.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2026-02-26T03:08:45.654 INFO:teuthology.orchestra.run.trial086.stdout:(32/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 12 MB/s | 838 kB 00:00 2026-02-26T03:08:45.655 INFO:teuthology.orchestra.run.trial086.stdout:(33/37): re2-20211101-20.el9.x86_64.rpm 6.8 MB/s | 191 kB 00:00 2026-02-26T03:08:45.713 INFO:teuthology.orchestra.run.trial086.stdout:(34/37): thrift-0.15.0-4.el9.x86_64.rpm 26 MB/s | 1.6 MB 00:00 2026-02-26T03:08:46.191 INFO:teuthology.orchestra.run.trial086.stdout:(35/37): nvme-cli-2.16-1.el9.x86_64.rpm 622 kB/s | 1.2 MB 00:01 2026-02-26T03:08:46.402 INFO:teuthology.orchestra.run.trial086.stdout:(36/37): librbd1-20.3.0-5312.gabffb617.el9.x86_ 3.9 MB/s | 2.7 MB 00:00 2026-02-26T03:08:46.406 INFO:teuthology.orchestra.run.trial086.stdout:(37/37): librados2-20.3.0-5312.gabffb617.el9.x8 4.4 MB/s | 3.3 MB 00:00 2026-02-26T03:08:46.409 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-26T03:08:46.409 INFO:teuthology.orchestra.run.trial086.stdout:Total 11 MB/s | 61 MB 00:05 2026-02-26T03:08:46.508 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-26T03:08:46.528 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-26T03:08:46.528 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-26T03:08:46.777 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-26T03:08:46.777 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-26T03:08:47.067 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-26T03:08:47.209 INFO:teuthology.orchestra.run.trial086.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/39 2026-02-26T03:08:47.214 INFO:teuthology.orchestra.run.trial086.stdout: Upgrading : librados2-2:20.3.0-5312.gabffb617.el9.x86_64 2/39 2026-02-26T03:08:47.263 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: librados2-2:20.3.0-5312.gabffb617.el9.x86_64 2/39 2026-02-26T03:08:47.264 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libcephfs2-2:20.3.0-5312.gabffb617.el9.x86_64 3/39 2026-02-26T03:08:47.277 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: libcephfs2-2:20.3.0-5312.gabffb617.el9.x86_64 3/39 2026-02-26T03:08:47.280 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libcephfs-daemon-2:20.3.0-5312.gabffb617.el9.x86_6 4/39 2026-02-26T03:08:47.280 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libcephfs-proxy2-2:20.3.0-5312.gabffb617.el9.x86_6 5/39 2026-02-26T03:08:47.307 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5312.gabffb617.el9.x86_6 5/39 2026-02-26T03:08:47.310 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-rados-2:20.3.0-5312.gabffb617.el9.x86_64 6/39 2026-02-26T03:08:47.319 INFO:teuthology.orchestra.run.trial086.stdout: Installing : liboath-2.6.12-1.el9.x86_64 7/39 2026-02-26T03:08:47.322 INFO:teuthology.orchestra.run.trial086.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/39 2026-02-26T03:08:47.325 INFO:teuthology.orchestra.run.trial086.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/39 2026-02-26T03:08:47.329 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/39 2026-02-26T03:08:47.340 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-ceph-argparse-2:20.3.0-5312.gabffb617.el9. 11/39 2026-02-26T03:08:47.353 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-cephfs-2:20.3.0-5312.gabffb617.el9.x86_64 12/39 2026-02-26T03:08:47.354 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libradosstriper1-2:20.3.0-5312.gabffb617.el9.x86_6 13/39 2026-02-26T03:08:47.374 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5312.gabffb617.el9.x86_6 13/39 2026-02-26T03:08:47.378 INFO:teuthology.orchestra.run.trial086.stdout: Installing : thrift-0.15.0-4.el9.x86_64 14/39 2026-02-26T03:08:47.407 INFO:teuthology.orchestra.run.trial086.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-26T03:08:47.411 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-26T03:08:47.417 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-26T03:08:47.419 INFO:teuthology.orchestra.run.trial086.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-26T03:08:47.424 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-26T03:08:47.540 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-26T03:08:47.541 INFO:teuthology.orchestra.run.trial086.stdout: Upgrading : librbd1-2:20.3.0-5312.gabffb617.el9.x86_64 21/39 2026-02-26T03:08:47.567 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: librbd1-2:20.3.0-5312.gabffb617.el9.x86_64 21/39 2026-02-26T03:08:47.570 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-rbd-2:20.3.0-5312.gabffb617.el9.x86_64 22/39 2026-02-26T03:08:47.576 INFO:teuthology.orchestra.run.trial086.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-26T03:08:47.827 INFO:teuthology.orchestra.run.trial086.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-26T03:08:47.828 INFO:teuthology.orchestra.run.trial086.stdout: Installing : librgw2-2:20.3.0-5312.gabffb617.el9.x86_64 25/39 2026-02-26T03:08:47.846 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: librgw2-2:20.3.0-5312.gabffb617.el9.x86_64 25/39 2026-02-26T03:08:47.850 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-rgw-2:20.3.0-5312.gabffb617.el9.x86_64 26/39 2026-02-26T03:08:47.854 INFO:teuthology.orchestra.run.trial086.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-26T03:08:47.857 INFO:teuthology.orchestra.run.trial086.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-26T03:08:47.858 INFO:teuthology.orchestra.run.trial086.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-26T03:08:47.875 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-26T03:08:47.990 INFO:teuthology.orchestra.run.trial086.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-26T03:08:47.992 INFO:teuthology.orchestra.run.trial086.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-26T03:08:48.268 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-26T03:08:48.268 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-26T03:08:48.268 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:08:48.310 INFO:teuthology.orchestra.run.trial086.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-26T03:08:48.312 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-ceph-common-2:20.3.0-5312.gabffb617.el9.x8 33/39 2026-02-26T03:08:49.266 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-common-2:20.3.0-5312.gabffb617.el9.x86_64 34/39 2026-02-26T03:08:49.269 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-common-2:20.3.0-5312.gabffb617.el9.x86_64 34/39 2026-02-26T03:08:49.532 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-common-2:20.3.0-5312.gabffb617.el9.x86_64 34/39 2026-02-26T03:08:49.535 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-base-2:20.3.0-5312.gabffb617.el9.x86_64 35/39 2026-02-26T03:08:49.573 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-base-2:20.3.0-5312.gabffb617.el9.x86_64 35/39 2026-02-26T03:08:49.573 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-26T03:08:49.573 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-26T03:08:49.573 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:08:49.577 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-selinux-2:20.3.0-5312.gabffb617.el9.x86_64 36/39 2026-02-26T03:08:54.100 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5312.gabffb617.el9.x86_64 36/39 2026-02-26T03:08:54.100 INFO:teuthology.orchestra.run.trial086.stdout:skipping the directory /sys 2026-02-26T03:08:54.100 INFO:teuthology.orchestra.run.trial086.stdout:skipping the directory /proc 2026-02-26T03:08:54.100 INFO:teuthology.orchestra.run.trial086.stdout:skipping the directory /mnt 2026-02-26T03:08:54.100 INFO:teuthology.orchestra.run.trial086.stdout:skipping the directory /var/tmp 2026-02-26T03:08:54.100 INFO:teuthology.orchestra.run.trial086.stdout:skipping the directory /home 2026-02-26T03:08:54.100 INFO:teuthology.orchestra.run.trial086.stdout:skipping the directory /root 2026-02-26T03:08:54.100 INFO:teuthology.orchestra.run.trial086.stdout:skipping the directory /tmp 2026-02-26T03:08:54.101 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:08:54.604 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-radosgw-2:20.3.0-5312.gabffb617.el9.x86_64 37/39 2026-02-26T03:08:54.627 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5312.gabffb617.el9.x86_64 37/39 2026-02-26T03:08:54.627 INFO:teuthology.orchestra.run.trial086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T03:08:54.627 INFO:teuthology.orchestra.run.trial086.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-26T03:08:54.627 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-26T03:08:54.627 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-26T03:08:54.628 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:08:54.629 INFO:teuthology.orchestra.run.trial086.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-26T03:08:54.641 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-26T03:08:54.642 INFO:teuthology.orchestra.run.trial086.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-26T03:08:54.697 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-26T03:08:54.697 INFO:teuthology.orchestra.run.trial086.stdout:Creating group 'qat' with GID 992. 2026-02-26T03:08:54.697 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:08:54.988 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-base-2:20.3.0-5312.gabffb617.el9.x86_64 1/39 2026-02-26T03:08:54.988 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-common-2:20.3.0-5312.gabffb617.el9.x86_64 2/39 2026-02-26T03:08:54.989 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-radosgw-2:20.3.0-5312.gabffb617.el9.x86_64 3/39 2026-02-26T03:08:54.989 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-selinux-2:20.3.0-5312.gabffb617.el9.x86_64 4/39 2026-02-26T03:08:54.989 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libcephfs-daemon-2:20.3.0-5312.gabffb617.el9.x86_6 5/39 2026-02-26T03:08:54.989 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5312.gabffb617.el9.x86_6 6/39 2026-02-26T03:08:54.989 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libcephfs2-2:20.3.0-5312.gabffb617.el9.x86_64 7/39 2026-02-26T03:08:54.989 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libradosstriper1-2:20.3.0-5312.gabffb617.el9.x86_6 8/39 2026-02-26T03:08:54.989 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : librgw2-2:20.3.0-5312.gabffb617.el9.x86_64 9/39 2026-02-26T03:08:54.989 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5312.gabffb617.el9. 10/39 2026-02-26T03:08:54.989 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-ceph-common-2:20.3.0-5312.gabffb617.el9.x8 11/39 2026-02-26T03:08:54.990 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-cephfs-2:20.3.0-5312.gabffb617.el9.x86_64 12/39 2026-02-26T03:08:54.990 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-rados-2:20.3.0-5312.gabffb617.el9.x86_64 13/39 2026-02-26T03:08:54.990 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-rbd-2:20.3.0-5312.gabffb617.el9.x86_64 14/39 2026-02-26T03:08:54.990 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-rgw-2:20.3.0-5312.gabffb617.el9.x86_64 15/39 2026-02-26T03:08:54.990 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-26T03:08:54.990 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 17/39 2026-02-26T03:08:54.990 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-26T03:08:54.990 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-26T03:08:54.990 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-26T03:08:54.990 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-26T03:08:54.990 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-26T03:08:54.990 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-26T03:08:54.990 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-26T03:08:54.991 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-26T03:08:54.991 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-26T03:08:54.991 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-26T03:08:54.991 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-26T03:08:54.991 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-26T03:08:54.991 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-26T03:08:54.991 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-26T03:08:54.991 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-26T03:08:54.991 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-26T03:08:54.991 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-26T03:08:54.991 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-26T03:08:54.991 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : librados2-2:20.3.0-5312.gabffb617.el9.x86_64 36/39 2026-02-26T03:08:54.991 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-26T03:08:54.991 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : librbd1-2:20.3.0-5312.gabffb617.el9.x86_64 38/39 2026-02-26T03:08:55.054 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-26T03:08:55.054 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:08:55.054 INFO:teuthology.orchestra.run.trial086.stdout:Upgraded: 2026-02-26T03:08:55.055 INFO:teuthology.orchestra.run.trial086.stdout: librados2-2:20.3.0-5312.gabffb617.el9.x86_64 2026-02-26T03:08:55.055 INFO:teuthology.orchestra.run.trial086.stdout: librbd1-2:20.3.0-5312.gabffb617.el9.x86_64 2026-02-26T03:08:55.055 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-26T03:08:55.055 INFO:teuthology.orchestra.run.trial086.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-26T03:08:55.055 INFO:teuthology.orchestra.run.trial086.stdout: ceph-base-2:20.3.0-5312.gabffb617.el9.x86_64 2026-02-26T03:08:55.055 INFO:teuthology.orchestra.run.trial086.stdout: ceph-common-2:20.3.0-5312.gabffb617.el9.x86_64 2026-02-26T03:08:55.056 INFO:teuthology.orchestra.run.trial086.stdout: ceph-radosgw-2:20.3.0-5312.gabffb617.el9.x86_64 2026-02-26T03:08:55.056 INFO:teuthology.orchestra.run.trial086.stdout: ceph-selinux-2:20.3.0-5312.gabffb617.el9.x86_64 2026-02-26T03:08:55.056 INFO:teuthology.orchestra.run.trial086.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-26T03:08:55.056 INFO:teuthology.orchestra.run.trial086.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-26T03:08:55.056 INFO:teuthology.orchestra.run.trial086.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-26T03:08:55.056 INFO:teuthology.orchestra.run.trial086.stdout: libcephfs-daemon-2:20.3.0-5312.gabffb617.el9.x86_64 2026-02-26T03:08:55.057 INFO:teuthology.orchestra.run.trial086.stdout: libcephfs-proxy2-2:20.3.0-5312.gabffb617.el9.x86_64 2026-02-26T03:08:55.057 INFO:teuthology.orchestra.run.trial086.stdout: libcephfs2-2:20.3.0-5312.gabffb617.el9.x86_64 2026-02-26T03:08:55.057 INFO:teuthology.orchestra.run.trial086.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-26T03:08:55.057 INFO:teuthology.orchestra.run.trial086.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-26T03:08:55.057 INFO:teuthology.orchestra.run.trial086.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-26T03:08:55.057 INFO:teuthology.orchestra.run.trial086.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-26T03:08:55.058 INFO:teuthology.orchestra.run.trial086.stdout: libradosstriper1-2:20.3.0-5312.gabffb617.el9.x86_64 2026-02-26T03:08:55.058 INFO:teuthology.orchestra.run.trial086.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-26T03:08:55.058 INFO:teuthology.orchestra.run.trial086.stdout: librgw2-2:20.3.0-5312.gabffb617.el9.x86_64 2026-02-26T03:08:55.058 INFO:teuthology.orchestra.run.trial086.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-26T03:08:55.058 INFO:teuthology.orchestra.run.trial086.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-26T03:08:55.058 INFO:teuthology.orchestra.run.trial086.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-26T03:08:55.059 INFO:teuthology.orchestra.run.trial086.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-26T03:08:55.059 INFO:teuthology.orchestra.run.trial086.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-26T03:08:55.059 INFO:teuthology.orchestra.run.trial086.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-26T03:08:55.059 INFO:teuthology.orchestra.run.trial086.stdout: python3-ceph-argparse-2:20.3.0-5312.gabffb617.el9.x86_64 2026-02-26T03:08:55.059 INFO:teuthology.orchestra.run.trial086.stdout: python3-ceph-common-2:20.3.0-5312.gabffb617.el9.x86_64 2026-02-26T03:08:55.059 INFO:teuthology.orchestra.run.trial086.stdout: python3-cephfs-2:20.3.0-5312.gabffb617.el9.x86_64 2026-02-26T03:08:55.060 INFO:teuthology.orchestra.run.trial086.stdout: python3-rados-2:20.3.0-5312.gabffb617.el9.x86_64 2026-02-26T03:08:55.060 INFO:teuthology.orchestra.run.trial086.stdout: python3-rbd-2:20.3.0-5312.gabffb617.el9.x86_64 2026-02-26T03:08:55.060 INFO:teuthology.orchestra.run.trial086.stdout: python3-rgw-2:20.3.0-5312.gabffb617.el9.x86_64 2026-02-26T03:08:55.060 INFO:teuthology.orchestra.run.trial086.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-26T03:08:55.060 INFO:teuthology.orchestra.run.trial086.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-26T03:08:55.060 INFO:teuthology.orchestra.run.trial086.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-26T03:08:55.060 INFO:teuthology.orchestra.run.trial086.stdout: re2-1:20211101-20.el9.x86_64 2026-02-26T03:08:55.060 INFO:teuthology.orchestra.run.trial086.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-26T03:08:55.061 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:08:55.061 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:08:55.097 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-test 2026-02-26T03:08:55.419 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:16 ago on Thu 26 Feb 2026 03:08:39 AM UTC. 2026-02-26T03:08:55.503 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:08:55.504 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-26T03:08:55.505 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repository Size 2026-02-26T03:08:55.505 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-26T03:08:55.505 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-26T03:08:55.505 INFO:teuthology.orchestra.run.trial086.stdout: ceph-test x86_64 2:20.3.0-5312.gabffb617.el9 ceph 126 M 2026-02-26T03:08:55.505 INFO:teuthology.orchestra.run.trial086.stdout:Installing dependencies: 2026-02-26T03:08:55.505 INFO:teuthology.orchestra.run.trial086.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-26T03:08:55.505 INFO:teuthology.orchestra.run.trial086.stdout: libasan8 x86_64 15.2.1-7.el9 appstream 525 k 2026-02-26T03:08:55.505 INFO:teuthology.orchestra.run.trial086.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-26T03:08:55.505 INFO:teuthology.orchestra.run.trial086.stdout: libcephsqlite x86_64 2:20.3.0-5312.gabffb617.el9 ceph 153 k 2026-02-26T03:08:55.506 INFO:teuthology.orchestra.run.trial086.stdout: libubsan x86_64 11.5.0-14.el9 appstream 176 k 2026-02-26T03:08:55.506 INFO:teuthology.orchestra.run.trial086.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-26T03:08:55.506 INFO:teuthology.orchestra.run.trial086.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-26T03:08:55.506 INFO:teuthology.orchestra.run.trial086.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-26T03:08:55.506 INFO:teuthology.orchestra.run.trial086.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-26T03:08:55.506 INFO:teuthology.orchestra.run.trial086.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-26T03:08:55.506 INFO:teuthology.orchestra.run.trial086.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-26T03:08:55.506 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:08:55.506 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-26T03:08:55.506 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-26T03:08:55.507 INFO:teuthology.orchestra.run.trial086.stdout:Install 12 Packages 2026-02-26T03:08:55.507 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:08:55.507 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 131 M 2026-02-26T03:08:55.507 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 976 M 2026-02-26T03:08:55.507 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-26T03:08:55.991 INFO:teuthology.orchestra.run.trial086.stdout:(1/12): hwloc-libs-2.4.1-6.el9.x86_64.rpm 8.1 MB/s | 2.1 MB 00:00 2026-02-26T03:08:56.020 INFO:teuthology.orchestra.run.trial086.stdout:(2/12): libatomic-11.5.0-14.el9.x86_64.rpm 788 kB/s | 23 kB 00:00 2026-02-26T03:08:56.056 INFO:teuthology.orchestra.run.trial086.stdout:(3/12): lksctp-tools-1.0.19-2.el9.x86_64.rpm 2.5 MB/s | 94 kB 00:00 2026-02-26T03:08:56.190 INFO:teuthology.orchestra.run.trial086.stdout:(4/12): libcephsqlite-20.3.0-5312.gabffb617.el9 333 kB/s | 153 kB 00:00 2026-02-26T03:08:56.991 INFO:teuthology.orchestra.run.trial086.stdout:(5/12): libubsan-11.5.0-14.el9.x86_64.rpm 220 kB/s | 176 kB 00:00 2026-02-26T03:08:57.383 INFO:teuthology.orchestra.run.trial086.stdout:(6/12): libxslt-1.1.34-12.el9.x86_64.rpm 595 kB/s | 233 kB 00:00 2026-02-26T03:08:58.030 INFO:teuthology.orchestra.run.trial086.stdout:(7/12): libasan8-15.2.1-7.el9.x86_64.rpm 266 kB/s | 525 kB 00:01 2026-02-26T03:08:58.642 INFO:teuthology.orchestra.run.trial086.stdout:(8/12): protobuf-3.14.0-17.el9.x86_64.rpm 817 kB/s | 1.0 MB 00:01 2026-02-26T03:08:58.657 INFO:teuthology.orchestra.run.trial086.stdout:(9/12): socat-1.7.4.1-8.el9.x86_64.rpm 483 kB/s | 303 kB 00:00 2026-02-26T03:08:58.878 INFO:teuthology.orchestra.run.trial086.stdout:(10/12): xmlstarlet-1.6.1-20.el9.x86_64.rpm 270 kB/s | 64 kB 00:00 2026-02-26T03:08:58.987 INFO:teuthology.orchestra.run.trial086.stdout:(11/12): yaml-cpp-0.6.3-5.el9.x86_64.rpm 370 kB/s | 122 kB 00:00 2026-02-26T03:09:16.486 INFO:teuthology.orchestra.run.trial086.stdout:(12/12): ceph-test-20.3.0-5312.gabffb617.el9.x8 6.1 MB/s | 126 MB 00:20 2026-02-26T03:09:16.490 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-26T03:09:16.490 INFO:teuthology.orchestra.run.trial086.stdout:Total 6.2 MB/s | 131 MB 00:20 2026-02-26T03:09:16.566 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-26T03:09:16.577 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-26T03:09:16.578 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-26T03:09:17.006 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-26T03:09:17.006 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-26T03:09:17.462 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-26T03:09:17.471 INFO:teuthology.orchestra.run.trial086.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/12 2026-02-26T03:09:17.479 INFO:teuthology.orchestra.run.trial086.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 2/12 2026-02-26T03:09:17.484 INFO:teuthology.orchestra.run.trial086.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/12 2026-02-26T03:09:17.489 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/12 2026-02-26T03:09:17.491 INFO:teuthology.orchestra.run.trial086.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 5/12 2026-02-26T03:09:17.496 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libubsan-11.5.0-14.el9.x86_64 6/12 2026-02-26T03:09:17.497 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-26T03:09:17.514 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-26T03:09:17.517 INFO:teuthology.orchestra.run.trial086.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 8/12 2026-02-26T03:09:17.528 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 9/12 2026-02-26T03:09:17.536 INFO:teuthology.orchestra.run.trial086.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 10/12 2026-02-26T03:09:17.537 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libcephsqlite-2:20.3.0-5312.gabffb617.el9.x86_64 11/12 2026-02-26T03:09:24.531 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5312.gabffb617.el9.x86_64 11/12 2026-02-26T03:09:24.550 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-test-2:20.3.0-5312.gabffb617.el9.x86_64 12/12 2026-02-26T03:09:25.317 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-test-2:20.3.0-5312.gabffb617.el9.x86_64 12/12 2026-02-26T03:09:25.317 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-test-2:20.3.0-5312.gabffb617.el9.x86_64 1/12 2026-02-26T03:09:25.317 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libcephsqlite-2:20.3.0-5312.gabffb617.el9.x86_64 2/12 2026-02-26T03:09:25.317 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 3/12 2026-02-26T03:09:25.317 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 4/12 2026-02-26T03:09:25.317 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 5/12 2026-02-26T03:09:25.317 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libasan8-15.2.1-7.el9.x86_64 6/12 2026-02-26T03:09:25.318 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libubsan-11.5.0-14.el9.x86_64 7/12 2026-02-26T03:09:25.318 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 8/12 2026-02-26T03:09:25.318 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 9/12 2026-02-26T03:09:25.318 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 10/12 2026-02-26T03:09:25.318 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 11/12 2026-02-26T03:09:25.378 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 12/12 2026-02-26T03:09:25.378 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:09:25.378 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-26T03:09:25.378 INFO:teuthology.orchestra.run.trial086.stdout: ceph-test-2:20.3.0-5312.gabffb617.el9.x86_64 2026-02-26T03:09:25.378 INFO:teuthology.orchestra.run.trial086.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-26T03:09:25.378 INFO:teuthology.orchestra.run.trial086.stdout: libasan8-15.2.1-7.el9.x86_64 2026-02-26T03:09:25.379 INFO:teuthology.orchestra.run.trial086.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-26T03:09:25.379 INFO:teuthology.orchestra.run.trial086.stdout: libcephsqlite-2:20.3.0-5312.gabffb617.el9.x86_64 2026-02-26T03:09:25.379 INFO:teuthology.orchestra.run.trial086.stdout: libubsan-11.5.0-14.el9.x86_64 2026-02-26T03:09:25.379 INFO:teuthology.orchestra.run.trial086.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-26T03:09:25.379 INFO:teuthology.orchestra.run.trial086.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-26T03:09:25.379 INFO:teuthology.orchestra.run.trial086.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-26T03:09:25.379 INFO:teuthology.orchestra.run.trial086.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-26T03:09:25.379 INFO:teuthology.orchestra.run.trial086.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-26T03:09:25.379 INFO:teuthology.orchestra.run.trial086.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-26T03:09:25.379 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:09:25.379 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:09:25.423 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph 2026-02-26T03:09:25.737 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:46 ago on Thu 26 Feb 2026 03:08:39 AM UTC. 2026-02-26T03:09:25.825 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:09:25.828 INFO:teuthology.orchestra.run.trial086.stdout:======================================================================================= 2026-02-26T03:09:25.828 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repository Size 2026-02-26T03:09:25.828 INFO:teuthology.orchestra.run.trial086.stdout:======================================================================================= 2026-02-26T03:09:25.828 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-26T03:09:25.829 INFO:teuthology.orchestra.run.trial086.stdout: ceph x86_64 2:20.3.0-5312.gabffb617.el9 ceph 6.5 k 2026-02-26T03:09:25.829 INFO:teuthology.orchestra.run.trial086.stdout:Installing dependencies: 2026-02-26T03:09:25.829 INFO:teuthology.orchestra.run.trial086.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-26T03:09:25.829 INFO:teuthology.orchestra.run.trial086.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5312.gabffb617.el9 ceph-noarch 57 k 2026-02-26T03:09:25.829 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mds x86_64 2:20.3.0-5312.gabffb617.el9 ceph 2.0 M 2026-02-26T03:09:25.829 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr x86_64 2:20.3.0-5312.gabffb617.el9 ceph 937 k 2026-02-26T03:09:25.829 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5312.gabffb617.el9 ceph-noarch 297 k 2026-02-26T03:09:25.829 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mon x86_64 2:20.3.0-5312.gabffb617.el9 ceph 4.9 M 2026-02-26T03:09:25.829 INFO:teuthology.orchestra.run.trial086.stdout: ceph-osd x86_64 2:20.3.0-5312.gabffb617.el9 ceph 163 k 2026-02-26T03:09:25.830 INFO:teuthology.orchestra.run.trial086.stdout: ceph-osd-classic x86_64 2:20.3.0-5312.gabffb617.el9 ceph 15 M 2026-02-26T03:09:25.830 INFO:teuthology.orchestra.run.trial086.stdout: ceph-osd-crimson x86_64 2:20.3.0-5312.gabffb617.el9 ceph 87 M 2026-02-26T03:09:25.830 INFO:teuthology.orchestra.run.trial086.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5312.gabffb617.el9 ceph-noarch 17 k 2026-02-26T03:09:25.830 INFO:teuthology.orchestra.run.trial086.stdout: cephadm noarch 2:20.3.0-5312.gabffb617.el9 ceph-noarch 1.0 M 2026-02-26T03:09:25.830 INFO:teuthology.orchestra.run.trial086.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-26T03:09:25.830 INFO:teuthology.orchestra.run.trial086.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-26T03:09:25.830 INFO:teuthology.orchestra.run.trial086.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-26T03:09:25.830 INFO:teuthology.orchestra.run.trial086.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-26T03:09:25.830 INFO:teuthology.orchestra.run.trial086.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-26T03:09:25.831 INFO:teuthology.orchestra.run.trial086.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-26T03:09:25.831 INFO:teuthology.orchestra.run.trial086.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-26T03:09:25.831 INFO:teuthology.orchestra.run.trial086.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-26T03:09:25.831 INFO:teuthology.orchestra.run.trial086.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-26T03:09:25.831 INFO:teuthology.orchestra.run.trial086.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-26T03:09:25.831 INFO:teuthology.orchestra.run.trial086.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-26T03:09:25.831 INFO:teuthology.orchestra.run.trial086.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-26T03:09:25.831 INFO:teuthology.orchestra.run.trial086.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-26T03:09:25.831 INFO:teuthology.orchestra.run.trial086.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-26T03:09:25.831 INFO:teuthology.orchestra.run.trial086.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-26T03:09:25.831 INFO:teuthology.orchestra.run.trial086.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-26T03:09:25.832 INFO:teuthology.orchestra.run.trial086.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-26T03:09:25.832 INFO:teuthology.orchestra.run.trial086.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-26T03:09:25.832 INFO:teuthology.orchestra.run.trial086.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-26T03:09:25.832 INFO:teuthology.orchestra.run.trial086.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-26T03:09:25.832 INFO:teuthology.orchestra.run.trial086.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-26T03:09:25.832 INFO:teuthology.orchestra.run.trial086.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-26T03:09:25.832 INFO:teuthology.orchestra.run.trial086.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-26T03:09:25.832 INFO:teuthology.orchestra.run.trial086.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-26T03:09:25.832 INFO:teuthology.orchestra.run.trial086.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-26T03:09:25.832 INFO:teuthology.orchestra.run.trial086.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-26T03:09:25.833 INFO:teuthology.orchestra.run.trial086.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-26T03:09:25.833 INFO:teuthology.orchestra.run.trial086.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-26T03:09:25.833 INFO:teuthology.orchestra.run.trial086.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-26T03:09:25.833 INFO:teuthology.orchestra.run.trial086.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-26T03:09:25.833 INFO:teuthology.orchestra.run.trial086.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-26T03:09:25.833 INFO:teuthology.orchestra.run.trial086.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-26T03:09:25.833 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-26T03:09:25.833 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-26T03:09:25.833 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-26T03:09:25.834 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-26T03:09:25.834 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-26T03:09:25.834 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-26T03:09:25.834 INFO:teuthology.orchestra.run.trial086.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-26T03:09:25.834 INFO:teuthology.orchestra.run.trial086.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-26T03:09:25.834 INFO:teuthology.orchestra.run.trial086.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-26T03:09:25.834 INFO:teuthology.orchestra.run.trial086.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-26T03:09:25.834 INFO:teuthology.orchestra.run.trial086.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-26T03:09:25.834 INFO:teuthology.orchestra.run.trial086.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-26T03:09:25.834 INFO:teuthology.orchestra.run.trial086.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-26T03:09:25.835 INFO:teuthology.orchestra.run.trial086.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-26T03:09:25.835 INFO:teuthology.orchestra.run.trial086.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-26T03:09:25.835 INFO:teuthology.orchestra.run.trial086.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-26T03:09:25.835 INFO:teuthology.orchestra.run.trial086.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-26T03:09:25.835 INFO:teuthology.orchestra.run.trial086.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-26T03:09:25.835 INFO:teuthology.orchestra.run.trial086.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-26T03:09:25.835 INFO:teuthology.orchestra.run.trial086.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-26T03:09:25.835 INFO:teuthology.orchestra.run.trial086.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-26T03:09:25.836 INFO:teuthology.orchestra.run.trial086.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-26T03:09:25.836 INFO:teuthology.orchestra.run.trial086.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-02-26T03:09:25.836 INFO:teuthology.orchestra.run.trial086.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-02-26T03:09:25.836 INFO:teuthology.orchestra.run.trial086.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-26T03:09:25.836 INFO:teuthology.orchestra.run.trial086.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-26T03:09:25.836 INFO:teuthology.orchestra.run.trial086.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-26T03:09:25.836 INFO:teuthology.orchestra.run.trial086.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-26T03:09:25.836 INFO:teuthology.orchestra.run.trial086.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-26T03:09:25.836 INFO:teuthology.orchestra.run.trial086.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-26T03:09:25.836 INFO:teuthology.orchestra.run.trial086.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-26T03:09:25.837 INFO:teuthology.orchestra.run.trial086.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-26T03:09:25.837 INFO:teuthology.orchestra.run.trial086.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-26T03:09:25.837 INFO:teuthology.orchestra.run.trial086.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-26T03:09:25.837 INFO:teuthology.orchestra.run.trial086.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-26T03:09:25.837 INFO:teuthology.orchestra.run.trial086.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-26T03:09:25.837 INFO:teuthology.orchestra.run.trial086.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-26T03:09:25.837 INFO:teuthology.orchestra.run.trial086.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-26T03:09:25.837 INFO:teuthology.orchestra.run.trial086.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-26T03:09:25.837 INFO:teuthology.orchestra.run.trial086.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-26T03:09:25.837 INFO:teuthology.orchestra.run.trial086.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-26T03:09:25.838 INFO:teuthology.orchestra.run.trial086.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-26T03:09:25.838 INFO:teuthology.orchestra.run.trial086.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-26T03:09:25.838 INFO:teuthology.orchestra.run.trial086.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-26T03:09:25.838 INFO:teuthology.orchestra.run.trial086.stdout:Installing weak dependencies: 2026-02-26T03:09:25.838 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5312.gabffb617.el9 ceph-noarch 184 k 2026-02-26T03:09:25.838 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5312.gabffb617.el9 ceph-noarch 51 M 2026-02-26T03:09:25.838 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5312.gabffb617.el9 ceph-noarch 7.4 M 2026-02-26T03:09:25.838 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5312.gabffb617.el9 ceph-noarch 22 k 2026-02-26T03:09:25.838 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-rook noarch 2:20.3.0-5312.gabffb617.el9 ceph-noarch 50 k 2026-02-26T03:09:25.839 INFO:teuthology.orchestra.run.trial086.stdout: ceph-volume noarch 2:20.3.0-5312.gabffb617.el9 ceph-noarch 301 k 2026-02-26T03:09:25.839 INFO:teuthology.orchestra.run.trial086.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-26T03:09:25.839 INFO:teuthology.orchestra.run.trial086.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-26T03:09:25.839 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:09:25.839 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-26T03:09:25.839 INFO:teuthology.orchestra.run.trial086.stdout:======================================================================================= 2026-02-26T03:09:25.839 INFO:teuthology.orchestra.run.trial086.stdout:Install 96 Packages 2026-02-26T03:09:25.839 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:09:25.840 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 225 M 2026-02-26T03:09:25.840 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 1.5 G 2026-02-26T03:09:25.840 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-26T03:09:26.892 INFO:teuthology.orchestra.run.trial086.stdout:(1/96): ceph-20.3.0-5312.gabffb617.el9.x86_64.r 25 kB/s | 6.5 kB 00:00 2026-02-26T03:09:27.568 INFO:teuthology.orchestra.run.trial086.stdout:(2/96): ceph-mgr-20.3.0-5312.gabffb617.el9.x86_ 1.0 MB/s | 937 kB 00:00 2026-02-26T03:09:27.690 INFO:teuthology.orchestra.run.trial086.stdout:(3/96): ceph-osd-20.3.0-5312.gabffb617.el9.x86_ 1.3 MB/s | 163 kB 00:00 2026-02-26T03:09:27.773 INFO:teuthology.orchestra.run.trial086.stdout:(4/96): ceph-mds-20.3.0-5312.gabffb617.el9.x86_ 1.8 MB/s | 2.0 MB 00:01 2026-02-26T03:09:29.768 INFO:teuthology.orchestra.run.trial086.stdout:(5/96): ceph-mon-20.3.0-5312.gabffb617.el9.x86_ 1.7 MB/s | 4.9 MB 00:02 2026-02-26T03:09:29.832 INFO:teuthology.orchestra.run.trial086.stdout:(6/96): ceph-grafana-dashboards-20.3.0-5312.gab 893 kB/s | 57 kB 00:00 2026-02-26T03:09:29.962 INFO:teuthology.orchestra.run.trial086.stdout:(7/96): ceph-mgr-cephadm-20.3.0-5312.gabffb617. 1.4 MB/s | 184 kB 00:00 2026-02-26T03:09:34.414 INFO:teuthology.orchestra.run.trial086.stdout:(8/96): ceph-osd-classic-20.3.0-5312.gabffb617. 2.2 MB/s | 15 MB 00:06 2026-02-26T03:09:37.487 INFO:teuthology.orchestra.run.trial086.stdout:(9/96): ceph-mgr-diskprediction-local-20.3.0-53 2.4 MB/s | 7.4 MB 00:03 2026-02-26T03:09:37.548 INFO:teuthology.orchestra.run.trial086.stdout:(10/96): ceph-mgr-k8sevents-20.3.0-5312.gabffb6 366 kB/s | 22 kB 00:00 2026-02-26T03:09:37.678 INFO:teuthology.orchestra.run.trial086.stdout:(11/96): ceph-mgr-modules-core-20.3.0-5312.gabf 2.2 MB/s | 297 kB 00:00 2026-02-26T03:09:37.742 INFO:teuthology.orchestra.run.trial086.stdout:(12/96): ceph-mgr-rook-20.3.0-5312.gabffb617.el 789 kB/s | 50 kB 00:00 2026-02-26T03:09:37.808 INFO:teuthology.orchestra.run.trial086.stdout:(13/96): ceph-prometheus-alerts-20.3.0-5312.gab 263 kB/s | 17 kB 00:00 2026-02-26T03:09:37.946 INFO:teuthology.orchestra.run.trial086.stdout:(14/96): ceph-volume-20.3.0-5312.gabffb617.el9. 2.1 MB/s | 301 kB 00:00 2026-02-26T03:09:38.345 INFO:teuthology.orchestra.run.trial086.stdout:(15/96): cephadm-20.3.0-5312.gabffb617.el9.noar 2.5 MB/s | 1.0 MB 00:00 2026-02-26T03:09:38.397 INFO:teuthology.orchestra.run.trial086.stdout:(16/96): cryptsetup-2.8.1-3.el9.x86_64.rpm 6.6 MB/s | 351 kB 00:00 2026-02-26T03:09:38.406 INFO:teuthology.orchestra.run.trial086.stdout:(17/96): ledmon-libs-1.1.0-3.el9.x86_64.rpm 4.3 MB/s | 40 kB 00:00 2026-02-26T03:09:38.415 INFO:teuthology.orchestra.run.trial086.stdout:(18/96): libconfig-1.7.2-9.el9.x86_64.rpm 7.6 MB/s | 72 kB 00:00 2026-02-26T03:09:38.436 INFO:teuthology.orchestra.run.trial086.stdout:(19/96): libgfortran-11.5.0-14.el9.x86_64.rpm 38 MB/s | 794 kB 00:00 2026-02-26T03:09:38.448 INFO:teuthology.orchestra.run.trial086.stdout:(20/96): libquadmath-11.5.0-14.el9.x86_64.rpm 15 MB/s | 184 kB 00:00 2026-02-26T03:09:38.459 INFO:teuthology.orchestra.run.trial086.stdout:(21/96): python3-cffi-1.14.5-5.el9.x86_64.rpm 22 MB/s | 253 kB 00:00 2026-02-26T03:09:38.493 INFO:teuthology.orchestra.run.trial086.stdout:(22/96): python3-cryptography-36.0.1-5.el9.x86_ 37 MB/s | 1.2 MB 00:00 2026-02-26T03:09:38.504 INFO:teuthology.orchestra.run.trial086.stdout:(23/96): python3-ply-3.11-14.el9.noarch.rpm 9.7 MB/s | 106 kB 00:00 2026-02-26T03:09:38.515 INFO:teuthology.orchestra.run.trial086.stdout:(24/96): python3-pycparser-2.20-6.el9.noarch.rp 12 MB/s | 135 kB 00:00 2026-02-26T03:09:38.526 INFO:teuthology.orchestra.run.trial086.stdout:(25/96): python3-pyparsing-2.4.7-9.el9.noarch.r 13 MB/s | 150 kB 00:00 2026-02-26T03:09:38.537 INFO:teuthology.orchestra.run.trial086.stdout:(26/96): python3-requests-2.25.1-10.el9.noarch. 11 MB/s | 126 kB 00:00 2026-02-26T03:09:38.549 INFO:teuthology.orchestra.run.trial086.stdout:(27/96): python3-urllib3-1.26.5-7.el9.noarch.rp 19 MB/s | 218 kB 00:00 2026-02-26T03:09:38.560 INFO:teuthology.orchestra.run.trial086.stdout:(28/96): unzip-6.0-59.el9.x86_64.rpm 16 MB/s | 182 kB 00:00 2026-02-26T03:09:38.571 INFO:teuthology.orchestra.run.trial086.stdout:(29/96): zip-3.0-35.el9.x86_64.rpm 24 MB/s | 266 kB 00:00 2026-02-26T03:09:39.159 INFO:teuthology.orchestra.run.trial086.stdout:(30/96): flexiblas-3.0.4-9.el9.x86_64.rpm 50 kB/s | 30 kB 00:00 2026-02-26T03:09:40.256 INFO:teuthology.orchestra.run.trial086.stdout:(31/96): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 2.7 MB/s | 3.0 MB 00:01 2026-02-26T03:09:40.750 INFO:teuthology.orchestra.run.trial086.stdout:(32/96): flexiblas-openblas-openmp-3.0.4-9.el9. 30 kB/s | 15 kB 00:00 2026-02-26T03:09:41.543 INFO:teuthology.orchestra.run.trial086.stdout:(33/96): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 311 kB/s | 246 kB 00:00 2026-02-26T03:09:42.302 INFO:teuthology.orchestra.run.trial086.stdout:(34/96): lua-5.4.4-4.el9.x86_64.rpm 248 kB/s | 188 kB 00:00 2026-02-26T03:09:42.909 INFO:teuthology.orchestra.run.trial086.stdout:(35/96): openblas-0.3.29-1.el9.x86_64.rpm 69 kB/s | 42 kB 00:00 2026-02-26T03:09:44.060 INFO:teuthology.orchestra.run.trial086.stdout:(36/96): openblas-openmp-0.3.29-1.el9.x86_64.rp 4.6 MB/s | 5.3 MB 00:01 2026-02-26T03:09:45.220 INFO:teuthology.orchestra.run.trial086.stdout:(37/96): python3-babel-2.9.1-2.el9.noarch.rpm 5.1 MB/s | 6.0 MB 00:01 2026-02-26T03:09:46.023 INFO:teuthology.orchestra.run.trial086.stdout:(38/96): python3-devel-3.9.25-3.el9.x86_64.rpm 305 kB/s | 244 kB 00:00 2026-02-26T03:09:46.833 INFO:teuthology.orchestra.run.trial086.stdout:(39/96): python3-jinja2-2.11.3-8.el9.noarch.rpm 307 kB/s | 249 kB 00:00 2026-02-26T03:09:47.457 INFO:teuthology.orchestra.run.trial086.stdout:(40/96): python3-jmespath-1.0.1-1.el9.noarch.rp 76 kB/s | 48 kB 00:00 2026-02-26T03:09:48.228 INFO:teuthology.orchestra.run.trial086.stdout:(41/96): python3-libstoragemgmt-1.10.1-1.el9.x8 229 kB/s | 177 kB 00:00 2026-02-26T03:09:49.231 INFO:teuthology.orchestra.run.trial086.stdout:(42/96): python3-lxml-4.6.5-3.el9.x86_64.rpm 1.2 MB/s | 1.2 MB 00:01 2026-02-26T03:09:49.827 INFO:teuthology.orchestra.run.trial086.stdout:(43/96): python3-markupsafe-1.1.1-12.el9.x86_64 58 kB/s | 35 kB 00:00 2026-02-26T03:09:51.062 INFO:teuthology.orchestra.run.trial086.stdout:(44/96): ceph-osd-crimson-20.3.0-5312.gabffb617 3.7 MB/s | 87 MB 00:23 2026-02-26T03:09:51.074 INFO:teuthology.orchestra.run.trial086.stdout:(45/96): python3-numpy-1.23.5-2.el9.x86_64.rpm 4.9 MB/s | 6.1 MB 00:01 2026-02-26T03:09:51.749 INFO:teuthology.orchestra.run.trial086.stdout:(46/96): python3-packaging-20.9-5.el9.noarch.rp 114 kB/s | 77 kB 00:00 2026-02-26T03:09:51.924 INFO:teuthology.orchestra.run.trial086.stdout:(47/96): python3-numpy-f2py-1.23.5-2.el9.x86_64 513 kB/s | 442 kB 00:00 2026-02-26T03:09:52.547 INFO:teuthology.orchestra.run.trial086.stdout:(48/96): python3-protobuf-3.14.0-17.el9.noarch. 335 kB/s | 267 kB 00:00 2026-02-26T03:09:52.656 INFO:teuthology.orchestra.run.trial086.stdout:(49/96): python3-pyasn1-0.4.8-7.el9.noarch.rpm 215 kB/s | 157 kB 00:00 2026-02-26T03:09:53.274 INFO:teuthology.orchestra.run.trial086.stdout:(50/96): python3-requests-oauthlib-1.3.0-12.el9 87 kB/s | 54 kB 00:00 2026-02-26T03:09:53.377 INFO:teuthology.orchestra.run.trial086.stdout:(51/96): python3-pyasn1-modules-0.4.8-7.el9.noa 334 kB/s | 277 kB 00:00 2026-02-26T03:09:53.990 INFO:teuthology.orchestra.run.trial086.stdout:(52/96): python3-toml-0.10.2-6.el9.noarch.rpm 68 kB/s | 42 kB 00:00 2026-02-26T03:09:54.239 INFO:teuthology.orchestra.run.trial086.stdout:(53/96): ceph-mgr-dashboard-20.3.0-5312.gabffb6 2.1 MB/s | 51 MB 00:24 2026-02-26T03:09:54.757 INFO:teuthology.orchestra.run.trial086.stdout:(54/96): xmlsec1-1.2.29-13.el9.x86_64.rpm 246 kB/s | 189 kB 00:00 2026-02-26T03:09:54.821 INFO:teuthology.orchestra.run.trial086.stdout:(55/96): python3-scipy-1.9.3-2.el9.x86_64.rpm 12 MB/s | 19 MB 00:01 2026-02-26T03:09:54.944 INFO:teuthology.orchestra.run.trial086.stdout:(56/96): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 129 kB/s | 90 kB 00:00 2026-02-26T03:09:55.197 INFO:teuthology.orchestra.run.trial086.stdout:(57/96): abseil-cpp-20211102.0-4.el9.x86_64.rpm 2.1 MB/s | 551 kB 00:00 2026-02-26T03:09:55.218 INFO:teuthology.orchestra.run.trial086.stdout:(58/96): lua-devel-5.4.4-4.el9.x86_64.rpm 48 kB/s | 22 kB 00:00 2026-02-26T03:09:55.228 INFO:teuthology.orchestra.run.trial086.stdout:(59/96): grpc-data-1.46.7-10.el9.noarch.rpm 644 kB/s | 19 kB 00:00 2026-02-26T03:09:55.278 INFO:teuthology.orchestra.run.trial086.stdout:(60/96): python3-asyncssh-2.13.2-5.el9.noarch.r 11 MB/s | 548 kB 00:00 2026-02-26T03:09:55.308 INFO:teuthology.orchestra.run.trial086.stdout:(61/96): python3-autocommand-2.2.2-8.el9.noarch 977 kB/s | 29 kB 00:00 2026-02-26T03:09:55.339 INFO:teuthology.orchestra.run.trial086.stdout:(62/96): python3-backports-tarfile-1.2.0-1.el9. 1.9 MB/s | 60 kB 00:00 2026-02-26T03:09:55.369 INFO:teuthology.orchestra.run.trial086.stdout:(63/96): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.4 MB/s | 43 kB 00:00 2026-02-26T03:09:55.400 INFO:teuthology.orchestra.run.trial086.stdout:(64/96): python3-cachetools-4.2.4-1.el9.noarch. 1.0 MB/s | 32 kB 00:00 2026-02-26T03:09:55.415 INFO:teuthology.orchestra.run.trial086.stdout:(65/96): luarocks-3.9.2-5.el9.noarch.rpm 767 kB/s | 151 kB 00:00 2026-02-26T03:09:55.430 INFO:teuthology.orchestra.run.trial086.stdout:(66/96): python3-certifi-2023.05.07-4.el9.noarc 472 kB/s | 14 kB 00:00 2026-02-26T03:09:55.470 INFO:teuthology.orchestra.run.trial086.stdout:(67/96): python3-cherrypy-18.6.1-2.el9.noarch.r 8.7 MB/s | 358 kB 00:00 2026-02-26T03:09:55.475 INFO:teuthology.orchestra.run.trial086.stdout:(68/96): python3-cheroot-10.0.1-4.el9.noarch.rp 2.8 MB/s | 173 kB 00:00 2026-02-26T03:09:55.508 INFO:teuthology.orchestra.run.trial086.stdout:(69/96): python3-google-auth-2.45.0-1.el9.noarc 6.7 MB/s | 254 kB 00:00 2026-02-26T03:09:55.542 INFO:teuthology.orchestra.run.trial086.stdout:(70/96): python3-grpcio-tools-1.46.7-10.el9.x86 4.1 MB/s | 144 kB 00:00 2026-02-26T03:09:55.575 INFO:teuthology.orchestra.run.trial086.stdout:(71/96): python3-influxdb-5.3.1-1.el9.noarch.rp 4.1 MB/s | 139 kB 00:00 2026-02-26T03:09:55.602 INFO:teuthology.orchestra.run.trial086.stdout:(72/96): python3-grpcio-1.46.7-10.el9.x86_64.rp 16 MB/s | 2.0 MB 00:00 2026-02-26T03:09:55.606 INFO:teuthology.orchestra.run.trial086.stdout:(73/96): python3-isodate-0.6.1-3.el9.noarch.rpm 1.8 MB/s | 56 kB 00:00 2026-02-26T03:09:55.632 INFO:teuthology.orchestra.run.trial086.stdout:(74/96): python3-jaraco-8.2.1-3.el9.noarch.rpm 357 kB/s | 11 kB 00:00 2026-02-26T03:09:55.637 INFO:teuthology.orchestra.run.trial086.stdout:(75/96): python3-jaraco-classes-3.2.1-5.el9.noa 580 kB/s | 18 kB 00:00 2026-02-26T03:09:55.690 INFO:teuthology.orchestra.run.trial086.stdout:(76/96): python3-jaraco-collections-3.0.0-8.el9 403 kB/s | 23 kB 00:00 2026-02-26T03:09:55.690 INFO:teuthology.orchestra.run.trial086.stdout:(77/96): python3-jaraco-context-6.0.1-3.el9.noa 372 kB/s | 20 kB 00:00 2026-02-26T03:09:55.720 INFO:teuthology.orchestra.run.trial086.stdout:(78/96): python3-jaraco-functools-3.5.0-2.el9.n 643 kB/s | 19 kB 00:00 2026-02-26T03:09:55.720 INFO:teuthology.orchestra.run.trial086.stdout:(79/96): python3-jaraco-text-4.0.0-2.el9.noarch 872 kB/s | 26 kB 00:00 2026-02-26T03:09:55.751 INFO:teuthology.orchestra.run.trial086.stdout:(80/96): python3-more-itertools-8.12.0-2.el9.no 2.5 MB/s | 79 kB 00:00 2026-02-26T03:09:55.782 INFO:teuthology.orchestra.run.trial086.stdout:(81/96): python3-msgpack-1.0.3-2.el9.x86_64.rpm 2.7 MB/s | 86 kB 00:00 2026-02-26T03:09:55.783 INFO:teuthology.orchestra.run.trial086.stdout:(82/96): python3-kubernetes-26.1.0-3.el9.noarch 16 MB/s | 1.0 MB 00:00 2026-02-26T03:09:55.812 INFO:teuthology.orchestra.run.trial086.stdout:(83/96): python3-natsort-7.1.1-5.el9.noarch.rpm 1.9 MB/s | 58 kB 00:00 2026-02-26T03:09:55.813 INFO:teuthology.orchestra.run.trial086.stdout:(84/96): python3-portend-3.1.0-2.el9.noarch.rpm 549 kB/s | 16 kB 00:00 2026-02-26T03:09:55.843 INFO:teuthology.orchestra.run.trial086.stdout:(85/96): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.9 MB/s | 90 kB 00:00 2026-02-26T03:09:55.844 INFO:teuthology.orchestra.run.trial086.stdout:(86/96): python3-repoze-lru-0.7-16.el9.noarch.r 1.0 MB/s | 31 kB 00:00 2026-02-26T03:09:55.873 INFO:teuthology.orchestra.run.trial086.stdout:(87/96): python3-rsa-4.9-2.el9.noarch.rpm 1.9 MB/s | 59 kB 00:00 2026-02-26T03:09:55.874 INFO:teuthology.orchestra.run.trial086.stdout:(88/96): python3-routes-2.5.1-5.el9.noarch.rpm 5.9 MB/s | 188 kB 00:00 2026-02-26T03:09:55.904 INFO:teuthology.orchestra.run.trial086.stdout:(89/96): python3-saml-1.16.0-1.el9.noarch.rpm 4.0 MB/s | 125 kB 00:00 2026-02-26T03:09:55.905 INFO:teuthology.orchestra.run.trial086.stdout:(90/96): python3-tempora-5.0.0-2.el9.noarch.rpm 1.1 MB/s | 36 kB 00:00 2026-02-26T03:09:55.936 INFO:teuthology.orchestra.run.trial086.stdout:(91/96): python3-typing-extensions-4.15.0-1.el9 2.8 MB/s | 86 kB 00:00 2026-02-26T03:09:55.936 INFO:teuthology.orchestra.run.trial086.stdout:(92/96): python3-websocket-client-1.2.3-2.el9.n 2.8 MB/s | 90 kB 00:00 2026-02-26T03:09:55.966 INFO:teuthology.orchestra.run.trial086.stdout:(93/96): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 1.6 MB/s | 48 kB 00:00 2026-02-26T03:09:55.966 INFO:teuthology.orchestra.run.trial086.stdout:(94/96): python3-xmltodict-0.12.0-15.el9.noarch 734 kB/s | 22 kB 00:00 2026-02-26T03:09:55.997 INFO:teuthology.orchestra.run.trial086.stdout:(95/96): python3-zc-lockfile-2.0-10.el9.noarch. 640 kB/s | 20 kB 00:00 2026-02-26T03:09:56.262 INFO:teuthology.orchestra.run.trial086.stdout:(96/96): protobuf-compiler-3.14.0-17.el9.x86_64 598 kB/s | 862 kB 00:01 2026-02-26T03:09:56.268 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-26T03:09:56.268 INFO:teuthology.orchestra.run.trial086.stdout:Total 7.4 MB/s | 225 MB 00:30 2026-02-26T03:09:56.669 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-26T03:09:56.707 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-26T03:09:56.707 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-26T03:09:57.504 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-26T03:09:57.504 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-26T03:09:58.330 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-26T03:09:58.332 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/96 2026-02-26T03:09:58.335 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/96 2026-02-26T03:09:58.357 INFO:teuthology.orchestra.run.trial086.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/96 2026-02-26T03:09:58.391 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 4/96 2026-02-26T03:09:58.397 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/96 2026-02-26T03:09:58.399 INFO:teuthology.orchestra.run.trial086.stdout: Installing : lua-5.4.4-4.el9.x86_64 6/96 2026-02-26T03:09:58.404 INFO:teuthology.orchestra.run.trial086.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 7/96 2026-02-26T03:09:58.428 INFO:teuthology.orchestra.run.trial086.stdout: Installing : unzip-6.0-59.el9.x86_64 8/96 2026-02-26T03:09:58.440 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 9/96 2026-02-26T03:09:58.443 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 10/96 2026-02-26T03:09:58.449 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 11/96 2026-02-26T03:09:58.451 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 12/96 2026-02-26T03:09:58.462 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 13/96 2026-02-26T03:09:58.468 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 14/96 2026-02-26T03:09:58.492 INFO:teuthology.orchestra.run.trial086.stdout: Installing : zip-3.0-35.el9.x86_64 15/96 2026-02-26T03:09:58.495 INFO:teuthology.orchestra.run.trial086.stdout: Installing : luarocks-3.9.2-5.el9.noarch 16/96 2026-02-26T03:09:58.545 INFO:teuthology.orchestra.run.trial086.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 17/96 2026-02-26T03:09:58.557 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 18/96 2026-02-26T03:09:58.560 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-rsa-4.9-2.el9.noarch 19/96 2026-02-26T03:09:58.565 INFO:teuthology.orchestra.run.trial086.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 20/96 2026-02-26T03:09:58.570 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 21/96 2026-02-26T03:09:58.574 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 22/96 2026-02-26T03:09:58.577 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 23/96 2026-02-26T03:09:58.592 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 24/96 2026-02-26T03:09:58.596 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 25/96 2026-02-26T03:09:58.601 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 26/96 2026-02-26T03:09:58.612 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 27/96 2026-02-26T03:09:58.621 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 28/96 2026-02-26T03:09:58.627 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 29/96 2026-02-26T03:09:58.647 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 30/96 2026-02-26T03:09:58.658 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 31/96 2026-02-26T03:09:58.673 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 32/96 2026-02-26T03:09:58.677 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 33/96 2026-02-26T03:09:58.685 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 34/96 2026-02-26T03:09:58.725 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 35/96 2026-02-26T03:09:59.046 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 36/96 2026-02-26T03:09:59.056 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 37/96 2026-02-26T03:09:59.060 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 38/96 2026-02-26T03:09:59.066 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 39/96 2026-02-26T03:09:59.068 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 40/96 2026-02-26T03:09:59.095 INFO:teuthology.orchestra.run.trial086.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 41/96 2026-02-26T03:09:59.139 INFO:teuthology.orchestra.run.trial086.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 42/96 2026-02-26T03:09:59.148 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 43/96 2026-02-26T03:09:59.153 INFO:teuthology.orchestra.run.trial086.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 44/96 2026-02-26T03:09:59.157 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 45/96 2026-02-26T03:09:59.162 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 46/96 2026-02-26T03:09:59.166 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 47/96 2026-02-26T03:09:59.173 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 48/96 2026-02-26T03:09:59.176 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 49/96 2026-02-26T03:09:59.204 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 50/96 2026-02-26T03:09:59.214 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 51/96 2026-02-26T03:09:59.220 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 52/96 2026-02-26T03:09:59.226 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 53/96 2026-02-26T03:09:59.261 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 54/96 2026-02-26T03:09:59.484 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 55/96 2026-02-26T03:09:59.508 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 56/96 2026-02-26T03:09:59.512 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 57/96 2026-02-26T03:09:59.570 INFO:teuthology.orchestra.run.trial086.stdout: Installing : openblas-0.3.29-1.el9.x86_64 58/96 2026-02-26T03:09:59.572 INFO:teuthology.orchestra.run.trial086.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 59/96 2026-02-26T03:09:59.594 INFO:teuthology.orchestra.run.trial086.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 60/96 2026-02-26T03:09:59.919 INFO:teuthology.orchestra.run.trial086.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 61/96 2026-02-26T03:09:59.992 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 62/96 2026-02-26T03:10:00.662 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 63/96 2026-02-26T03:10:00.679 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 64/96 2026-02-26T03:10:00.689 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 65/96 2026-02-26T03:10:00.695 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-packaging-20.9-5.el9.noarch 66/96 2026-02-26T03:10:00.709 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-ply-3.11-14.el9.noarch 67/96 2026-02-26T03:10:00.725 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 68/96 2026-02-26T03:10:00.800 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 69/96 2026-02-26T03:10:00.809 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 70/96 2026-02-26T03:10:00.832 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 71/96 2026-02-26T03:10:00.862 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 72/96 2026-02-26T03:10:00.913 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 73/96 2026-02-26T03:10:00.918 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 74/96 2026-02-26T03:10:00.924 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 75/96 2026-02-26T03:10:00.925 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 76/96 2026-02-26T03:10:00.951 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-26T03:10:00.951 INFO:teuthology.orchestra.run.trial086.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-26T03:10:00.951 INFO:teuthology.orchestra.run.trial086.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-26T03:10:00.951 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:10:00.959 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-26T03:10:00.984 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-26T03:10:00.984 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-26T03:10:00.984 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:10:01.018 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 78/96 2026-02-26T03:10:01.603 INFO:teuthology.orchestra.run.trial086.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 79/96 2026-02-26T03:10:06.961 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-osd-classic-2:20.3.0-5312.gabffb617.el9.x86_6 80/96 2026-02-26T03:10:07.025 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-osd-crimson-2:20.3.0-5312.gabffb617.el9.x86_6 81/96 2026-02-26T03:10:07.027 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-volume-2:20.3.0-5312.gabffb617.el9.noarch 82/96 2026-02-26T03:10:07.042 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-volume-2:20.3.0-5312.gabffb617.el9.noarch 82/96 2026-02-26T03:10:07.042 INFO:teuthology.orchestra.run.trial086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T03:10:07.042 INFO:teuthology.orchestra.run.trial086.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-26T03:10:07.042 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:10:07.054 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-osd-2:20.3.0-5312.gabffb617.el9.x86_64 83/96 2026-02-26T03:10:07.079 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-osd-2:20.3.0-5312.gabffb617.el9.x86_64 83/96 2026-02-26T03:10:07.080 INFO:teuthology.orchestra.run.trial086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T03:10:07.080 INFO:teuthology.orchestra.run.trial086.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-26T03:10:07.080 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-26T03:10:07.080 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-26T03:10:07.080 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:10:07.140 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: cephadm-2:20.3.0-5312.gabffb617.el9.noarch 84/96 2026-02-26T03:10:07.142 INFO:teuthology.orchestra.run.trial086.stdout: Installing : cephadm-2:20.3.0-5312.gabffb617.el9.noarch 84/96 2026-02-26T03:10:07.151 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5312.gabffb617.el9 85/96 2026-02-26T03:10:07.175 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5312.gabffb617.el 86/96 2026-02-26T03:10:07.176 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5312.gabffb617.el9.noarc 87/96 2026-02-26T03:10:10.057 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5312.gabffb617.el9.noarc 87/96 2026-02-26T03:10:10.063 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5312.gabffb617.el9.noa 88/96 2026-02-26T03:10:10.523 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5312.gabffb617.el9.noa 88/96 2026-02-26T03:10:10.524 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5312.gabffb 89/96 2026-02-26T03:10:10.537 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5312.gabffb 89/96 2026-02-26T03:10:10.537 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5312.gabffb617.el9.noa 90/96 2026-02-26T03:10:10.599 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5312.gabffb617.el9.noa 90/96 2026-02-26T03:10:10.638 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5312.gabffb617.el9. 91/96 2026-02-26T03:10:10.639 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-mgr-2:20.3.0-5312.gabffb617.el9.x86_64 92/96 2026-02-26T03:10:10.660 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5312.gabffb617.el9.x86_64 92/96 2026-02-26T03:10:10.660 INFO:teuthology.orchestra.run.trial086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T03:10:10.660 INFO:teuthology.orchestra.run.trial086.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-26T03:10:10.660 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-26T03:10:10.660 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-26T03:10:10.661 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:10:10.672 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-mgr-rook-2:20.3.0-5312.gabffb617.el9.noarch 93/96 2026-02-26T03:10:10.883 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5312.gabffb617.el9.noarch 93/96 2026-02-26T03:10:10.884 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-mon-2:20.3.0-5312.gabffb617.el9.x86_64 94/96 2026-02-26T03:10:10.906 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-mon-2:20.3.0-5312.gabffb617.el9.x86_64 94/96 2026-02-26T03:10:10.906 INFO:teuthology.orchestra.run.trial086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T03:10:10.906 INFO:teuthology.orchestra.run.trial086.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-26T03:10:10.906 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-26T03:10:10.906 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-26T03:10:10.906 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:10:10.989 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-mds-2:20.3.0-5312.gabffb617.el9.x86_64 95/96 2026-02-26T03:10:11.010 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-mds-2:20.3.0-5312.gabffb617.el9.x86_64 95/96 2026-02-26T03:10:11.010 INFO:teuthology.orchestra.run.trial086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T03:10:11.010 INFO:teuthology.orchestra.run.trial086.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-26T03:10:11.010 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-26T03:10:11.010 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-26T03:10:11.010 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:10:11.011 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-2:20.3.0-5312.gabffb617.el9.x86_64 96/96 2026-02-26T03:10:11.018 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5312.gabffb617.el9.x86_6 96/96 2026-02-26T03:10:11.043 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5312.gabffb617.el9.x86_6 96/96 2026-02-26T03:10:12.425 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-2:20.3.0-5312.gabffb617.el9.x86_64 96/96 2026-02-26T03:10:12.426 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-2:20.3.0-5312.gabffb617.el9.x86_64 1/96 2026-02-26T03:10:12.426 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-mds-2:20.3.0-5312.gabffb617.el9.x86_64 2/96 2026-02-26T03:10:12.426 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-mgr-2:20.3.0-5312.gabffb617.el9.x86_64 3/96 2026-02-26T03:10:12.426 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-mon-2:20.3.0-5312.gabffb617.el9.x86_64 4/96 2026-02-26T03:10:12.426 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-osd-2:20.3.0-5312.gabffb617.el9.x86_64 5/96 2026-02-26T03:10:12.426 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-osd-classic-2:20.3.0-5312.gabffb617.el9.x86_6 6/96 2026-02-26T03:10:12.426 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5312.gabffb617.el9.x86_6 7/96 2026-02-26T03:10:12.426 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5312.gabffb617.el 8/96 2026-02-26T03:10:12.426 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5312.gabffb617.el9.noarc 9/96 2026-02-26T03:10:12.426 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5312.gabffb617.el9.noa 10/96 2026-02-26T03:10:12.427 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5312.gabffb 11/96 2026-02-26T03:10:12.427 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-mgr-k8sevents-2:20.3.0-5312.gabffb617.el9.noa 12/96 2026-02-26T03:10:12.427 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5312.gabffb617.el9. 13/96 2026-02-26T03:10:12.427 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5312.gabffb617.el9.noarch 14/96 2026-02-26T03:10:12.427 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5312.gabffb617.el9 15/96 2026-02-26T03:10:12.427 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-volume-2:20.3.0-5312.gabffb617.el9.noarch 16/96 2026-02-26T03:10:12.427 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : cephadm-2:20.3.0-5312.gabffb617.el9.noarch 17/96 2026-02-26T03:10:12.427 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 18/96 2026-02-26T03:10:12.427 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 19/96 2026-02-26T03:10:12.427 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 20/96 2026-02-26T03:10:12.427 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 21/96 2026-02-26T03:10:12.427 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 22/96 2026-02-26T03:10:12.428 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 23/96 2026-02-26T03:10:12.428 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 24/96 2026-02-26T03:10:12.428 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-ply-3.11-14.el9.noarch 25/96 2026-02-26T03:10:12.428 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 26/96 2026-02-26T03:10:12.428 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 27/96 2026-02-26T03:10:12.428 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 28/96 2026-02-26T03:10:12.428 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 29/96 2026-02-26T03:10:12.428 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : unzip-6.0-59.el9.x86_64 30/96 2026-02-26T03:10:12.428 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : zip-3.0-35.el9.x86_64 31/96 2026-02-26T03:10:12.428 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 32/96 2026-02-26T03:10:12.428 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 33/96 2026-02-26T03:10:12.428 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 34/96 2026-02-26T03:10:12.428 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 35/96 2026-02-26T03:10:12.429 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : lua-5.4.4-4.el9.x86_64 36/96 2026-02-26T03:10:12.429 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 37/96 2026-02-26T03:10:12.429 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 38/96 2026-02-26T03:10:12.429 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 39/96 2026-02-26T03:10:12.429 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 40/96 2026-02-26T03:10:12.429 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 41/96 2026-02-26T03:10:12.429 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 42/96 2026-02-26T03:10:12.429 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 43/96 2026-02-26T03:10:12.429 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 44/96 2026-02-26T03:10:12.429 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 45/96 2026-02-26T03:10:12.429 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 46/96 2026-02-26T03:10:12.429 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 47/96 2026-02-26T03:10:12.430 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 48/96 2026-02-26T03:10:12.430 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 49/96 2026-02-26T03:10:12.430 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 50/96 2026-02-26T03:10:12.430 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 51/96 2026-02-26T03:10:12.430 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 52/96 2026-02-26T03:10:12.430 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 53/96 2026-02-26T03:10:12.430 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 54/96 2026-02-26T03:10:12.430 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 55/96 2026-02-26T03:10:12.430 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 56/96 2026-02-26T03:10:12.430 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 57/96 2026-02-26T03:10:12.430 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 58/96 2026-02-26T03:10:12.430 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 59/96 2026-02-26T03:10:12.431 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 60/96 2026-02-26T03:10:12.431 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 61/96 2026-02-26T03:10:12.431 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 62/96 2026-02-26T03:10:12.431 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 63/96 2026-02-26T03:10:12.431 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 64/96 2026-02-26T03:10:12.431 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 65/96 2026-02-26T03:10:12.431 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 66/96 2026-02-26T03:10:12.431 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 67/96 2026-02-26T03:10:12.431 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 68/96 2026-02-26T03:10:12.431 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 69/96 2026-02-26T03:10:12.431 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 70/96 2026-02-26T03:10:12.431 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 71/96 2026-02-26T03:10:12.431 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 72/96 2026-02-26T03:10:12.432 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 73/96 2026-02-26T03:10:12.432 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 74/96 2026-02-26T03:10:12.432 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 75/96 2026-02-26T03:10:12.432 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 76/96 2026-02-26T03:10:12.432 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 77/96 2026-02-26T03:10:12.432 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 78/96 2026-02-26T03:10:12.432 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 79/96 2026-02-26T03:10:12.432 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 80/96 2026-02-26T03:10:12.432 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 81/96 2026-02-26T03:10:12.432 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/96 2026-02-26T03:10:12.432 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/96 2026-02-26T03:10:12.432 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/96 2026-02-26T03:10:12.432 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/96 2026-02-26T03:10:12.433 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/96 2026-02-26T03:10:12.433 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/96 2026-02-26T03:10:12.433 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/96 2026-02-26T03:10:12.433 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/96 2026-02-26T03:10:12.433 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/96 2026-02-26T03:10:12.433 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/96 2026-02-26T03:10:12.433 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/96 2026-02-26T03:10:12.433 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 93/96 2026-02-26T03:10:12.433 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 94/96 2026-02-26T03:10:12.433 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 95/96 2026-02-26T03:10:12.496 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 96/96 2026-02-26T03:10:12.496 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:10:12.496 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-26T03:10:12.496 INFO:teuthology.orchestra.run.trial086.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-26T03:10:12.497 INFO:teuthology.orchestra.run.trial086.stdout: ceph-2:20.3.0-5312.gabffb617.el9.x86_64 2026-02-26T03:10:12.497 INFO:teuthology.orchestra.run.trial086.stdout: ceph-grafana-dashboards-2:20.3.0-5312.gabffb617.el9.noarch 2026-02-26T03:10:12.497 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mds-2:20.3.0-5312.gabffb617.el9.x86_64 2026-02-26T03:10:12.497 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-2:20.3.0-5312.gabffb617.el9.x86_64 2026-02-26T03:10:12.497 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-cephadm-2:20.3.0-5312.gabffb617.el9.noarch 2026-02-26T03:10:12.497 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-dashboard-2:20.3.0-5312.gabffb617.el9.noarch 2026-02-26T03:10:12.497 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5312.gabffb617.el9.noarch 2026-02-26T03:10:12.497 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-k8sevents-2:20.3.0-5312.gabffb617.el9.noarch 2026-02-26T03:10:12.497 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-modules-core-2:20.3.0-5312.gabffb617.el9.noarch 2026-02-26T03:10:12.497 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-rook-2:20.3.0-5312.gabffb617.el9.noarch 2026-02-26T03:10:12.498 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mon-2:20.3.0-5312.gabffb617.el9.x86_64 2026-02-26T03:10:12.498 INFO:teuthology.orchestra.run.trial086.stdout: ceph-osd-2:20.3.0-5312.gabffb617.el9.x86_64 2026-02-26T03:10:12.498 INFO:teuthology.orchestra.run.trial086.stdout: ceph-osd-classic-2:20.3.0-5312.gabffb617.el9.x86_64 2026-02-26T03:10:12.498 INFO:teuthology.orchestra.run.trial086.stdout: ceph-osd-crimson-2:20.3.0-5312.gabffb617.el9.x86_64 2026-02-26T03:10:12.498 INFO:teuthology.orchestra.run.trial086.stdout: ceph-prometheus-alerts-2:20.3.0-5312.gabffb617.el9.noarch 2026-02-26T03:10:12.498 INFO:teuthology.orchestra.run.trial086.stdout: ceph-volume-2:20.3.0-5312.gabffb617.el9.noarch 2026-02-26T03:10:12.498 INFO:teuthology.orchestra.run.trial086.stdout: cephadm-2:20.3.0-5312.gabffb617.el9.noarch 2026-02-26T03:10:12.498 INFO:teuthology.orchestra.run.trial086.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-26T03:10:12.498 INFO:teuthology.orchestra.run.trial086.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-26T03:10:12.498 INFO:teuthology.orchestra.run.trial086.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-26T03:10:12.498 INFO:teuthology.orchestra.run.trial086.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-26T03:10:12.498 INFO:teuthology.orchestra.run.trial086.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-26T03:10:12.498 INFO:teuthology.orchestra.run.trial086.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-26T03:10:12.498 INFO:teuthology.orchestra.run.trial086.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-26T03:10:12.498 INFO:teuthology.orchestra.run.trial086.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-26T03:10:12.498 INFO:teuthology.orchestra.run.trial086.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-26T03:10:12.498 INFO:teuthology.orchestra.run.trial086.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-26T03:10:12.498 INFO:teuthology.orchestra.run.trial086.stdout: lua-5.4.4-4.el9.x86_64 2026-02-26T03:10:12.498 INFO:teuthology.orchestra.run.trial086.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-26T03:10:12.498 INFO:teuthology.orchestra.run.trial086.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-26T03:10:12.498 INFO:teuthology.orchestra.run.trial086.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-26T03:10:12.498 INFO:teuthology.orchestra.run.trial086.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-26T03:10:12.498 INFO:teuthology.orchestra.run.trial086.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-26T03:10:12.498 INFO:teuthology.orchestra.run.trial086.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-26T03:10:12.498 INFO:teuthology.orchestra.run.trial086.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-26T03:10:12.498 INFO:teuthology.orchestra.run.trial086.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-26T03:10:12.498 INFO:teuthology.orchestra.run.trial086.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-26T03:10:12.498 INFO:teuthology.orchestra.run.trial086.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-26T03:10:12.499 INFO:teuthology.orchestra.run.trial086.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-26T03:10:12.499 INFO:teuthology.orchestra.run.trial086.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-26T03:10:12.499 INFO:teuthology.orchestra.run.trial086.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-26T03:10:12.499 INFO:teuthology.orchestra.run.trial086.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-26T03:10:12.499 INFO:teuthology.orchestra.run.trial086.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-26T03:10:12.499 INFO:teuthology.orchestra.run.trial086.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-26T03:10:12.499 INFO:teuthology.orchestra.run.trial086.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-26T03:10:12.499 INFO:teuthology.orchestra.run.trial086.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-26T03:10:12.499 INFO:teuthology.orchestra.run.trial086.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-26T03:10:12.499 INFO:teuthology.orchestra.run.trial086.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-26T03:10:12.499 INFO:teuthology.orchestra.run.trial086.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-26T03:10:12.499 INFO:teuthology.orchestra.run.trial086.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-26T03:10:12.499 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-26T03:10:12.499 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-26T03:10:12.499 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-26T03:10:12.499 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-26T03:10:12.499 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-26T03:10:12.499 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-26T03:10:12.499 INFO:teuthology.orchestra.run.trial086.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-26T03:10:12.499 INFO:teuthology.orchestra.run.trial086.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-26T03:10:12.499 INFO:teuthology.orchestra.run.trial086.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-26T03:10:12.499 INFO:teuthology.orchestra.run.trial086.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-26T03:10:12.499 INFO:teuthology.orchestra.run.trial086.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-26T03:10:12.499 INFO:teuthology.orchestra.run.trial086.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-26T03:10:12.499 INFO:teuthology.orchestra.run.trial086.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-26T03:10:12.499 INFO:teuthology.orchestra.run.trial086.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-26T03:10:12.499 INFO:teuthology.orchestra.run.trial086.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-26T03:10:12.499 INFO:teuthology.orchestra.run.trial086.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-26T03:10:12.499 INFO:teuthology.orchestra.run.trial086.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-26T03:10:12.499 INFO:teuthology.orchestra.run.trial086.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-26T03:10:12.499 INFO:teuthology.orchestra.run.trial086.stdout: python3-ply-3.11-14.el9.noarch 2026-02-26T03:10:12.499 INFO:teuthology.orchestra.run.trial086.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-26T03:10:12.499 INFO:teuthology.orchestra.run.trial086.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-26T03:10:12.499 INFO:teuthology.orchestra.run.trial086.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-26T03:10:12.499 INFO:teuthology.orchestra.run.trial086.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-02-26T03:10:12.499 INFO:teuthology.orchestra.run.trial086.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-02-26T03:10:12.499 INFO:teuthology.orchestra.run.trial086.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-26T03:10:12.500 INFO:teuthology.orchestra.run.trial086.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-26T03:10:12.500 INFO:teuthology.orchestra.run.trial086.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-26T03:10:12.500 INFO:teuthology.orchestra.run.trial086.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-26T03:10:12.500 INFO:teuthology.orchestra.run.trial086.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-26T03:10:12.500 INFO:teuthology.orchestra.run.trial086.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-26T03:10:12.500 INFO:teuthology.orchestra.run.trial086.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-26T03:10:12.500 INFO:teuthology.orchestra.run.trial086.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-26T03:10:12.500 INFO:teuthology.orchestra.run.trial086.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-26T03:10:12.500 INFO:teuthology.orchestra.run.trial086.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-26T03:10:12.500 INFO:teuthology.orchestra.run.trial086.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-26T03:10:12.500 INFO:teuthology.orchestra.run.trial086.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-26T03:10:12.500 INFO:teuthology.orchestra.run.trial086.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-26T03:10:12.500 INFO:teuthology.orchestra.run.trial086.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-26T03:10:12.500 INFO:teuthology.orchestra.run.trial086.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-26T03:10:12.500 INFO:teuthology.orchestra.run.trial086.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-26T03:10:12.500 INFO:teuthology.orchestra.run.trial086.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-26T03:10:12.500 INFO:teuthology.orchestra.run.trial086.stdout: unzip-6.0-59.el9.x86_64 2026-02-26T03:10:12.500 INFO:teuthology.orchestra.run.trial086.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-26T03:10:12.500 INFO:teuthology.orchestra.run.trial086.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-26T03:10:12.500 INFO:teuthology.orchestra.run.trial086.stdout: zip-3.0-35.el9.x86_64 2026-02-26T03:10:12.500 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:10:12.500 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:10:12.563 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-base 2026-02-26T03:10:12.878 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:01:33 ago on Thu 26 Feb 2026 03:08:39 AM UTC. 2026-02-26T03:10:12.943 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-base-2:20.3.0-5312.gabffb617.el9.x86_64 is already installed. 2026-02-26T03:10:12.961 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:10:12.962 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-26T03:10:12.962 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:10:12.983 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install cephadm 2026-02-26T03:10:13.292 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:01:34 ago on Thu 26 Feb 2026 03:08:39 AM UTC. 2026-02-26T03:10:13.357 INFO:teuthology.orchestra.run.trial086.stdout:Package cephadm-2:20.3.0-5312.gabffb617.el9.noarch is already installed. 2026-02-26T03:10:13.376 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:10:13.376 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-26T03:10:13.376 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:10:13.397 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-immutable-object-cache 2026-02-26T03:10:13.708 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:01:34 ago on Thu 26 Feb 2026 03:08:39 AM UTC. 2026-02-26T03:10:13.792 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:10:13.792 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-26T03:10:13.792 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repo Size 2026-02-26T03:10:13.793 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-26T03:10:13.793 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-26T03:10:13.793 INFO:teuthology.orchestra.run.trial086.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5312.gabffb617.el9 ceph 149 k 2026-02-26T03:10:13.793 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:10:13.793 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-26T03:10:13.793 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-26T03:10:13.793 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-26T03:10:13.793 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:10:13.793 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 149 k 2026-02-26T03:10:13.793 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 455 k 2026-02-26T03:10:13.793 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-26T03:10:14.193 INFO:teuthology.orchestra.run.trial086.stdout:ceph-immutable-object-cache-20.3.0-5312.gabffb6 374 kB/s | 149 kB 00:00 2026-02-26T03:10:14.193 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-26T03:10:14.193 INFO:teuthology.orchestra.run.trial086.stdout:Total 373 kB/s | 149 kB 00:00 2026-02-26T03:10:14.193 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-26T03:10:14.198 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-26T03:10:14.198 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-26T03:10:14.228 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-26T03:10:14.228 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-26T03:10:14.284 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-26T03:10:14.285 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5312.gabffb617. 1/1 2026-02-26T03:10:14.307 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5312.gabffb617. 1/1 2026-02-26T03:10:14.307 INFO:teuthology.orchestra.run.trial086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T03:10:14.307 INFO:teuthology.orchestra.run.trial086.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-26T03:10:14.307 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:10:14.596 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5312.gabffb617. 1/1 2026-02-26T03:10:14.596 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:10:14.596 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-26T03:10:14.596 INFO:teuthology.orchestra.run.trial086.stdout: ceph-immutable-object-cache-2:20.3.0-5312.gabffb617.el9.x86_64 2026-02-26T03:10:14.596 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:10:14.596 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:10:14.623 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-mgr 2026-02-26T03:10:14.937 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:01:35 ago on Thu 26 Feb 2026 03:08:39 AM UTC. 2026-02-26T03:10:15.002 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-mgr-2:20.3.0-5312.gabffb617.el9.x86_64 is already installed. 2026-02-26T03:10:15.020 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:10:15.021 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-26T03:10:15.021 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:10:15.042 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-mgr-dashboard 2026-02-26T03:10:15.357 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:01:36 ago on Thu 26 Feb 2026 03:08:39 AM UTC. 2026-02-26T03:10:15.422 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-mgr-dashboard-2:20.3.0-5312.gabffb617.el9.noarch is already installed. 2026-02-26T03:10:15.440 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:10:15.441 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-26T03:10:15.441 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:10:15.464 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-26T03:10:15.776 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:01:36 ago on Thu 26 Feb 2026 03:08:39 AM UTC. 2026-02-26T03:10:15.840 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5312.gabffb617.el9.noarch is already installed. 2026-02-26T03:10:15.859 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:10:15.859 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-26T03:10:15.859 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:10:15.881 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-mgr-rook 2026-02-26T03:10:16.197 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:01:37 ago on Thu 26 Feb 2026 03:08:39 AM UTC. 2026-02-26T03:10:16.263 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-mgr-rook-2:20.3.0-5312.gabffb617.el9.noarch is already installed. 2026-02-26T03:10:16.281 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:10:16.282 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-26T03:10:16.282 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:10:16.303 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-mgr-cephadm 2026-02-26T03:10:16.619 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:01:37 ago on Thu 26 Feb 2026 03:08:39 AM UTC. 2026-02-26T03:10:16.684 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-mgr-cephadm-2:20.3.0-5312.gabffb617.el9.noarch is already installed. 2026-02-26T03:10:16.703 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:10:16.704 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-26T03:10:16.704 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:10:16.724 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-osd 2026-02-26T03:10:17.038 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:01:38 ago on Thu 26 Feb 2026 03:08:39 AM UTC. 2026-02-26T03:10:17.104 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-osd-2:20.3.0-5312.gabffb617.el9.x86_64 is already installed. 2026-02-26T03:10:17.122 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:10:17.123 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-26T03:10:17.123 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:10:17.144 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-osd-classic 2026-02-26T03:10:17.456 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:01:38 ago on Thu 26 Feb 2026 03:08:39 AM UTC. 2026-02-26T03:10:17.521 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-osd-classic-2:20.3.0-5312.gabffb617.el9.x86_64 is already installed. 2026-02-26T03:10:17.539 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:10:17.540 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-26T03:10:17.540 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:10:17.560 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-fuse 2026-02-26T03:10:17.879 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:01:38 ago on Thu 26 Feb 2026 03:08:39 AM UTC. 2026-02-26T03:10:17.964 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:10:17.964 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-26T03:10:17.964 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repo Size 2026-02-26T03:10:17.964 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-26T03:10:17.964 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-26T03:10:17.964 INFO:teuthology.orchestra.run.trial086.stdout: ceph-fuse x86_64 2:20.3.0-5312.gabffb617.el9 ceph 914 k 2026-02-26T03:10:17.965 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:10:17.965 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-26T03:10:17.965 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-26T03:10:17.965 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-26T03:10:17.965 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:10:17.965 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 914 k 2026-02-26T03:10:17.965 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 2.9 M 2026-02-26T03:10:17.965 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-26T03:10:18.859 INFO:teuthology.orchestra.run.trial086.stdout:ceph-fuse-20.3.0-5312.gabffb617.el9.x86_64.rpm 1.0 MB/s | 914 kB 00:00 2026-02-26T03:10:18.859 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-26T03:10:18.859 INFO:teuthology.orchestra.run.trial086.stdout:Total 1.0 MB/s | 914 kB 00:00 2026-02-26T03:10:18.860 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-26T03:10:18.864 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-26T03:10:18.864 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-26T03:10:18.899 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-26T03:10:18.899 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-26T03:10:18.991 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-26T03:10:19.009 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-fuse-2:20.3.0-5312.gabffb617.el9.x86_64 1/1 2026-02-26T03:10:19.230 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-fuse-2:20.3.0-5312.gabffb617.el9.x86_64 1/1 2026-02-26T03:10:19.292 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-fuse-2:20.3.0-5312.gabffb617.el9.x86_64 1/1 2026-02-26T03:10:19.292 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:10:19.292 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-26T03:10:19.292 INFO:teuthology.orchestra.run.trial086.stdout: ceph-fuse-2:20.3.0-5312.gabffb617.el9.x86_64 2026-02-26T03:10:19.292 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:10:19.293 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:10:19.319 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-volume 2026-02-26T03:10:19.639 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:01:40 ago on Thu 26 Feb 2026 03:08:39 AM UTC. 2026-02-26T03:10:19.704 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-volume-2:20.3.0-5312.gabffb617.el9.noarch is already installed. 2026-02-26T03:10:19.723 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:10:19.723 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-26T03:10:19.723 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:10:19.745 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install librados-devel 2026-02-26T03:10:20.058 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:01:41 ago on Thu 26 Feb 2026 03:08:39 AM UTC. 2026-02-26T03:10:20.141 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:10:20.141 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-26T03:10:20.141 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repo Size 2026-02-26T03:10:20.141 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-26T03:10:20.141 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-26T03:10:20.141 INFO:teuthology.orchestra.run.trial086.stdout: librados-devel x86_64 2:20.3.0-5312.gabffb617.el9 ceph 124 k 2026-02-26T03:10:20.141 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:10:20.141 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-26T03:10:20.141 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-26T03:10:20.141 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-26T03:10:20.141 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:10:20.142 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 124 k 2026-02-26T03:10:20.142 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 434 k 2026-02-26T03:10:20.142 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-26T03:10:20.584 INFO:teuthology.orchestra.run.trial086.stdout:librados-devel-20.3.0-5312.gabffb617.el9.x86_64 279 kB/s | 124 kB 00:00 2026-02-26T03:10:20.585 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-26T03:10:20.585 INFO:teuthology.orchestra.run.trial086.stdout:Total 279 kB/s | 124 kB 00:00 2026-02-26T03:10:20.585 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-26T03:10:20.588 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-26T03:10:20.588 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-26T03:10:20.619 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-26T03:10:20.619 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-26T03:10:20.675 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-26T03:10:20.692 INFO:teuthology.orchestra.run.trial086.stdout: Installing : librados-devel-2:20.3.0-5312.gabffb617.el9.x86_64 1/1 2026-02-26T03:10:20.780 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: librados-devel-2:20.3.0-5312.gabffb617.el9.x86_64 1/1 2026-02-26T03:10:20.843 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : librados-devel-2:20.3.0-5312.gabffb617.el9.x86_64 1/1 2026-02-26T03:10:20.843 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:10:20.843 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-26T03:10:20.843 INFO:teuthology.orchestra.run.trial086.stdout: librados-devel-2:20.3.0-5312.gabffb617.el9.x86_64 2026-02-26T03:10:20.843 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:10:20.844 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:10:20.872 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install libcephfs2 2026-02-26T03:10:21.190 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:01:42 ago on Thu 26 Feb 2026 03:08:39 AM UTC. 2026-02-26T03:10:21.255 INFO:teuthology.orchestra.run.trial086.stdout:Package libcephfs2-2:20.3.0-5312.gabffb617.el9.x86_64 is already installed. 2026-02-26T03:10:21.274 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:10:21.274 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-26T03:10:21.274 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:10:21.295 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install libcephfs-devel 2026-02-26T03:10:21.611 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:01:42 ago on Thu 26 Feb 2026 03:08:39 AM UTC. 2026-02-26T03:10:21.696 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:10:21.696 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-26T03:10:21.696 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repo Size 2026-02-26T03:10:21.696 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-26T03:10:21.696 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-26T03:10:21.696 INFO:teuthology.orchestra.run.trial086.stdout: libcephfs-devel x86_64 2:20.3.0-5312.gabffb617.el9 ceph 37 k 2026-02-26T03:10:21.696 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:10:21.697 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-26T03:10:21.697 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-26T03:10:21.697 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-26T03:10:21.697 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:10:21.697 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 37 k 2026-02-26T03:10:21.697 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 171 k 2026-02-26T03:10:21.697 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-26T03:10:22.007 INFO:teuthology.orchestra.run.trial086.stdout:libcephfs-devel-20.3.0-5312.gabffb617.el9.x86_6 120 kB/s | 37 kB 00:00 2026-02-26T03:10:22.007 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-26T03:10:22.007 INFO:teuthology.orchestra.run.trial086.stdout:Total 120 kB/s | 37 kB 00:00 2026-02-26T03:10:22.007 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-26T03:10:22.010 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-26T03:10:22.010 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-26T03:10:22.013 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-26T03:10:22.013 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-26T03:10:22.035 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-26T03:10:22.052 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libcephfs-devel-2:20.3.0-5312.gabffb617.el9.x86_64 1/1 2026-02-26T03:10:22.118 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: libcephfs-devel-2:20.3.0-5312.gabffb617.el9.x86_64 1/1 2026-02-26T03:10:22.181 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libcephfs-devel-2:20.3.0-5312.gabffb617.el9.x86_64 1/1 2026-02-26T03:10:22.181 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:10:22.181 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-26T03:10:22.181 INFO:teuthology.orchestra.run.trial086.stdout: libcephfs-devel-2:20.3.0-5312.gabffb617.el9.x86_64 2026-02-26T03:10:22.181 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:10:22.181 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:10:22.206 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install librados2 2026-02-26T03:10:22.518 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:01:43 ago on Thu 26 Feb 2026 03:08:39 AM UTC. 2026-02-26T03:10:22.584 INFO:teuthology.orchestra.run.trial086.stdout:Package librados2-2:20.3.0-5312.gabffb617.el9.x86_64 is already installed. 2026-02-26T03:10:22.601 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:10:22.602 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-26T03:10:22.602 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:10:22.623 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install librbd1 2026-02-26T03:10:22.939 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:01:43 ago on Thu 26 Feb 2026 03:08:39 AM UTC. 2026-02-26T03:10:23.005 INFO:teuthology.orchestra.run.trial086.stdout:Package librbd1-2:20.3.0-5312.gabffb617.el9.x86_64 is already installed. 2026-02-26T03:10:23.023 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:10:23.023 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-26T03:10:23.024 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:10:23.044 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install python3-rados 2026-02-26T03:10:23.360 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:01:44 ago on Thu 26 Feb 2026 03:08:39 AM UTC. 2026-02-26T03:10:23.425 INFO:teuthology.orchestra.run.trial086.stdout:Package python3-rados-2:20.3.0-5312.gabffb617.el9.x86_64 is already installed. 2026-02-26T03:10:23.442 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:10:23.443 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-26T03:10:23.443 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:10:23.464 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install python3-rgw 2026-02-26T03:10:23.780 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:01:44 ago on Thu 26 Feb 2026 03:08:39 AM UTC. 2026-02-26T03:10:23.845 INFO:teuthology.orchestra.run.trial086.stdout:Package python3-rgw-2:20.3.0-5312.gabffb617.el9.x86_64 is already installed. 2026-02-26T03:10:23.862 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:10:23.863 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-26T03:10:23.863 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:10:23.884 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install python3-cephfs 2026-02-26T03:10:24.197 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:01:45 ago on Thu 26 Feb 2026 03:08:39 AM UTC. 2026-02-26T03:10:24.264 INFO:teuthology.orchestra.run.trial086.stdout:Package python3-cephfs-2:20.3.0-5312.gabffb617.el9.x86_64 is already installed. 2026-02-26T03:10:24.281 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:10:24.282 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-26T03:10:24.282 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:10:24.303 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install python3-rbd 2026-02-26T03:10:24.616 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:01:45 ago on Thu 26 Feb 2026 03:08:39 AM UTC. 2026-02-26T03:10:24.681 INFO:teuthology.orchestra.run.trial086.stdout:Package python3-rbd-2:20.3.0-5312.gabffb617.el9.x86_64 is already installed. 2026-02-26T03:10:24.699 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:10:24.700 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-26T03:10:24.700 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:10:24.721 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install rbd-fuse 2026-02-26T03:10:25.036 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:01:46 ago on Thu 26 Feb 2026 03:08:39 AM UTC. 2026-02-26T03:10:25.119 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:10:25.120 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-26T03:10:25.120 INFO:teuthology.orchestra.run.trial086.stdout: Package Architecture Version Repository Size 2026-02-26T03:10:25.120 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-26T03:10:25.120 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-26T03:10:25.120 INFO:teuthology.orchestra.run.trial086.stdout: rbd-fuse x86_64 2:20.3.0-5312.gabffb617.el9 ceph 87 k 2026-02-26T03:10:25.120 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:10:25.120 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-26T03:10:25.120 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-26T03:10:25.120 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-26T03:10:25.121 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:10:25.121 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 87 k 2026-02-26T03:10:25.121 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 236 k 2026-02-26T03:10:25.121 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-26T03:10:25.535 INFO:teuthology.orchestra.run.trial086.stdout:rbd-fuse-20.3.0-5312.gabffb617.el9.x86_64.rpm 209 kB/s | 87 kB 00:00 2026-02-26T03:10:25.535 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-26T03:10:25.536 INFO:teuthology.orchestra.run.trial086.stdout:Total 208 kB/s | 87 kB 00:00 2026-02-26T03:10:25.536 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-26T03:10:25.540 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-26T03:10:25.540 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-26T03:10:25.571 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-26T03:10:25.571 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-26T03:10:25.623 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-26T03:10:25.641 INFO:teuthology.orchestra.run.trial086.stdout: Installing : rbd-fuse-2:20.3.0-5312.gabffb617.el9.x86_64 1/1 2026-02-26T03:10:25.728 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: rbd-fuse-2:20.3.0-5312.gabffb617.el9.x86_64 1/1 2026-02-26T03:10:25.791 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : rbd-fuse-2:20.3.0-5312.gabffb617.el9.x86_64 1/1 2026-02-26T03:10:25.791 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:10:25.791 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-26T03:10:25.791 INFO:teuthology.orchestra.run.trial086.stdout: rbd-fuse-2:20.3.0-5312.gabffb617.el9.x86_64 2026-02-26T03:10:25.791 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:10:25.791 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:10:25.820 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install rbd-mirror 2026-02-26T03:10:26.135 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:01:47 ago on Thu 26 Feb 2026 03:08:39 AM UTC. 2026-02-26T03:10:26.220 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:10:26.221 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-26T03:10:26.221 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repo Size 2026-02-26T03:10:26.221 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-26T03:10:26.221 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-26T03:10:26.221 INFO:teuthology.orchestra.run.trial086.stdout: rbd-mirror x86_64 2:20.3.0-5312.gabffb617.el9 ceph 2.6 M 2026-02-26T03:10:26.221 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:10:26.221 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-26T03:10:26.221 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-26T03:10:26.221 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-26T03:10:26.222 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:10:26.222 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 2.6 M 2026-02-26T03:10:26.222 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 11 M 2026-02-26T03:10:26.222 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-26T03:10:27.332 INFO:teuthology.orchestra.run.trial086.stdout:rbd-mirror-20.3.0-5312.gabffb617.el9.x86_64.rpm 2.3 MB/s | 2.6 MB 00:01 2026-02-26T03:10:27.332 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-26T03:10:27.332 INFO:teuthology.orchestra.run.trial086.stdout:Total 2.3 MB/s | 2.6 MB 00:01 2026-02-26T03:10:27.332 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-26T03:10:27.337 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-26T03:10:27.337 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-26T03:10:27.375 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-26T03:10:27.375 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-26T03:10:27.544 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-26T03:10:27.546 INFO:teuthology.orchestra.run.trial086.stdout: Installing : rbd-mirror-2:20.3.0-5312.gabffb617.el9.x86_64 1/1 2026-02-26T03:10:27.568 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5312.gabffb617.el9.x86_64 1/1 2026-02-26T03:10:27.568 INFO:teuthology.orchestra.run.trial086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T03:10:27.568 INFO:teuthology.orchestra.run.trial086.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-26T03:10:27.568 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-26T03:10:27.568 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-26T03:10:27.568 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:10:27.905 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : rbd-mirror-2:20.3.0-5312.gabffb617.el9.x86_64 1/1 2026-02-26T03:10:27.906 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:10:27.906 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-26T03:10:27.906 INFO:teuthology.orchestra.run.trial086.stdout: rbd-mirror-2:20.3.0-5312.gabffb617.el9.x86_64 2026-02-26T03:10:27.906 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:10:27.906 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:10:27.933 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install rbd-nbd 2026-02-26T03:10:28.252 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:01:49 ago on Thu 26 Feb 2026 03:08:39 AM UTC. 2026-02-26T03:10:28.337 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:10:28.337 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-26T03:10:28.337 INFO:teuthology.orchestra.run.trial086.stdout: Package Architecture Version Repository Size 2026-02-26T03:10:28.337 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-26T03:10:28.338 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-26T03:10:28.338 INFO:teuthology.orchestra.run.trial086.stdout: rbd-nbd x86_64 2:20.3.0-5312.gabffb617.el9 ceph 166 k 2026-02-26T03:10:28.338 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:10:28.338 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-26T03:10:28.338 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-26T03:10:28.338 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-26T03:10:28.338 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:10:28.338 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 166 k 2026-02-26T03:10:28.338 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 496 k 2026-02-26T03:10:28.338 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-26T03:10:28.711 INFO:teuthology.orchestra.run.trial086.stdout:rbd-nbd-20.3.0-5312.gabffb617.el9.x86_64.rpm 444 kB/s | 166 kB 00:00 2026-02-26T03:10:28.711 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-26T03:10:28.711 INFO:teuthology.orchestra.run.trial086.stdout:Total 443 kB/s | 166 kB 00:00 2026-02-26T03:10:28.712 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-26T03:10:28.716 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-26T03:10:28.717 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-26T03:10:28.748 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-26T03:10:28.748 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-26T03:10:28.805 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-26T03:10:28.822 INFO:teuthology.orchestra.run.trial086.stdout: Installing : rbd-nbd-2:20.3.0-5312.gabffb617.el9.x86_64 1/1 2026-02-26T03:10:28.911 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: rbd-nbd-2:20.3.0-5312.gabffb617.el9.x86_64 1/1 2026-02-26T03:10:28.973 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : rbd-nbd-2:20.3.0-5312.gabffb617.el9.x86_64 1/1 2026-02-26T03:10:28.974 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:10:28.974 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-26T03:10:28.974 INFO:teuthology.orchestra.run.trial086.stdout: rbd-nbd-2:20.3.0-5312.gabffb617.el9.x86_64 2026-02-26T03:10:28.974 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:10:28.974 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:10:29.002 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-osd-crimson 2026-02-26T03:10:29.322 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:01:50 ago on Thu 26 Feb 2026 03:08:39 AM UTC. 2026-02-26T03:10:29.387 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-osd-crimson-2:20.3.0-5312.gabffb617.el9.x86_64 is already installed. 2026-02-26T03:10:29.405 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:10:29.405 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-26T03:10:29.405 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:10:29.427 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-osd-crimson-debuginfo 2026-02-26T03:10:29.744 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:01:50 ago on Thu 26 Feb 2026 03:08:39 AM UTC. 2026-02-26T03:10:29.828 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:10:29.828 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-26T03:10:29.828 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repo Size 2026-02-26T03:10:29.828 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-26T03:10:29.828 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-26T03:10:29.828 INFO:teuthology.orchestra.run.trial086.stdout: ceph-osd-crimson-debuginfo x86_64 2:20.3.0-5312.gabffb617.el9 ceph 429 M 2026-02-26T03:10:29.828 INFO:teuthology.orchestra.run.trial086.stdout:Installing weak dependencies: 2026-02-26T03:10:29.828 INFO:teuthology.orchestra.run.trial086.stdout: ceph-debugsource x86_64 2:20.3.0-5312.gabffb617.el9 ceph 12 M 2026-02-26T03:10:29.828 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:10:29.828 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-26T03:10:29.828 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-26T03:10:29.828 INFO:teuthology.orchestra.run.trial086.stdout:Install 2 Packages 2026-02-26T03:10:29.828 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:10:29.829 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 441 M 2026-02-26T03:10:29.829 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 2.7 G 2026-02-26T03:10:29.829 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-26T03:10:32.473 INFO:teuthology.orchestra.run.trial086.stdout:(1/2): ceph-debugsource-20.3.0-5312.gabffb617.e 4.5 MB/s | 12 MB 00:02 2026-02-26T03:14:05.815 INFO:teuthology.orchestra.run.trial086.stdout:(2/2): ceph-osd-crimson-debuginfo-20.3.0-5312.g 2.0 MB/s | 429 MB 03:35 2026-02-26T03:14:05.816 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-26T03:14:05.816 INFO:teuthology.orchestra.run.trial086.stdout:Total 2.0 MB/s | 441 MB 03:35 2026-02-26T03:14:05.816 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-26T03:14:05.822 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-26T03:14:05.822 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-26T03:14:07.187 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-26T03:14:07.187 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-26T03:14:10.803 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-26T03:14:33.835 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-debugsource-2:20.3.0-5312.gabffb617.el9.x86_64 1/2 2026-02-26T03:14:33.853 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-osd-crimson-debuginfo-2:20.3.0-5312.gabffb617.e 2/2 2026-02-26T03:14:35.837 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-osd-crimson-debuginfo-2:20.3.0-5312.gabffb617.e 2/2 2026-02-26T03:14:35.837 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-debugsource-2:20.3.0-5312.gabffb617.el9.x86_64 1/2 2026-02-26T03:14:35.900 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-osd-crimson-debuginfo-2:20.3.0-5312.gabffb617.e 2/2 2026-02-26T03:14:35.900 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:14:35.901 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-26T03:14:35.901 INFO:teuthology.orchestra.run.trial086.stdout: ceph-debugsource-2:20.3.0-5312.gabffb617.el9.x86_64 2026-02-26T03:14:35.901 INFO:teuthology.orchestra.run.trial086.stdout: ceph-osd-crimson-debuginfo-2:20.3.0-5312.gabffb617.el9.x86_64 2026-02-26T03:14:35.901 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:14:35.901 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:14:35.975 DEBUG:teuthology.parallel:result is None 2026-02-26T03:14:35.976 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=abffb617683951511fccf3c3cab6e219f2ec83a8 2026-02-26T03:14:36.113 DEBUG:teuthology.orchestra.run.trial086:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-26T03:14:36.135 INFO:teuthology.orchestra.run.trial086.stdout:20.3.0-5312.gabffb617.el9 2026-02-26T03:14:36.135 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5312.gabffb617.el9 2026-02-26T03:14:36.135 INFO:teuthology.task.install:The correct ceph version 20.3.0-5312.gabffb617 is installed. 2026-02-26T03:14:36.137 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-26T03:14:36.137 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-26T03:14:36.137 DEBUG:teuthology.orchestra.run.trial086:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-26T03:14:36.200 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-26T03:14:36.200 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-26T03:14:36.200 DEBUG:teuthology.orchestra.run.trial086:> sudo dd of=/usr/bin/daemon-helper 2026-02-26T03:14:36.265 DEBUG:teuthology.orchestra.run.trial086:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-26T03:14:36.329 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-26T03:14:36.330 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-26T03:14:36.330 DEBUG:teuthology.orchestra.run.trial086:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-26T03:14:36.393 DEBUG:teuthology.orchestra.run.trial086:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-26T03:14:36.457 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-26T03:14:36.457 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-26T03:14:36.457 DEBUG:teuthology.orchestra.run.trial086:> sudo dd of=/usr/bin/stdin-killer 2026-02-26T03:14:36.522 DEBUG:teuthology.orchestra.run.trial086:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-26T03:14:36.587 INFO:teuthology.run_tasks:Running task pexec... 2026-02-26T03:14:36.600 INFO:teuthology.task.pexec:Executing custom commands... 2026-02-26T03:14:36.601 DEBUG:teuthology.orchestra.run.trial086:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-26T03:14:36.630 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial086.front.sepia.ceph.com 2026-02-26T03:14:36.630 INFO:teuthology.task.pexec:sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson 2026-02-26T03:14:36.680 DEBUG:teuthology.parallel:result is None 2026-02-26T03:14:36.680 INFO:teuthology.run_tasks:Running task install... 2026-02-26T03:14:36.695 DEBUG:teuthology.task.install:project ceph 2026-02-26T03:14:36.695 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'debug', 'sha1': 'abffb617683951511fccf3c3cab6e219f2ec83a8'}} 2026-02-26T03:14:36.695 DEBUG:teuthology.task.install:config {'flavor': 'debug', 'sha1': 'abffb617683951511fccf3c3cab6e219f2ec83a8'} 2026-02-26T03:14:36.695 INFO:teuthology.task.install:Using flavor: debug 2026-02-26T03:14:36.704 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-26T03:14:36.704 INFO:teuthology.task.install:extra packages: [] 2026-02-26T03:14:36.704 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'abffb617683951511fccf3c3cab6e219f2ec83a8', 'tag': None, 'wait_for_package': False} 2026-02-26T03:14:36.705 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=abffb617683951511fccf3c3cab6e219f2ec83a8 2026-02-26T03:14:36.860 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-shraddhaag-peering-bug/abffb617683951511fccf3c3cab6e219f2ec83a8/centos/9/flavors/debug/ 2026-02-26T03:14:36.860 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5312.gabffb617 2026-02-26T03:14:37.321 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-shraddhaag-peering-bug/abffb617683951511fccf3c3cab6e219f2ec83a8/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-shraddhaag-peering-bug/abffb617683951511fccf3c3cab6e219f2ec83a8/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-shraddhaag-peering-bug/abffb617683951511fccf3c3cab6e219f2ec83a8/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-26T03:14:37.321 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-26T03:14:37.321 DEBUG:teuthology.orchestra.run.trial086:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-26T03:14:37.346 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-26T03:14:37.347 DEBUG:teuthology.orchestra.run.trial086:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-26T03:14:37.411 DEBUG:teuthology.orchestra.run.trial086:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-26T03:14:37.474 DEBUG:teuthology.orchestra.run.trial086:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-26T03:14:37.529 INFO:teuthology.orchestra.run.trial086.stdout:check_obsoletes = 1 2026-02-26T03:14:37.539 DEBUG:teuthology.orchestra.run.trial086:> sudo yum clean all 2026-02-26T03:14:37.697 INFO:teuthology.orchestra.run.trial086.stdout:56 files removed 2026-02-26T03:14:37.712 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-radosgw 2026-02-26T03:14:38.583 INFO:teuthology.orchestra.run.trial086.stdout:ceph packages for x86_64 131 kB/s | 94 kB 00:00 2026-02-26T03:14:39.265 INFO:teuthology.orchestra.run.trial086.stdout:ceph noarch packages 37 kB/s | 24 kB 00:00 2026-02-26T03:14:39.880 INFO:teuthology.orchestra.run.trial086.stdout:ceph source packages 3.5 kB/s | 2.1 kB 00:00 2026-02-26T03:14:40.784 INFO:teuthology.orchestra.run.trial086.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.9 MB 00:00 2026-02-26T03:14:44.012 INFO:teuthology.orchestra.run.trial086.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-26T03:14:47.589 INFO:teuthology.orchestra.run.trial086.stdout:CentOS Stream 9 - CRB 6.6 MB/s | 8.0 MB 00:01 2026-02-26T03:14:48.470 INFO:teuthology.orchestra.run.trial086.stdout:CentOS Stream 9 - Extras packages 134 kB/s | 20 kB 00:00 2026-02-26T03:14:48.705 INFO:teuthology.orchestra.run.trial086.stdout:Extra Packages for Enterprise Linux 118 MB/s | 20 MB 00:00 2026-02-26T03:14:51.903 INFO:teuthology.orchestra.run.trial086.stdout:lab-extras 2.9 MB/s | 50 kB 00:00 2026-02-26T03:14:53.099 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-radosgw-2:20.3.0-5312.gabffb617.el9.x86_64 is already installed. 2026-02-26T03:14:53.117 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:14:53.118 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-26T03:14:53.118 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:14:53.143 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-test 2026-02-26T03:14:53.465 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:02 ago on Thu 26 Feb 2026 03:14:51 AM UTC. 2026-02-26T03:14:53.530 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-test-2:20.3.0-5312.gabffb617.el9.x86_64 is already installed. 2026-02-26T03:14:53.548 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:14:53.549 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-26T03:14:53.549 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:14:53.572 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph 2026-02-26T03:14:53.890 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:02 ago on Thu 26 Feb 2026 03:14:51 AM UTC. 2026-02-26T03:14:53.956 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-2:20.3.0-5312.gabffb617.el9.x86_64 is already installed. 2026-02-26T03:14:53.974 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:14:53.974 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-26T03:14:53.975 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:14:53.998 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-base 2026-02-26T03:14:54.317 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:03 ago on Thu 26 Feb 2026 03:14:51 AM UTC. 2026-02-26T03:14:54.381 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-base-2:20.3.0-5312.gabffb617.el9.x86_64 is already installed. 2026-02-26T03:14:54.399 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:14:54.399 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-26T03:14:54.399 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:14:54.421 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install cephadm 2026-02-26T03:14:54.742 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:03 ago on Thu 26 Feb 2026 03:14:51 AM UTC. 2026-02-26T03:14:54.807 INFO:teuthology.orchestra.run.trial086.stdout:Package cephadm-2:20.3.0-5312.gabffb617.el9.noarch is already installed. 2026-02-26T03:14:54.824 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:14:54.825 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-26T03:14:54.825 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:14:54.846 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-immutable-object-cache 2026-02-26T03:14:55.167 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:04 ago on Thu 26 Feb 2026 03:14:51 AM UTC. 2026-02-26T03:14:55.233 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-immutable-object-cache-2:20.3.0-5312.gabffb617.el9.x86_64 is already installed. 2026-02-26T03:14:55.250 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:14:55.251 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-26T03:14:55.251 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:14:55.273 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-mgr 2026-02-26T03:14:55.596 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:04 ago on Thu 26 Feb 2026 03:14:51 AM UTC. 2026-02-26T03:14:55.661 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-mgr-2:20.3.0-5312.gabffb617.el9.x86_64 is already installed. 2026-02-26T03:14:55.680 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:14:55.680 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-26T03:14:55.681 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:14:55.701 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-mgr-dashboard 2026-02-26T03:14:56.021 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:05 ago on Thu 26 Feb 2026 03:14:51 AM UTC. 2026-02-26T03:14:56.086 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-mgr-dashboard-2:20.3.0-5312.gabffb617.el9.noarch is already installed. 2026-02-26T03:14:56.104 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:14:56.104 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-26T03:14:56.104 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:14:56.126 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-26T03:14:56.442 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:05 ago on Thu 26 Feb 2026 03:14:51 AM UTC. 2026-02-26T03:14:56.507 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5312.gabffb617.el9.noarch is already installed. 2026-02-26T03:14:56.525 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:14:56.525 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-26T03:14:56.526 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:14:56.547 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-mgr-rook 2026-02-26T03:14:56.863 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:05 ago on Thu 26 Feb 2026 03:14:51 AM UTC. 2026-02-26T03:14:56.928 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-mgr-rook-2:20.3.0-5312.gabffb617.el9.noarch is already installed. 2026-02-26T03:14:56.946 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:14:56.947 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-26T03:14:56.947 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:14:56.968 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-mgr-cephadm 2026-02-26T03:14:57.288 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:06 ago on Thu 26 Feb 2026 03:14:51 AM UTC. 2026-02-26T03:14:57.354 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-mgr-cephadm-2:20.3.0-5312.gabffb617.el9.noarch is already installed. 2026-02-26T03:14:57.372 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:14:57.372 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-26T03:14:57.372 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:14:57.395 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-osd 2026-02-26T03:14:57.711 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:06 ago on Thu 26 Feb 2026 03:14:51 AM UTC. 2026-02-26T03:14:57.776 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-osd-2:20.3.0-5312.gabffb617.el9.x86_64 is already installed. 2026-02-26T03:14:57.793 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:14:57.793 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-26T03:14:57.793 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:14:57.815 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-osd-classic 2026-02-26T03:14:58.132 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:07 ago on Thu 26 Feb 2026 03:14:51 AM UTC. 2026-02-26T03:14:58.197 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-osd-classic-2:20.3.0-5312.gabffb617.el9.x86_64 is already installed. 2026-02-26T03:14:58.215 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:14:58.215 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-26T03:14:58.215 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:14:58.237 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-fuse 2026-02-26T03:14:58.554 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:07 ago on Thu 26 Feb 2026 03:14:51 AM UTC. 2026-02-26T03:14:58.619 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-fuse-2:20.3.0-5312.gabffb617.el9.x86_64 is already installed. 2026-02-26T03:14:58.636 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:14:58.637 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-26T03:14:58.637 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:14:58.658 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-volume 2026-02-26T03:14:58.976 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:07 ago on Thu 26 Feb 2026 03:14:51 AM UTC. 2026-02-26T03:14:59.041 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-volume-2:20.3.0-5312.gabffb617.el9.noarch is already installed. 2026-02-26T03:14:59.059 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:14:59.059 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-26T03:14:59.059 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:14:59.081 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install librados-devel 2026-02-26T03:14:59.395 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:08 ago on Thu 26 Feb 2026 03:14:51 AM UTC. 2026-02-26T03:14:59.460 INFO:teuthology.orchestra.run.trial086.stdout:Package librados-devel-2:20.3.0-5312.gabffb617.el9.x86_64 is already installed. 2026-02-26T03:14:59.478 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:14:59.478 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-26T03:14:59.479 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:14:59.501 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install libcephfs2 2026-02-26T03:14:59.821 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:08 ago on Thu 26 Feb 2026 03:14:51 AM UTC. 2026-02-26T03:14:59.886 INFO:teuthology.orchestra.run.trial086.stdout:Package libcephfs2-2:20.3.0-5312.gabffb617.el9.x86_64 is already installed. 2026-02-26T03:14:59.904 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:14:59.905 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-26T03:14:59.905 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:14:59.927 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install libcephfs-devel 2026-02-26T03:15:00.248 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:09 ago on Thu 26 Feb 2026 03:14:51 AM UTC. 2026-02-26T03:15:00.313 INFO:teuthology.orchestra.run.trial086.stdout:Package libcephfs-devel-2:20.3.0-5312.gabffb617.el9.x86_64 is already installed. 2026-02-26T03:15:00.330 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:15:00.331 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-26T03:15:00.331 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:15:00.354 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install librados2 2026-02-26T03:15:00.673 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:09 ago on Thu 26 Feb 2026 03:14:51 AM UTC. 2026-02-26T03:15:00.737 INFO:teuthology.orchestra.run.trial086.stdout:Package librados2-2:20.3.0-5312.gabffb617.el9.x86_64 is already installed. 2026-02-26T03:15:00.755 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:15:00.756 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-26T03:15:00.756 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:15:00.778 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install librbd1 2026-02-26T03:15:01.092 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:10 ago on Thu 26 Feb 2026 03:14:51 AM UTC. 2026-02-26T03:15:01.157 INFO:teuthology.orchestra.run.trial086.stdout:Package librbd1-2:20.3.0-5312.gabffb617.el9.x86_64 is already installed. 2026-02-26T03:15:01.175 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:15:01.175 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-26T03:15:01.176 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:15:01.197 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install python3-rados 2026-02-26T03:15:01.515 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:10 ago on Thu 26 Feb 2026 03:14:51 AM UTC. 2026-02-26T03:15:01.581 INFO:teuthology.orchestra.run.trial086.stdout:Package python3-rados-2:20.3.0-5312.gabffb617.el9.x86_64 is already installed. 2026-02-26T03:15:01.598 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:15:01.599 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-26T03:15:01.599 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:15:01.620 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install python3-rgw 2026-02-26T03:15:01.936 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:10 ago on Thu 26 Feb 2026 03:14:51 AM UTC. 2026-02-26T03:15:02.001 INFO:teuthology.orchestra.run.trial086.stdout:Package python3-rgw-2:20.3.0-5312.gabffb617.el9.x86_64 is already installed. 2026-02-26T03:15:02.019 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:15:02.019 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-26T03:15:02.020 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:15:02.042 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install python3-cephfs 2026-02-26T03:15:02.358 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:11 ago on Thu 26 Feb 2026 03:14:51 AM UTC. 2026-02-26T03:15:02.423 INFO:teuthology.orchestra.run.trial086.stdout:Package python3-cephfs-2:20.3.0-5312.gabffb617.el9.x86_64 is already installed. 2026-02-26T03:15:02.441 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:15:02.441 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-26T03:15:02.442 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:15:02.464 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install python3-rbd 2026-02-26T03:15:02.784 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:11 ago on Thu 26 Feb 2026 03:14:51 AM UTC. 2026-02-26T03:15:02.850 INFO:teuthology.orchestra.run.trial086.stdout:Package python3-rbd-2:20.3.0-5312.gabffb617.el9.x86_64 is already installed. 2026-02-26T03:15:02.868 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:15:02.868 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-26T03:15:02.868 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:15:02.890 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install rbd-fuse 2026-02-26T03:15:03.207 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:12 ago on Thu 26 Feb 2026 03:14:51 AM UTC. 2026-02-26T03:15:03.272 INFO:teuthology.orchestra.run.trial086.stdout:Package rbd-fuse-2:20.3.0-5312.gabffb617.el9.x86_64 is already installed. 2026-02-26T03:15:03.290 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:15:03.291 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-26T03:15:03.291 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:15:03.312 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install rbd-mirror 2026-02-26T03:15:03.631 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:12 ago on Thu 26 Feb 2026 03:14:51 AM UTC. 2026-02-26T03:15:03.699 INFO:teuthology.orchestra.run.trial086.stdout:Package rbd-mirror-2:20.3.0-5312.gabffb617.el9.x86_64 is already installed. 2026-02-26T03:15:03.716 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:15:03.717 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-26T03:15:03.717 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:15:03.738 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install rbd-nbd 2026-02-26T03:15:04.053 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:13 ago on Thu 26 Feb 2026 03:14:51 AM UTC. 2026-02-26T03:15:04.118 INFO:teuthology.orchestra.run.trial086.stdout:Package rbd-nbd-2:20.3.0-5312.gabffb617.el9.x86_64 is already installed. 2026-02-26T03:15:04.136 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-26T03:15:04.137 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-26T03:15:04.137 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-26T03:15:04.162 DEBUG:teuthology.parallel:result is None 2026-02-26T03:15:04.162 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=abffb617683951511fccf3c3cab6e219f2ec83a8 2026-02-26T03:15:04.330 DEBUG:teuthology.orchestra.run.trial086:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-26T03:15:04.350 INFO:teuthology.orchestra.run.trial086.stdout:20.3.0-5312.gabffb617.el9 2026-02-26T03:15:04.350 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5312.gabffb617.el9 2026-02-26T03:15:04.351 INFO:teuthology.task.install:The correct ceph version 20.3.0-5312.gabffb617 is installed. 2026-02-26T03:15:04.353 INFO:teuthology.task.install.util:Utilities already shipped, skip it... 2026-02-26T03:15:04.353 INFO:teuthology.run_tasks:Running task ceph... 2026-02-26T03:15:04.480 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-26T03:15:04.480 DEBUG:teuthology.orchestra.run.trial086:> sudo chmod 777 /var/log/ceph 2026-02-26T03:15:04.505 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-26T03:15:04.505 DEBUG:teuthology.orchestra.run.trial086:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-26T03:15:04.568 INFO:tasks.ceph:Creating extra log directories... 2026-02-26T03:15:04.568 DEBUG:teuthology.orchestra.run.trial086:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-26T03:15:04.646 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-26T03:15:04.646 INFO:tasks.ceph:config {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson cpu num': 3, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'seastore cachepin size pershard': '64M', 'seastore max concurrent transactions': 8}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(OBJECT_', 'for optimal performance'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-26T03:15:04.647 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/shraddhaag-2026-02-26_02:22:56-crimson-rados-main-distro-debug-trial/71141', 'branch': 'main', 'description': 'crimson-rados/objectstore_tool/{0-crimson_install clusters/fixed-1-num-threads-3 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/seastore-segmented tasks/crimson_obejctstore_tool}', 'email': None, 'first_in_suite': False, 'flavor': 'debug', 'job_id': '71141', 'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'shraddhaag-2026-02-26_02:22:56-crimson-rados-main-distro-debug-trial', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'crimson cpu num': 3, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'seastore cachepin size pershard': '64M', 'seastore max concurrent transactions': 8}}, 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(OBJECT_', 'for optimal performance'], 'sha1': 'abffb617683951511fccf3c3cab6e219f2ec83a8'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'debug', 'sha1': 'abffb617683951511fccf3c3cab6e219f2ec83a8'}}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '1f87b69b1a8041112e26ae0ea3c0a2a0fd14d996'}}, 'owner': 'scheduled_shraddhaag@soko04.front.sepia.ceph.com', 'priority': 101, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']], 'seed': 5117, 'sha1': 'abffb617683951511fccf3c3cab6e219f2ec83a8', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_1f87b69b1a8041112e26ae0ea3c0a2a0fd14d996/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph.git', 'suite_sha1': '1f87b69b1a8041112e26ae0ea3c0a2a0fd14d996', 'targets': {'trial086.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFzLQ+FYcHHEfCmaFhBrcEvCWXKjPerr+rd8rp1wgifljnpypm/n2+T+h+1Aeefjd2NuqoyVbafkuf7cx2HK3d0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'flavor': 'debug', 'sha1': 'abffb617683951511fccf3c3cab6e219f2ec83a8'}}, {'pexec': {'all': ['sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson']}}, {'install': None}, {'ceph': {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson cpu num': 3, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'seastore cachepin size pershard': '64M', 'seastore max concurrent transactions': 8}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}}, 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(OBJECT_', 'for optimal performance'], 'sha1': 'abffb617683951511fccf3c3cab6e219f2ec83a8', 'cluster': 'ceph'}}, {'ceph_objectstore_tool': {'crimson_objectstore_tool': True, 'objects': 5, 'pgnum': 8}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '6e3d0419ccca0e75a03e08feb708946e198236f4', 'timestamp': '2026-02-26_02:22:56', 'tube': 'trial', 'user': 'shraddhaag', 'verbose': False, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.904699'} 2026-02-26T03:15:04.647 DEBUG:teuthology.orchestra.run.trial086:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-26T03:15:04.687 DEBUG:teuthology.orchestra.run.trial086:> sudo install -d -m0777 -- /var/run/ceph 2026-02-26T03:15:04.752 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-26T03:15:04.753 DEBUG:teuthology.orchestra.run.trial086:> dd if=/scratch_devs of=/dev/stdout 2026-02-26T03:15:04.809 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-26T03:15:04.810 DEBUG:teuthology.orchestra.run.trial086:> stat /dev/vg_nvme/lv_1 2026-02-26T03:15:04.865 INFO:teuthology.orchestra.run.trial086.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-26T03:15:04.865 INFO:teuthology.orchestra.run.trial086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-26T03:15:04.865 INFO:teuthology.orchestra.run.trial086.stdout:Device: 6h/6d Inode: 1297 Links: 1 2026-02-26T03:15:04.865 INFO:teuthology.orchestra.run.trial086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-26T03:15:04.865 INFO:teuthology.orchestra.run.trial086.stdout:Context: system_u:object_r:device_t:s0 2026-02-26T03:15:04.865 INFO:teuthology.orchestra.run.trial086.stdout:Access: 2026-02-26 03:10:27.712984260 +0000 2026-02-26T03:15:04.865 INFO:teuthology.orchestra.run.trial086.stdout:Modify: 2026-02-26 03:08:48.292938058 +0000 2026-02-26T03:15:04.865 INFO:teuthology.orchestra.run.trial086.stdout:Change: 2026-02-26 03:08:48.292938058 +0000 2026-02-26T03:15:04.865 INFO:teuthology.orchestra.run.trial086.stdout: Birth: 2026-02-26 03:08:48.292938058 +0000 2026-02-26T03:15:04.865 DEBUG:teuthology.orchestra.run.trial086:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-26T03:15:04.927 INFO:teuthology.orchestra.run.trial086.stderr:1+0 records in 2026-02-26T03:15:04.927 INFO:teuthology.orchestra.run.trial086.stderr:1+0 records out 2026-02-26T03:15:04.927 INFO:teuthology.orchestra.run.trial086.stderr:512 bytes copied, 0.000154828 s, 3.3 MB/s 2026-02-26T03:15:04.928 DEBUG:teuthology.orchestra.run.trial086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-26T03:15:04.986 DEBUG:teuthology.orchestra.run.trial086:> stat /dev/vg_nvme/lv_2 2026-02-26T03:15:05.042 INFO:teuthology.orchestra.run.trial086.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-26T03:15:05.043 INFO:teuthology.orchestra.run.trial086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-26T03:15:05.043 INFO:teuthology.orchestra.run.trial086.stdout:Device: 6h/6d Inode: 1292 Links: 1 2026-02-26T03:15:05.043 INFO:teuthology.orchestra.run.trial086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-26T03:15:05.043 INFO:teuthology.orchestra.run.trial086.stdout:Context: system_u:object_r:device_t:s0 2026-02-26T03:15:05.043 INFO:teuthology.orchestra.run.trial086.stdout:Access: 2026-02-26 03:10:27.713984220 +0000 2026-02-26T03:15:05.043 INFO:teuthology.orchestra.run.trial086.stdout:Modify: 2026-02-26 03:08:48.291938074 +0000 2026-02-26T03:15:05.043 INFO:teuthology.orchestra.run.trial086.stdout:Change: 2026-02-26 03:08:48.291938074 +0000 2026-02-26T03:15:05.043 INFO:teuthology.orchestra.run.trial086.stdout: Birth: 2026-02-26 03:08:48.291938074 +0000 2026-02-26T03:15:05.043 DEBUG:teuthology.orchestra.run.trial086:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-26T03:15:05.106 INFO:teuthology.orchestra.run.trial086.stderr:1+0 records in 2026-02-26T03:15:05.106 INFO:teuthology.orchestra.run.trial086.stderr:1+0 records out 2026-02-26T03:15:05.106 INFO:teuthology.orchestra.run.trial086.stderr:512 bytes copied, 0.000154958 s, 3.3 MB/s 2026-02-26T03:15:05.107 DEBUG:teuthology.orchestra.run.trial086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-26T03:15:05.164 DEBUG:teuthology.orchestra.run.trial086:> stat /dev/vg_nvme/lv_3 2026-02-26T03:15:05.221 INFO:teuthology.orchestra.run.trial086.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-26T03:15:05.221 INFO:teuthology.orchestra.run.trial086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-26T03:15:05.221 INFO:teuthology.orchestra.run.trial086.stdout:Device: 6h/6d Inode: 1310 Links: 1 2026-02-26T03:15:05.221 INFO:teuthology.orchestra.run.trial086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-26T03:15:05.221 INFO:teuthology.orchestra.run.trial086.stdout:Context: system_u:object_r:device_t:s0 2026-02-26T03:15:05.221 INFO:teuthology.orchestra.run.trial086.stdout:Access: 2026-02-26 03:10:27.713984220 +0000 2026-02-26T03:15:05.221 INFO:teuthology.orchestra.run.trial086.stdout:Modify: 2026-02-26 03:08:48.292938058 +0000 2026-02-26T03:15:05.221 INFO:teuthology.orchestra.run.trial086.stdout:Change: 2026-02-26 03:08:48.292938058 +0000 2026-02-26T03:15:05.221 INFO:teuthology.orchestra.run.trial086.stdout: Birth: 2026-02-26 03:08:48.292938058 +0000 2026-02-26T03:15:05.222 DEBUG:teuthology.orchestra.run.trial086:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-26T03:15:05.285 INFO:teuthology.orchestra.run.trial086.stderr:1+0 records in 2026-02-26T03:15:05.285 INFO:teuthology.orchestra.run.trial086.stderr:1+0 records out 2026-02-26T03:15:05.285 INFO:teuthology.orchestra.run.trial086.stderr:512 bytes copied, 0.000146692 s, 3.5 MB/s 2026-02-26T03:15:05.288 DEBUG:teuthology.orchestra.run.trial086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-26T03:15:05.344 DEBUG:teuthology.orchestra.run.trial086:> stat /dev/vg_nvme/lv_4 2026-02-26T03:15:05.401 INFO:teuthology.orchestra.run.trial086.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-26T03:15:05.401 INFO:teuthology.orchestra.run.trial086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-26T03:15:05.402 INFO:teuthology.orchestra.run.trial086.stdout:Device: 6h/6d Inode: 1293 Links: 1 2026-02-26T03:15:05.402 INFO:teuthology.orchestra.run.trial086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-26T03:15:05.402 INFO:teuthology.orchestra.run.trial086.stdout:Context: system_u:object_r:device_t:s0 2026-02-26T03:15:05.402 INFO:teuthology.orchestra.run.trial086.stdout:Access: 2026-02-26 03:10:27.713984220 +0000 2026-02-26T03:15:05.402 INFO:teuthology.orchestra.run.trial086.stdout:Modify: 2026-02-26 03:08:48.291938074 +0000 2026-02-26T03:15:05.402 INFO:teuthology.orchestra.run.trial086.stdout:Change: 2026-02-26 03:08:48.291938074 +0000 2026-02-26T03:15:05.402 INFO:teuthology.orchestra.run.trial086.stdout: Birth: 2026-02-26 03:08:48.291938074 +0000 2026-02-26T03:15:05.402 DEBUG:teuthology.orchestra.run.trial086:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-26T03:15:05.464 INFO:teuthology.orchestra.run.trial086.stderr:1+0 records in 2026-02-26T03:15:05.465 INFO:teuthology.orchestra.run.trial086.stderr:1+0 records out 2026-02-26T03:15:05.465 INFO:teuthology.orchestra.run.trial086.stderr:512 bytes copied, 0.000137877 s, 3.7 MB/s 2026-02-26T03:15:05.466 DEBUG:teuthology.orchestra.run.trial086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-26T03:15:05.523 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-26T03:15:05.523 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial086.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2026-02-26T03:15:05.523 INFO:tasks.ceph:Generating config... 2026-02-26T03:15:05.524 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2026-02-26T03:15:05.524 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2026-02-26T03:15:05.524 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2026-02-26T03:15:05.525 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2026-02-26T03:15:05.525 INFO:tasks.ceph:[mon] paxos service trim min = 10 2026-02-26T03:15:05.525 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-26T03:15:05.525 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-26T03:15:05.525 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-26T03:15:05.525 INFO:tasks.ceph:[mon] osd pool default crimson = True 2026-02-26T03:15:05.525 INFO:tasks.ceph:[osd] debug monc = 20 2026-02-26T03:15:05.525 INFO:tasks.ceph:[osd] crimson cpu num = 3 2026-02-26T03:15:05.525 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2026-02-26T03:15:05.525 INFO:tasks.ceph:[osd] debug ms = 20 2026-02-26T03:15:05.525 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-26T03:15:05.525 INFO:tasks.ceph:[osd] debug seastore = 20 2026-02-26T03:15:05.525 INFO:tasks.ceph:[osd] debug seastore backref = 20 2026-02-26T03:15:05.525 INFO:tasks.ceph:[osd] debug seastore cache = 20 2026-02-26T03:15:05.525 INFO:tasks.ceph:[osd] debug seastore cleaner = 20 2026-02-26T03:15:05.525 INFO:tasks.ceph:[osd] debug seastore device = 20 2026-02-26T03:15:05.525 INFO:tasks.ceph:[osd] debug seastore epm = 20 2026-02-26T03:15:05.525 INFO:tasks.ceph:[osd] debug seastore fixedkv tree = 20 2026-02-26T03:15:05.525 INFO:tasks.ceph:[osd] debug seastore journal = 20 2026-02-26T03:15:05.525 INFO:tasks.ceph:[osd] debug seastore lba = 20 2026-02-26T03:15:05.525 INFO:tasks.ceph:[osd] debug seastore odata = 20 2026-02-26T03:15:05.525 INFO:tasks.ceph:[osd] debug seastore omap = 20 2026-02-26T03:15:05.525 INFO:tasks.ceph:[osd] debug seastore onode = 20 2026-02-26T03:15:05.525 INFO:tasks.ceph:[osd] debug seastore t = 20 2026-02-26T03:15:05.525 INFO:tasks.ceph:[osd] debug seastore tm = 20 2026-02-26T03:15:05.526 INFO:tasks.ceph:[osd] osd objectstore = seastore 2026-02-26T03:15:05.526 INFO:tasks.ceph:[osd] seastore cachepin size pershard = 64M 2026-02-26T03:15:05.526 INFO:tasks.ceph:[osd] seastore max concurrent transactions = 8 2026-02-26T03:15:05.526 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2026-02-26T03:15:05.526 INFO:tasks.ceph:[global] ms client mode = crc 2026-02-26T03:15:05.526 INFO:tasks.ceph:[global] ms cluster mode = crc 2026-02-26T03:15:05.526 INFO:tasks.ceph:[global] ms mon client mode = crc 2026-02-26T03:15:05.526 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2026-02-26T03:15:05.526 INFO:tasks.ceph:[global] ms mon service mode = crc 2026-02-26T03:15:05.526 INFO:tasks.ceph:[global] ms service mode = crc 2026-02-26T03:15:05.526 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-26T03:15:05.526 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-26T03:15:05.526 INFO:tasks.ceph:Setting up mon.a... 2026-02-26T03:15:05.526 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-26T03:15:05.604 INFO:teuthology.orchestra.run.trial086.stdout:creating /etc/ceph/ceph.keyring 2026-02-26T03:15:05.607 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-26T03:15:05.692 DEBUG:teuthology.orchestra.run.trial086:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-26T03:15:05.716 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.86')] 2026-02-26T03:15:05.717 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.86', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': 'true', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'crimson cpu num': 3, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'seastore cachepin size pershard': '64M', 'seastore max concurrent transactions': 8}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'osd pool default crimson': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}} 2026-02-26T03:15:05.718 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-26T03:15:05.718 DEBUG:teuthology.orchestra.run.trial086:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-26T03:15:05.772 DEBUG:teuthology.orchestra.run.trial086:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.86 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-26T03:15:05.852 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:05.848+0000 7f8337037f40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:05.853 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:05.848+0000 7f8337037f40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:05.853 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:05.848+0000 7f8337037f40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:05.855 INFO:teuthology.orchestra.run.trial086.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-26T03:15:05.855 INFO:teuthology.orchestra.run.trial086.stdout:monmaptool: generated fsid a3320112-ec0c-4bb6-bf8e-5331f894afbc 2026-02-26T03:15:05.855 INFO:teuthology.orchestra.run.trial086.stdout:setting min_mon_release = tentacle 2026-02-26T03:15:05.855 INFO:teuthology.orchestra.run.trial086.stdout:epoch 0 2026-02-26T03:15:05.856 INFO:teuthology.orchestra.run.trial086.stdout:fsid a3320112-ec0c-4bb6-bf8e-5331f894afbc 2026-02-26T03:15:05.856 INFO:teuthology.orchestra.run.trial086.stdout:last_changed 2026-02-26T03:15:05.849710+0000 2026-02-26T03:15:05.856 INFO:teuthology.orchestra.run.trial086.stdout:created 2026-02-26T03:15:05.849710+0000 2026-02-26T03:15:05.856 INFO:teuthology.orchestra.run.trial086.stdout:min_mon_release 20 (tentacle) 2026-02-26T03:15:05.856 INFO:teuthology.orchestra.run.trial086.stdout:election_strategy: 1 2026-02-26T03:15:05.856 INFO:teuthology.orchestra.run.trial086.stdout:0: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.a 2026-02-26T03:15:05.857 INFO:teuthology.orchestra.run.trial086.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2026-02-26T03:15:05.858 DEBUG:teuthology.orchestra.run.trial086:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-26T03:15:05.912 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID a3320112-ec0c-4bb6-bf8e-5331f894afbc... 2026-02-26T03:15:05.913 DEBUG:teuthology.orchestra.run.trial086:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-26T03:15:05.993 INFO:teuthology.orchestra.run.trial086.stdout:[global] 2026-02-26T03:15:05.994 INFO:teuthology.orchestra.run.trial086.stdout: chdir = "" 2026-02-26T03:15:05.994 INFO:teuthology.orchestra.run.trial086.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-26T03:15:05.994 INFO:teuthology.orchestra.run.trial086.stdout: auth supported = cephx 2026-02-26T03:15:05.994 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:15:05.994 INFO:teuthology.orchestra.run.trial086.stdout: filestore xattr use omap = true 2026-02-26T03:15:05.994 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:15:05.994 INFO:teuthology.orchestra.run.trial086.stdout: mon clock drift allowed = 1.000 2026-02-26T03:15:05.994 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:15:05.994 INFO:teuthology.orchestra.run.trial086.stdout: osd crush chooseleaf type = 0 2026-02-26T03:15:05.994 INFO:teuthology.orchestra.run.trial086.stdout: auth debug = true 2026-02-26T03:15:05.994 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:15:05.994 INFO:teuthology.orchestra.run.trial086.stdout: ms die on old message = true 2026-02-26T03:15:05.994 INFO:teuthology.orchestra.run.trial086.stdout: ms die on bug = true 2026-02-26T03:15:05.994 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:15:05.994 INFO:teuthology.orchestra.run.trial086.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-26T03:15:05.994 INFO:teuthology.orchestra.run.trial086.stdout: mon pg warn max object skew = 0 2026-02-26T03:15:05.994 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:15:05.994 INFO:teuthology.orchestra.run.trial086.stdout: # disable pg_autoscaler by default for new pools 2026-02-26T03:15:05.994 INFO:teuthology.orchestra.run.trial086.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-26T03:15:05.994 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:15:05.994 INFO:teuthology.orchestra.run.trial086.stdout: osd pool default size = 2 2026-02-26T03:15:05.994 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:15:05.994 INFO:teuthology.orchestra.run.trial086.stdout: mon osd allow primary affinity = true 2026-02-26T03:15:05.994 INFO:teuthology.orchestra.run.trial086.stdout: mon osd allow pg remap = true 2026-02-26T03:15:05.994 INFO:teuthology.orchestra.run.trial086.stdout: mon warn on legacy crush tunables = false 2026-02-26T03:15:05.994 INFO:teuthology.orchestra.run.trial086.stdout: mon warn on crush straw calc version zero = false 2026-02-26T03:15:05.994 INFO:teuthology.orchestra.run.trial086.stdout: mon warn on no sortbitwise = false 2026-02-26T03:15:05.994 INFO:teuthology.orchestra.run.trial086.stdout: mon warn on osd down out interval zero = false 2026-02-26T03:15:05.994 INFO:teuthology.orchestra.run.trial086.stdout: mon warn on too few osds = false 2026-02-26T03:15:05.994 INFO:teuthology.orchestra.run.trial086.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-26T03:15:05.994 INFO:teuthology.orchestra.run.trial086.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-26T03:15:05.994 INFO:teuthology.orchestra.run.trial086.stdout: mon_allow_pool_size_one = true 2026-02-26T03:15:05.994 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:15:05.995 INFO:teuthology.orchestra.run.trial086.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-26T03:15:05.995 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:15:05.995 INFO:teuthology.orchestra.run.trial086.stdout: osd default data pool replay window = 5 2026-02-26T03:15:05.995 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:15:05.995 INFO:teuthology.orchestra.run.trial086.stdout: mon allow pool delete = true 2026-02-26T03:15:05.995 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:15:05.995 INFO:teuthology.orchestra.run.trial086.stdout: mon cluster log file level = debug 2026-02-26T03:15:05.995 INFO:teuthology.orchestra.run.trial086.stdout: debug asserts on shutdown = true 2026-02-26T03:15:05.995 INFO:teuthology.orchestra.run.trial086.stdout: mon health detail to clog = false 2026-02-26T03:15:05.995 INFO:teuthology.orchestra.run.trial086.stdout: mon host = 10.20.193.86 2026-02-26T03:15:05.995 INFO:teuthology.orchestra.run.trial086.stdout: enable experimental unrecoverable data corrupting features = crimson 2026-02-26T03:15:05.995 INFO:teuthology.orchestra.run.trial086.stdout: ms client mode = crc 2026-02-26T03:15:05.995 INFO:teuthology.orchestra.run.trial086.stdout: ms cluster mode = crc 2026-02-26T03:15:05.995 INFO:teuthology.orchestra.run.trial086.stdout: ms mon client mode = crc 2026-02-26T03:15:05.995 INFO:teuthology.orchestra.run.trial086.stdout: ms mon cluster mode = crc 2026-02-26T03:15:05.995 INFO:teuthology.orchestra.run.trial086.stdout: ms mon service mode = crc 2026-02-26T03:15:05.995 INFO:teuthology.orchestra.run.trial086.stdout: ms service mode = crc 2026-02-26T03:15:05.995 INFO:teuthology.orchestra.run.trial086.stdout: fsid = a3320112-ec0c-4bb6-bf8e-5331f894afbc 2026-02-26T03:15:05.995 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:15:05.995 INFO:teuthology.orchestra.run.trial086.stdout:[osd] 2026-02-26T03:15:05.995 INFO:teuthology.orchestra.run.trial086.stdout: osd journal size = 100 2026-02-26T03:15:05.995 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:15:05.995 INFO:teuthology.orchestra.run.trial086.stdout: osd scrub load threshold = 5.0 2026-02-26T03:15:05.995 INFO:teuthology.orchestra.run.trial086.stdout: osd scrub max interval = 600 2026-02-26T03:15:05.995 INFO:teuthology.orchestra.run.trial086.stdout: osd mclock profile = high_recovery_ops 2026-02-26T03:15:05.995 INFO:teuthology.orchestra.run.trial086.stdout: osd mclock skip benchmark = true 2026-02-26T03:15:05.995 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:15:05.995 INFO:teuthology.orchestra.run.trial086.stdout: osd recover clone overlap = true 2026-02-26T03:15:05.995 INFO:teuthology.orchestra.run.trial086.stdout: osd recovery max chunk = 1048576 2026-02-26T03:15:05.995 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:15:05.995 INFO:teuthology.orchestra.run.trial086.stdout: osd debug shutdown = true 2026-02-26T03:15:05.995 INFO:teuthology.orchestra.run.trial086.stdout: osd debug op order = true 2026-02-26T03:15:05.995 INFO:teuthology.orchestra.run.trial086.stdout: osd debug verify stray on activate = true 2026-02-26T03:15:05.995 INFO:teuthology.orchestra.run.trial086.stdout: osd debug trim objects = true 2026-02-26T03:15:05.995 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:15:05.996 INFO:teuthology.orchestra.run.trial086.stdout: osd open classes on start = true 2026-02-26T03:15:05.996 INFO:teuthology.orchestra.run.trial086.stdout: osd debug pg log writeout = true 2026-02-26T03:15:05.996 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:15:05.996 INFO:teuthology.orchestra.run.trial086.stdout: osd deep scrub update digest min age = 30 2026-02-26T03:15:05.996 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:15:05.996 INFO:teuthology.orchestra.run.trial086.stdout: osd map max advance = 10 2026-02-26T03:15:05.996 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:15:05.996 INFO:teuthology.orchestra.run.trial086.stdout: journal zero on create = true 2026-02-26T03:15:05.996 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:15:05.996 INFO:teuthology.orchestra.run.trial086.stdout: filestore ondisk finisher threads = 3 2026-02-26T03:15:05.996 INFO:teuthology.orchestra.run.trial086.stdout: filestore apply finisher threads = 3 2026-02-26T03:15:05.996 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:15:05.996 INFO:teuthology.orchestra.run.trial086.stdout: bdev debug aio = true 2026-02-26T03:15:05.996 INFO:teuthology.orchestra.run.trial086.stdout: osd debug misdirected ops = true 2026-02-26T03:15:05.996 INFO:teuthology.orchestra.run.trial086.stdout: debug monc = 20 2026-02-26T03:15:05.996 INFO:teuthology.orchestra.run.trial086.stdout: crimson cpu num = 3 2026-02-26T03:15:05.996 INFO:teuthology.orchestra.run.trial086.stdout: crimson osd obc lru size = 10 2026-02-26T03:15:05.996 INFO:teuthology.orchestra.run.trial086.stdout: debug ms = 20 2026-02-26T03:15:05.996 INFO:teuthology.orchestra.run.trial086.stdout: debug osd = 20 2026-02-26T03:15:05.996 INFO:teuthology.orchestra.run.trial086.stdout: debug seastore = 20 2026-02-26T03:15:05.996 INFO:teuthology.orchestra.run.trial086.stdout: debug seastore backref = 20 2026-02-26T03:15:05.996 INFO:teuthology.orchestra.run.trial086.stdout: debug seastore cache = 20 2026-02-26T03:15:05.996 INFO:teuthology.orchestra.run.trial086.stdout: debug seastore cleaner = 20 2026-02-26T03:15:05.996 INFO:teuthology.orchestra.run.trial086.stdout: debug seastore device = 20 2026-02-26T03:15:05.996 INFO:teuthology.orchestra.run.trial086.stdout: debug seastore epm = 20 2026-02-26T03:15:05.996 INFO:teuthology.orchestra.run.trial086.stdout: debug seastore fixedkv tree = 20 2026-02-26T03:15:05.996 INFO:teuthology.orchestra.run.trial086.stdout: debug seastore journal = 20 2026-02-26T03:15:05.996 INFO:teuthology.orchestra.run.trial086.stdout: debug seastore lba = 20 2026-02-26T03:15:05.996 INFO:teuthology.orchestra.run.trial086.stdout: debug seastore odata = 20 2026-02-26T03:15:05.996 INFO:teuthology.orchestra.run.trial086.stdout: debug seastore omap = 20 2026-02-26T03:15:05.996 INFO:teuthology.orchestra.run.trial086.stdout: debug seastore onode = 20 2026-02-26T03:15:05.996 INFO:teuthology.orchestra.run.trial086.stdout: debug seastore t = 20 2026-02-26T03:15:05.996 INFO:teuthology.orchestra.run.trial086.stdout: debug seastore tm = 20 2026-02-26T03:15:05.996 INFO:teuthology.orchestra.run.trial086.stdout: osd objectstore = seastore 2026-02-26T03:15:05.996 INFO:teuthology.orchestra.run.trial086.stdout: seastore cachepin size pershard = 64M 2026-02-26T03:15:05.996 INFO:teuthology.orchestra.run.trial086.stdout: seastore max concurrent transactions = 8 2026-02-26T03:15:05.996 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:15:05.996 INFO:teuthology.orchestra.run.trial086.stdout:[mgr] 2026-02-26T03:15:05.997 INFO:teuthology.orchestra.run.trial086.stdout: debug ms = 1 2026-02-26T03:15:05.997 INFO:teuthology.orchestra.run.trial086.stdout: debug mgr = 20 2026-02-26T03:15:05.997 INFO:teuthology.orchestra.run.trial086.stdout: debug mon = 20 2026-02-26T03:15:05.997 INFO:teuthology.orchestra.run.trial086.stdout: debug auth = 20 2026-02-26T03:15:05.997 INFO:teuthology.orchestra.run.trial086.stdout: mon reweight min pgs per osd = 4 2026-02-26T03:15:05.997 INFO:teuthology.orchestra.run.trial086.stdout: mon reweight min bytes per osd = 10 2026-02-26T03:15:05.997 INFO:teuthology.orchestra.run.trial086.stdout: mgr/telemetry/nag = false 2026-02-26T03:15:05.997 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:15:05.997 INFO:teuthology.orchestra.run.trial086.stdout:[mon] 2026-02-26T03:15:05.997 INFO:teuthology.orchestra.run.trial086.stdout: debug ms = 1 2026-02-26T03:15:05.997 INFO:teuthology.orchestra.run.trial086.stdout: debug mon = 20 2026-02-26T03:15:05.997 INFO:teuthology.orchestra.run.trial086.stdout: debug paxos = 20 2026-02-26T03:15:05.997 INFO:teuthology.orchestra.run.trial086.stdout: debug auth = 20 2026-02-26T03:15:05.997 INFO:teuthology.orchestra.run.trial086.stdout: mon data avail warn = 5 2026-02-26T03:15:05.997 INFO:teuthology.orchestra.run.trial086.stdout: mon mgr mkfs grace = 240 2026-02-26T03:15:05.997 INFO:teuthology.orchestra.run.trial086.stdout: mon reweight min pgs per osd = 4 2026-02-26T03:15:05.997 INFO:teuthology.orchestra.run.trial086.stdout: mon osd reporter subtree level = osd 2026-02-26T03:15:05.997 INFO:teuthology.orchestra.run.trial086.stdout: mon osd prime pg temp = true 2026-02-26T03:15:05.997 INFO:teuthology.orchestra.run.trial086.stdout: mon reweight min bytes per osd = 10 2026-02-26T03:15:05.997 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:15:05.997 INFO:teuthology.orchestra.run.trial086.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-26T03:15:05.997 INFO:teuthology.orchestra.run.trial086.stdout: auth mon ticket ttl = 660 # 11m 2026-02-26T03:15:05.997 INFO:teuthology.orchestra.run.trial086.stdout: auth service ticket ttl = 240 # 4m 2026-02-26T03:15:05.997 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:15:05.997 INFO:teuthology.orchestra.run.trial086.stdout: # don't complain about insecure global_id in the test suite 2026-02-26T03:15:05.997 INFO:teuthology.orchestra.run.trial086.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-26T03:15:05.997 INFO:teuthology.orchestra.run.trial086.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-26T03:15:05.997 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:15:05.997 INFO:teuthology.orchestra.run.trial086.stdout: # 1m isn't quite enough 2026-02-26T03:15:05.997 INFO:teuthology.orchestra.run.trial086.stdout: mon_down_mkfs_grace = 2m 2026-02-26T03:15:05.997 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:15:05.997 INFO:teuthology.orchestra.run.trial086.stdout: mon_warn_on_filestore_osds = false 2026-02-26T03:15:05.997 INFO:teuthology.orchestra.run.trial086.stdout: mon min osdmap epochs = 50 2026-02-26T03:15:05.997 INFO:teuthology.orchestra.run.trial086.stdout: mon osdmap full prune interval = 2 2026-02-26T03:15:05.997 INFO:teuthology.orchestra.run.trial086.stdout: mon osdmap full prune min = 15 2026-02-26T03:15:05.997 INFO:teuthology.orchestra.run.trial086.stdout: mon osdmap full prune txsize = 2 2026-02-26T03:15:05.997 INFO:teuthology.orchestra.run.trial086.stdout: paxos service trim min = 10 2026-02-26T03:15:05.998 INFO:teuthology.orchestra.run.trial086.stdout: osd pool default crimson = True 2026-02-26T03:15:05.998 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:15:05.998 INFO:teuthology.orchestra.run.trial086.stdout:[client] 2026-02-26T03:15:05.998 INFO:teuthology.orchestra.run.trial086.stdout: rgw cache enabled = true 2026-02-26T03:15:05.998 INFO:teuthology.orchestra.run.trial086.stdout: rgw enable ops log = true 2026-02-26T03:15:05.998 INFO:teuthology.orchestra.run.trial086.stdout: rgw enable usage log = true 2026-02-26T03:15:05.998 INFO:teuthology.orchestra.run.trial086.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-26T03:15:05.998 INFO:teuthology.orchestra.run.trial086.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-26T03:15:05.998 INFO:teuthology.orchestra.run.trial086.stdout:[mon.a] 2026-02-26T03:15:06.003 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-26T03:15:06.003 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-26T03:15:06.094 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-26T03:15:06.094 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-26T03:15:06.094 DEBUG:teuthology.orchestra.run.trial086:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-26T03:15:06.111 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-26T03:15:06.111 DEBUG:teuthology.orchestra.run.trial086:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-26T03:15:06.168 INFO:tasks.ceph:Sending monmap to node ubuntu@trial086.front.sepia.ceph.com 2026-02-26T03:15:06.168 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-26T03:15:06.168 DEBUG:teuthology.orchestra.run.trial086:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-26T03:15:06.168 DEBUG:teuthology.orchestra.run.trial086:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-26T03:15:06.240 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-26T03:15:06.240 DEBUG:teuthology.orchestra.run.trial086:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-26T03:15:06.296 INFO:tasks.ceph:Setting up mon nodes... 2026-02-26T03:15:06.296 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-26T03:15:06.296 DEBUG:teuthology.orchestra.run.trial086:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-26T03:15:06.386 INFO:teuthology.orchestra.run.trial086.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-26T03:15:06.389 INFO:tasks.ceph:Setting up mds nodes... 2026-02-26T03:15:06.389 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-26T03:15:06.390 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-26T03:15:06.431 INFO:teuthology.orchestra.run.trial086.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-26T03:15:06.444 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-26T03:15:06.444 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial086.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2026-02-26T03:15:06.444 DEBUG:teuthology.orchestra.run.trial086:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-26T03:15:06.508 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-26T03:15:06.508 INFO:tasks.ceph:role: osd.0 2026-02-26T03:15:06.508 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial086.front.sepia.ceph.com 2026-02-26T03:15:06.508 DEBUG:teuthology.orchestra.run.trial086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-26T03:15:06.574 INFO:teuthology.orchestra.run.trial086.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-26T03:15:06.574 INFO:teuthology.orchestra.run.trial086.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-26T03:15:06.574 INFO:teuthology.orchestra.run.trial086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-26T03:15:06.574 INFO:teuthology.orchestra.run.trial086.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-26T03:15:06.574 INFO:teuthology.orchestra.run.trial086.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-26T03:15:06.574 INFO:teuthology.orchestra.run.trial086.stdout: = sunit=0 swidth=0 blks 2026-02-26T03:15:06.574 INFO:teuthology.orchestra.run.trial086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-26T03:15:06.575 INFO:teuthology.orchestra.run.trial086.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-26T03:15:06.575 INFO:teuthology.orchestra.run.trial086.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-26T03:15:06.575 INFO:teuthology.orchestra.run.trial086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-26T03:15:07.145 INFO:teuthology.orchestra.run.trial086.stdout:Discarding blocks...Done. 2026-02-26T03:15:07.146 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial086.front.sepia.ceph.com -o noatime 2026-02-26T03:15:07.147 DEBUG:teuthology.orchestra.run.trial086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-26T03:15:07.216 DEBUG:teuthology.orchestra.run.trial086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-26T03:15:07.283 DEBUG:teuthology.orchestra.run.trial086:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-26T03:15:07.347 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-26T03:15:07.347 INFO:tasks.ceph:role: osd.1 2026-02-26T03:15:07.348 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial086.front.sepia.ceph.com 2026-02-26T03:15:07.348 DEBUG:teuthology.orchestra.run.trial086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-26T03:15:07.412 INFO:teuthology.orchestra.run.trial086.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-26T03:15:07.413 INFO:teuthology.orchestra.run.trial086.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-26T03:15:07.413 INFO:teuthology.orchestra.run.trial086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-26T03:15:07.413 INFO:teuthology.orchestra.run.trial086.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-26T03:15:07.413 INFO:teuthology.orchestra.run.trial086.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-26T03:15:07.413 INFO:teuthology.orchestra.run.trial086.stdout: = sunit=0 swidth=0 blks 2026-02-26T03:15:07.413 INFO:teuthology.orchestra.run.trial086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-26T03:15:07.413 INFO:teuthology.orchestra.run.trial086.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-26T03:15:07.413 INFO:teuthology.orchestra.run.trial086.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-26T03:15:07.413 INFO:teuthology.orchestra.run.trial086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-26T03:15:07.972 INFO:teuthology.orchestra.run.trial086.stdout:Discarding blocks...Done. 2026-02-26T03:15:07.974 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial086.front.sepia.ceph.com -o noatime 2026-02-26T03:15:07.974 DEBUG:teuthology.orchestra.run.trial086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-26T03:15:08.046 DEBUG:teuthology.orchestra.run.trial086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-26T03:15:08.114 DEBUG:teuthology.orchestra.run.trial086:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-26T03:15:08.178 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-26T03:15:08.178 INFO:tasks.ceph:role: osd.2 2026-02-26T03:15:08.178 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial086.front.sepia.ceph.com 2026-02-26T03:15:08.178 DEBUG:teuthology.orchestra.run.trial086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-26T03:15:08.242 INFO:teuthology.orchestra.run.trial086.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-26T03:15:08.242 INFO:teuthology.orchestra.run.trial086.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-26T03:15:08.243 INFO:teuthology.orchestra.run.trial086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-26T03:15:08.243 INFO:teuthology.orchestra.run.trial086.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-26T03:15:08.243 INFO:teuthology.orchestra.run.trial086.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-26T03:15:08.243 INFO:teuthology.orchestra.run.trial086.stdout: = sunit=0 swidth=0 blks 2026-02-26T03:15:08.243 INFO:teuthology.orchestra.run.trial086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-26T03:15:08.243 INFO:teuthology.orchestra.run.trial086.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-26T03:15:08.243 INFO:teuthology.orchestra.run.trial086.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-26T03:15:08.243 INFO:teuthology.orchestra.run.trial086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-26T03:15:08.801 INFO:teuthology.orchestra.run.trial086.stdout:Discarding blocks...Done. 2026-02-26T03:15:08.803 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial086.front.sepia.ceph.com -o noatime 2026-02-26T03:15:08.803 DEBUG:teuthology.orchestra.run.trial086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2026-02-26T03:15:08.875 DEBUG:teuthology.orchestra.run.trial086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-26T03:15:08.947 DEBUG:teuthology.orchestra.run.trial086:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-26T03:15:09.011 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-26T03:15:09.012 INFO:tasks.ceph:role: osd.3 2026-02-26T03:15:09.012 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial086.front.sepia.ceph.com 2026-02-26T03:15:09.012 DEBUG:teuthology.orchestra.run.trial086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-26T03:15:09.076 INFO:teuthology.orchestra.run.trial086.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-26T03:15:09.076 INFO:teuthology.orchestra.run.trial086.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-26T03:15:09.076 INFO:teuthology.orchestra.run.trial086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-26T03:15:09.076 INFO:teuthology.orchestra.run.trial086.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-26T03:15:09.077 INFO:teuthology.orchestra.run.trial086.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-26T03:15:09.077 INFO:teuthology.orchestra.run.trial086.stdout: = sunit=0 swidth=0 blks 2026-02-26T03:15:09.077 INFO:teuthology.orchestra.run.trial086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-26T03:15:09.077 INFO:teuthology.orchestra.run.trial086.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-26T03:15:09.077 INFO:teuthology.orchestra.run.trial086.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-26T03:15:09.077 INFO:teuthology.orchestra.run.trial086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-26T03:15:09.635 INFO:teuthology.orchestra.run.trial086.stdout:Discarding blocks...Done. 2026-02-26T03:15:09.636 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial086.front.sepia.ceph.com -o noatime 2026-02-26T03:15:09.636 DEBUG:teuthology.orchestra.run.trial086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2026-02-26T03:15:09.718 DEBUG:teuthology.orchestra.run.trial086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-26T03:15:09.785 DEBUG:teuthology.orchestra.run.trial086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-26T03:15:09.934 INFO:teuthology.orchestra.run.trial086.stderr:INFO  osd - OSD::main: parsing early config 2026-02-26T03:15:09.990 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:15:09,988 seastar - Reactor backend: linux-aio 2026-02-26T03:15:10.000 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:15:09,997 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:15:10.000 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:15:09,998 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:15:10.002 INFO:teuthology.orchestra.run.trial086.stderr:==39906==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:15:10.057 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:15:10,054 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-26T03:15:10.057 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:15:10,054 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-26T03:15:10.058 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:15:10,054 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-26T03:15:10.058 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:15:10,054 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 3 2026-02-26T03:15:10.058 INFO:teuthology.orchestra.run.trial086.stderr:DEBUG 2026-02-26 03:15:10,055 [shard 0:main] seastar - reactor::drain 2026-02-26T03:15:12.118 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:15:12.118 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:15:12.118 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:15:12.118 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:15:12.118 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:15:12.118 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:15:12.139 INFO:teuthology.orchestra.run.trial086.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-26T03:15:12.139 INFO:teuthology.orchestra.run.trial086.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-26T03:15:12.180 INFO:teuthology.orchestra.run.trial086.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-26T03:15:12.180 INFO:teuthology.orchestra.run.trial086.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-26T03:15:12.187 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:15:12,185 seastar - Reactor backend: linux-aio 2026-02-26T03:15:12.197 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:15:12,195 [shard 1:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:15:12.197 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:15:12,195 [shard 1:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:15:12.200 INFO:teuthology.orchestra.run.trial086.stderr:==39904==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:15:12.200 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:15:12,198 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-26T03:15:12.257 INFO:teuthology.orchestra.run.trial086.stderr:DEBUG 2026-02-26 03:15:12,255 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-26T03:15:12.338 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9e28178 0x9e28461 0x9e88dff 0x9e895f2 0x9e89860 0x9e899a8 0x9e89e67 /lib64/libc.so.6+0x3fc2f 0x9c50aa1 0x9c50f59 0x9c511cc 0x9c51482 0x9c51f31 0x9c5242f 0x9c52a5f 0x9c52bc9 0x9d32f39 0x9d45d3c 0x9d07d91 0x9d06d91 0x7bea2f1 0x7bf3e60 0x7a431c9 0x7a807bd 0x711f05d 0x6fa06ea 0x6fa44eb 0x6faa095 0x7419054 0x743ba5c 0x728f369 0x728f461 0x736153a 0x73615f3 0x73617aa 0x743badd 0x728f4de 0x728f563 0x72bb301 0x7423ee4 0x7423f69 0x7424047 0x72a6c86 0x73b49a4 0x743027a 0x74302f5 0x7430370 0x74f3b82 0x75ebd86 0x9ee2cc7 0x9e36f9c 0x9f10737 0x9f78f1a 0x9f939aa 0x9f94026 0x26ea5d3 0xa5a1f30 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-26T03:15:12.338 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9e28178 0x9e28461 0x9e88dff 0x9e895f2 0x9e89860 0x9e899a8 0x9e89e67 /lib64/libc.so.6+0x3fc2f /lib64/ld-linux-x86-64.so.2+0x16ec3 /lib64/libasan.so.8+0xc65b1 /lib64/libasan.so.8+0x157c7 0x10908ef 0xf2e0dc 0x9c50c5c 0x9c50f59 0x9c511cc 0x9c521cc 0x9c5273a 0x9c52a5f 0x9c52bc9 0x9d32f39 0x9d45d3c 0x9d07d91 0x9d06d91 0x7bea2f1 0x7bf3e60 0x7a431c9 0x7a807bd 0x711f05d 0x6fa06ea 0x6fa44eb 0x6faa095 0x7419054 0x743ba5c 0x728f369 0x728f461 0x736153a 0x73615f3 0x73617aa 0x743badd 0x728f4de 0x728f563 0x72bb301 0x7423ee4 0x7423f69 0x7424047 0x72a6c86 0x73b49a4 0x743027a 0x74302f5 0x7430370 0x74f3b82 0x75ebd86 0x9ee2cc7 0x9e36f9c 0x9f10737 0x9f78f1a 0x9f939aa 0x9f94026 0x26ea5d3 0xa5a1f30 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-26T03:15:12.410 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9e28178 0x9e28461 0x9e88dff 0x9e895f2 0x9e89860 0x9e899a8 0x9e89e67 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x10b6c3 0x36021cd 0x62e9e15 0x7f83149 0x7f83420 0x7f8354c 0x7f859d7 0x7f8662f 0x7dc5e9c 0x7e40da7 0x7e63e44 0x8f5d61d 0x8f5ff8b 0x787cd7f 0x78b3782 0x6fa18b5 0x755a4ec 0x755a640 0x9ee2cc7 0x9e36f9c 0x9f10737 0x9f78f1a 0x9f939aa 0x9f94026 0x26ea5d3 0xa5a1f30 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-26T03:15:12.435 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9e28178 0x9e28461 0x9e88dff 0x9e895f2 0x9e89860 0x9e899a8 0x9e89e67 /lib64/libc.so.6+0x3fc2f 0x2a5481d 0x7d837d2 0x7d9fd5e 0x7e419e3 0x7dc12dd 0x7877bf3 0x78788e8 0x79adc2a 0x7836cfc 0x78b1d9e 0x78fa531 0x78fa7aa 0x799b982 0x799bae1 0x79add8d 0x7868874 0x798a5f1 0x798a680 0x798a724 0x73e442a 0x7404ce9 0x740998a 0x754d7e2 0x9ee2cc7 0x9e36f9c 0x9f10737 0x9f78f1a 0x9f7a738 0x9bf83c1 0x9bf8bfc 0xecf14d /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb46f44 2026-02-26T03:15:12.474 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9e28178 0x9e28461 0x9e88dff 0x9e895f2 0x9e89860 0x9e899a8 0x9e89e67 /lib64/libc.so.6+0x3fc2f 0x2a00b99 0x2a559e0 0x7d837b9 0x7d9fd5e 0x7e419e3 0x7dc12dd 0x7877bf3 0x78788e8 0x79adc2a 0x7836cfc 0x78b1d9e 0x78fa531 0x78fa7aa 0x799b982 0x799bae1 0x79add8d 0x7868874 0x798a5f1 0x798a680 0x798a724 0x73e442a 0x7404ce9 0x740998a 0x754d7e2 0x9ee2cc7 0x9e36f9c 0x9f10737 0x9f78f1a 0x9f939aa 0x9f94026 0x26ea5d3 0xa5a1f30 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-26T03:15:12.476 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9e28178 0x9e28461 0x9e88dff 0x9e895f2 0x9e89860 0x9e899a8 0x9e89e67 /lib64/libc.so.6+0x3fc2f 0x2a55b6d 0x7d837b9 0x7d9fd5e 0x7e419e3 0x7dc12dd 0x7877bf3 0x78788e8 0x79adc2a 0x7836cfc 0x78b1d9e 0x78fa531 0x78fa7aa 0x799b982 0x799bae1 0x79add8d 0x7868874 0x798a5f1 0x798a680 0x798a724 0x73e442a 0x7404ce9 0x740998a 0x754d7e2 0x9ee2cc7 0x9e36f9c 0x9f10737 0x9f78f1a 0x9f939aa 0x9f94026 0x26ea5d3 0xa5a1f30 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-26T03:15:12.620 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9e28178 0x9e28461 0x9e88dff 0x9e895f2 0x9e89860 0x9e899a8 0x9e89e67 /lib64/libc.so.6+0x3fc2f 0xcde785 0x360bba6 0x360beaf 0x9d25e14 0x9d26250 0x9d42adb 0x9d477c3 0x9d07d91 0x9d06d91 0x7bea2f1 0x7bf3e60 0x7a431c9 0x7a807bd 0x711f05d 0x6f43702 0x6f45a6a 0x7483f52 0x72a690f 0x72a6a11 0x72a6b09 0x7360706 0x73607bf 0x7360972 0x7360aaa 0x7360b25 0x7360baa 0x7360d05 0x7423961 0x7483fdb 0x728dda4 0x72a6c86 0x73b49a4 0x743027a 0x74302f5 0x7430370 0x74f3b82 0x75ebd86 0x9ee2cc7 0x9e36f9c 0x9f10737 0x9f78f1a 0x9f939aa 0x9f94026 0x26ea5d3 0xa5a1f30 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-26T03:15:12.620 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9e28178 0x9e28461 0x9e88dff 0x9e895f2 0x9e89860 0x9e899a8 0x9e89e67 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1297db /lib64/libasan.so.8+0xc65d1 /lib64/libasan.so.8+0x15197 0x1125428 0xf2e0d1 0x9c50a8f 0x9c50f59 0x9c511cc 0x9c51482 0x9c51f31 0x9c5242f 0x9c52a5f 0x9c52bc9 0x9d32f39 0x9d45d3c 0x9d07d91 0x9d06d91 0x7bea2f1 0x7bf3e60 0x7a431c9 0x7a807bd 0x711f05d 0x6f43702 0x6f45a6a 0x7483f52 0x72a690f 0x72a6a11 0x72a6b09 0x7360706 0x73607bf 0x7360972 0x7360aaa 0x7360b25 0x7360baa 0x7360d05 0x7423961 0x7483fdb 0x728dda4 0x72a6c86 0x73b49a4 0x743027a 0x74302f5 0x7430370 0x74f3b82 0x75ebd86 0x9ee2cc7 0x9e36f9c 0x9f10737 0x9f78f1a 0x9f939aa 0x9f94026 0x26ea5d3 0xa5a1f30 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-26T03:15:12.670 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 32 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9e28178 0x9e28461 0x9e88dff 0x9e895f2 0x9e89860 0x9e899a8 0x9e89e67 /lib64/libc.so.6+0x3fc2f 0x2a549cb 0x7d837d2 0x7d9fd5e 0x7e419e3 0x7dc12dd 0x7877bf3 0x78788e8 0x79adc2a 0x7836cfc 0x78b1d9e 0x78fa531 0x78fa7aa 0x799b982 0x799bae1 0x79add8d 0x7868874 0x798a5f1 0x798a680 0x798a724 0x73e442a 0x7404ce9 0x740998a 0x754d7e2 0x9ee2cc7 0x9e36f9c 0x9f10737 0x9f78f1a 0x9f7a738 0x9bf83c1 0x9bf8bfc 0xecf14d /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb46f44 2026-02-26T03:15:12.715 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9e28178 0x9e28461 0x9e88dff 0x9e895f2 0x9e89860 0x9e899a8 0x9e89e67 /lib64/libc.so.6+0x3fc2f 0x2a55835 0x7d837b9 0x7d9fd5e 0x7e419e3 0x7dc12dd 0x7877bf3 0x78788e8 0x79adc2a 0x7836cfc 0x78b1d9e 0x78fa531 0x78fa7aa 0x799b982 0x799bae1 0x79add8d 0x7868874 0x798a5f1 0x798a680 0x798a724 0x73e442a 0x7404ce9 0x740998a 0x754d7e2 0x9ee2cc7 0x9e36f9c 0x9f10737 0x9f78f1a 0x9f939aa 0x9f94026 0x26ea5d3 0xa5a1f30 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-26T03:15:12.715 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9e28178 0x9e28461 0x9e88dff 0x9e895f2 0x9e89860 0x9e899a8 0x9e89e67 /lib64/libc.so.6+0x3fc2f 0x2a549c8 0x7d837d2 0x7d9fd5e 0x7e419e3 0x7dc12dd 0x7877bf3 0x78788e8 0x79adc2a 0x7836cfc 0x78b1d9e 0x78fa531 0x78fa7aa 0x799b982 0x799bae1 0x79add8d 0x7868874 0x798a5f1 0x798a680 0x798a724 0x73e442a 0x7404ce9 0x740998a 0x754d7e2 0x9ee2cc7 0x9e36f9c 0x9f10737 0x9f78f1a 0x9f939aa 0x9f94026 0x26ea5d3 0xa5a1f30 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-26T03:15:12.727 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 90 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9e28178 0x9e28461 0x9e88dff 0x9e895f2 0x9e89860 0x9e899a8 0x9e89e67 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x151f5 0x2a55a3f 0x7d837b9 0x7d9fd5e 0x7e419e3 0x7dc12dd 0x7877bf3 0x78788e8 0x79adc2a 0x7836cfc 0x78b1d9e 0x78fa531 0x78fa7aa 0x799b982 0x799bae1 0x79add8d 0x7868874 0x798a5f1 0x798a680 0x798a724 0x73e442a 0x7404ce9 0x740998a 0x754d7e2 0x9ee2cc7 0x9e36f9c 0x9f10737 0x9f78f1a 0x9f7a738 0x9bf83c1 0x9bf8bfc 0xecf14d /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb46f44 2026-02-26T03:15:14.876 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:15:14.877 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:15:14.877 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:15:14.877 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:15:14.877 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:15:14.877 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:15:14.911 DEBUG:teuthology.orchestra.run.trial086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-26T03:15:14.936 DEBUG:teuthology.orchestra.run.trial086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-26T03:15:15.086 INFO:teuthology.orchestra.run.trial086.stderr:INFO  osd - OSD::main: parsing early config 2026-02-26T03:15:15.139 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:15:15,136 seastar - Reactor backend: linux-aio 2026-02-26T03:15:15.149 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:15:15,147 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:15:15.150 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:15:15,147 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:15:15.152 INFO:teuthology.orchestra.run.trial086.stderr:==39967==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:15:15.208 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:15:15,205 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-26T03:15:15.208 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:15:15,205 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-26T03:15:15.208 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:15:15,205 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-26T03:15:15.208 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:15:15,205 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 3 2026-02-26T03:15:15.208 INFO:teuthology.orchestra.run.trial086.stderr:DEBUG 2026-02-26 03:15:15,205 [shard 0:main] seastar - reactor::drain 2026-02-26T03:15:17.196 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:15:17.196 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:15:17.196 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:15:17.196 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:15:17.196 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:15:17.196 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:15:17.217 INFO:teuthology.orchestra.run.trial086.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-26T03:15:17.217 INFO:teuthology.orchestra.run.trial086.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-26T03:15:17.259 INFO:teuthology.orchestra.run.trial086.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-26T03:15:17.259 INFO:teuthology.orchestra.run.trial086.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-26T03:15:17.265 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:15:17,263 seastar - Reactor backend: linux-aio 2026-02-26T03:15:17.277 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:15:17,275 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:15:17.277 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:15:17,275 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:15:17.281 INFO:teuthology.orchestra.run.trial086.stderr:==39965==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:15:17.281 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:15:17,279 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-26T03:15:17.337 INFO:teuthology.orchestra.run.trial086.stderr:DEBUG 2026-02-26 03:15:17,335 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-26T03:15:17.417 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9e28178 0x9e28461 0x9e88dff 0x9e895f2 0x9e89860 0x9e899a8 0x9e89e67 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc65c2 /lib64/libasan.so.8+0x15197 0x1125428 0xf2e0d1 0x9d33b41 0x9d33e86 0x9d34209 0x9d44360 0x9d477c3 0x9d07d91 0x9d06d91 0x7bea2f1 0x7bf3e60 0x7a431c9 0x7a807bd 0x711f05d 0x6fa06ea 0x6fa44eb 0x6faa095 0x7419054 0x743ba5c 0x728f369 0x728f461 0x736153a 0x73615f3 0x73617aa 0x743badd 0x728f4de 0x728f563 0x72bb301 0x7423ee4 0x7423f69 0x7424047 0x72a6c86 0x73b49a4 0x743027a 0x74302f5 0x7430370 0x74f3b82 0x75ebd86 0x9ee2cc7 0x9e36f9c 0x9f10737 0x9f78f1a 0x9f939aa 0x9f94026 0x26ea5d3 0xa5a1f30 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-26T03:15:17.417 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9e28178 0x9e28461 0x9e88dff 0x9e895f2 0x9e89860 0x9e899a8 0x9e89e67 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x158cf 0x10908ef 0xf2e0dc 0x9c5477a 0x9c550b9 0x9d3f001 0x9d49b10 0x78947dd 0x7be9c23 0x7bf3e60 0x7a431c9 0x7a807bd 0x711f05d 0x6fa06ea 0x6fa44eb 0x6faa095 0x7419054 0x743ba5c 0x728f369 0x728f461 0x736153a 0x73615f3 0x73617aa 0x743badd 0x728f4de 0x728f563 0x72bb301 0x7423ee4 0x7423f69 0x7424047 0x72a6c86 0x73b49a4 0x743027a 0x74302f5 0x7430370 0x74f3b82 0x75ebd86 0x9ee2cc7 0x9e36f9c 0x9f10737 0x9f78f1a 0x9f939aa 0x9f94026 0x26ea5d3 0xa5a1f30 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-26T03:15:17.514 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9e28178 0x9e28461 0x9e88dff 0x9e895f2 0x9e89860 0x9e899a8 0x9e89e67 /lib64/libc.so.6+0x3fc2f 0x7d837d2 0x7d9fd5e 0x7e419e3 0x7dc12dd 0x7877bf3 0x78788e8 0x79adc2a 0x7836cfc 0x78b1d9e 0x78fa531 0x78fa7aa 0x799b982 0x799bae1 0x79add8d 0x7868874 0x798a5f1 0x798a680 0x798a724 0x73e442a 0x7404ce9 0x740998a 0x754d7e2 0x9ee2cc7 0x9e36f9c 0x9f10737 0x9f78f1a 0x9f7a738 0x9bf83c1 0x9bf8bfc 0xecf14d /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb46f44 2026-02-26T03:15:17.552 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9e28178 0x9e28461 0x9e88dff 0x9e895f2 0x9e89860 0x9e899a8 0x9e89e67 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc65bc /lib64/libasan.so.8+0x15197 0x2a55a3f 0x7d837b9 0x7d9fd5e 0x7e419e3 0x7dc12dd 0x7877bf3 0x78788e8 0x79adc2a 0x7836cfc 0x78b1d9e 0x78fa531 0x78fa7aa 0x799b982 0x799bae1 0x79add8d 0x7868874 0x798a5f1 0x798a680 0x798a724 0x73e442a 0x7404ce9 0x740998a 0x754d7e2 0x9ee2cc7 0x9e36f9c 0x9f10737 0x9f78f1a 0x9f939aa 0x9f94026 0x26ea5d3 0xa5a1f30 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-26T03:15:17.552 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9e28178 0x9e28461 0x9e88dff 0x9e895f2 0x9e89860 0x9e899a8 0x9e89e67 /lib64/libc.so.6+0x3fc2f /lib64/ld-linux-x86-64.so.2+0x16ebc /lib64/libasan.so.8+0xc65b1 /lib64/libasan.so.8+0x15197 0x2a55a3f 0x7d837b9 0x7d9fd5e 0x7e419e3 0x7dc12dd 0x7877bf3 0x78788e8 0x79adc2a 0x7836cfc 0x78b1d9e 0x78fa531 0x78fa7aa 0x799b982 0x799bae1 0x79add8d 0x7868874 0x798a5f1 0x798a680 0x798a724 0x73e442a 0x7404ce9 0x740998a 0x754d7e2 0x9ee2cc7 0x9e36f9c 0x9f10737 0x9f78f1a 0x9f939aa 0x9f94026 0x26ea5d3 0xa5a1f30 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-26T03:15:17.694 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9e28178 0x9e28461 0x9e88dff 0x9e895f2 0x9e89860 0x9e899a8 0x9e89e67 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1297e4 /lib64/libasan.so.8+0xc65d1 /lib64/libasan.so.8+0x15197 0x1125428 0xf2e0d1 0x9c50c5c 0x9c50f59 0x9c511cc 0x9c51482 0x9c51f31 0x9c5242f 0x9c52a5f 0x9c52bc9 0x9d32f39 0x9d45d3c 0x9d07d91 0x9d06d91 0x7bea2f1 0x7bf3e60 0x7a431c9 0x7a807bd 0x711f05d 0x6f43702 0x6f45a6a 0x7483f52 0x72a690f 0x72a6a11 0x72a6b09 0x7360706 0x73607bf 0x7360972 0x7360aaa 0x7360b25 0x7360baa 0x7360d05 0x7423961 0x7483fdb 0x728dda4 0x72a6c86 0x73b49a4 0x743027a 0x74302f5 0x7430370 0x74f3b82 0x75ebd86 0x9ee2cc7 0x9e36f9c 0x9f10737 0x9f78f1a 0x9f939aa 0x9f94026 0x26ea5d3 0xa5a1f30 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-26T03:15:17.695 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9e28178 0x9e28461 0x9e88dff 0x9e895f2 0x9e89860 0x9e899a8 0x9e89e67 /lib64/libc.so.6+0x3fc2f 0x10909be 0xf2e0dc 0x9c50c5c 0x9c50f59 0x9c511cc 0x9c51482 0x9c51a44 0x9c59eeb 0x9c5a5cb 0x9d43118 0x9d477c3 0x9d07d91 0x9d06d91 0x7bea2f1 0x7bf3e60 0x7a431c9 0x7a807bd 0x711f05d 0x6f43702 0x6f45a6a 0x7483f52 0x72a690f 0x72a6a11 0x72a6b09 0x7360706 0x73607bf 0x7360972 0x7360aaa 0x7360b25 0x7360baa 0x7360d05 0x7423961 0x7483fdb 0x728dda4 0x72a6c86 0x73b49a4 0x743027a 0x74302f5 0x7430370 0x74f3b82 0x75ebd86 0x9ee2cc7 0x9e36f9c 0x9f10737 0x9f78f1a 0x9f939aa 0x9f94026 0x26ea5d3 0xa5a1f30 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-26T03:15:17.777 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9e28178 0x9e28461 0x9e88dff 0x9e895f2 0x9e89860 0x9e899a8 0x9e89e67 /lib64/libc.so.6+0x3fc2f 0x2a00bec 0x2a559e0 0x7d837b9 0x7d9fd5e 0x7e419e3 0x7dc12dd 0x7877bf3 0x78788e8 0x79adc2a 0x7836cfc 0x78b1d9e 0x78fa531 0x78fa7aa 0x799b982 0x799bae1 0x79add8d 0x7868874 0x798a5f1 0x798a680 0x798a724 0x73e442a 0x7404ce9 0x740998a 0x754d7e2 0x9ee2cc7 0x9e36f9c 0x9f10737 0x9f78f1a 0x9f7a738 0x9bf83c1 0x9bf8bfc 0xecf14d /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb46f44 2026-02-26T03:15:17.789 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9e28178 0x9e28461 0x9e88dff 0x9e895f2 0x9e89860 0x9e899a8 0x9e89e67 /lib64/libc.so.6+0x3fc2f 0x2a55a3f 0x7d837b9 0x7d9fd5e 0x7e419e3 0x7dc12dd 0x7877bf3 0x78788e8 0x79adc2a 0x7836cfc 0x78b1d9e 0x78fa531 0x78fa7aa 0x799b982 0x799bae1 0x79add8d 0x7868874 0x798a5f1 0x798a680 0x798a724 0x73e442a 0x7404ce9 0x740998a 0x754d7e2 0x9ee2cc7 0x9e36f9c 0x9f10737 0x9f78f1a 0x9f939aa 0x9f94026 0x26ea5d3 0xa5a1f30 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-26T03:15:17.789 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9e28178 0x9e28461 0x9e88dff 0x9e895f2 0x9e89860 0x9e899a8 0x9e89e67 /lib64/libc.so.6+0x3fc2f 0x2a55846 0x7d837b9 0x7d9fd5e 0x7e419e3 0x7dc12dd 0x7877bf3 0x78788e8 0x79adc2a 0x7836cfc 0x78b1d9e 0x78fa531 0x78fa7aa 0x799b982 0x799bae1 0x79add8d 0x7868874 0x798a5f1 0x798a680 0x798a724 0x73e442a 0x7404ce9 0x740998a 0x754d7e2 0x9ee2cc7 0x9e36f9c 0x9f10737 0x9f78f1a 0x9f939aa 0x9f94026 0x26ea5d3 0xa5a1f30 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-26T03:15:19.970 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:15:19.971 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:15:19.971 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:15:19.971 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:15:19.971 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:15:19.971 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:15:20.005 DEBUG:teuthology.orchestra.run.trial086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-26T03:15:20.030 DEBUG:teuthology.orchestra.run.trial086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-26T03:15:20.180 INFO:teuthology.orchestra.run.trial086.stderr:INFO  osd - OSD::main: parsing early config 2026-02-26T03:15:20.236 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:15:20,234 seastar - Reactor backend: linux-aio 2026-02-26T03:15:20.254 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:15:20,252 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:15:20.254 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:15:20,252 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:15:20.256 INFO:teuthology.orchestra.run.trial086.stderr:==40031==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:15:20.312 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:15:20,309 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-26T03:15:20.312 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:15:20,309 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-26T03:15:20.312 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:15:20,309 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-26T03:15:20.312 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:15:20,309 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 3 2026-02-26T03:15:20.312 INFO:teuthology.orchestra.run.trial086.stderr:DEBUG 2026-02-26 03:15:20,310 [shard 0:main] seastar - reactor::drain 2026-02-26T03:15:22.402 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:15:22.402 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:15:22.402 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:15:22.403 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:15:22.403 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:15:22.403 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:15:22.423 INFO:teuthology.orchestra.run.trial086.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-26T03:15:22.423 INFO:teuthology.orchestra.run.trial086.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-26T03:15:22.471 INFO:teuthology.orchestra.run.trial086.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-26T03:15:22.471 INFO:teuthology.orchestra.run.trial086.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-26T03:15:22.478 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:15:22,475 seastar - Reactor backend: linux-aio 2026-02-26T03:15:22.490 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:15:22,487 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:15:22.490 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:15:22,487 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:15:22.493 INFO:teuthology.orchestra.run.trial086.stderr:==40029==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:15:22.493 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:15:22,491 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-26T03:15:22.550 INFO:teuthology.orchestra.run.trial086.stderr:DEBUG 2026-02-26 03:15:22,548 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-26T03:15:22.628 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9e28178 0x9e28461 0x9e88dff 0x9e895f2 0x9e89860 0x9e899a8 0x9e89e67 /lib64/libc.so.6+0x3fc2f /lib64/libc.so.6+0x8cc0c /lib64/libasan.so.8+0x10069c /lib64/libasan.so.8+0xc65b9 /lib64/libasan.so.8+0x15197 0x1125428 0xf2e0d1 0x9c50c5c 0x9c50f59 0x9c511cc 0x9c52ef3 0x9d38e4d 0x9d390bc 0x9d4334a 0x9d477c3 0x9d07d91 0x9d06d91 0x7bea2f1 0x7bf3e60 0x7a431c9 0x7a807bd 0x711f05d 0x6fa06ea 0x6fa44eb 0x6faa095 0x7419054 0x743ba5c 0x728f369 0x728f461 0x736153a 0x73615f3 0x73617aa 0x743badd 0x728f4de 0x728f563 0x72bb301 0x7423ee4 0x7423f69 0x7424047 0x72a6c86 0x73b49a4 0x743027a 0x74302f5 0x7430370 0x74f3b82 0x75ebd86 0x9ee2cc7 0x9e36f9c 0x9f10737 0x9f78f1a 0x9f939aa 0x9f94026 0x26ea5d3 0xa5a1f30 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-26T03:15:22.629 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9e28178 0x9e28461 0x9e88dff 0x9e895f2 0x9e89860 0x9e899a8 0x9e89e67 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc59b /lib64/libasan.so.8+0x91c1 /lib64/libasan.so.8+0xee7dc 0x748c80d 0x7289368 0x72b2d61 0x73d6fea 0x7894741 0x7be9c23 0x7bf3e60 0x7a431c9 0x7a807bd 0x711f05d 0x6fa06ea 0x6fa44eb 0x6faa095 0x7419054 0x743ba5c 0x728f369 0x728f461 0x736153a 0x73615f3 0x73617aa 0x743badd 0x728f4de 0x728f563 0x72bb301 0x7423ee4 0x7423f69 0x7424047 0x72a6c86 0x73b49a4 0x743027a 0x74302f5 0x7430370 0x74f3b82 0x75ebd86 0x9ee2cc7 0x9e36f9c 0x9f10737 0x9f78f1a 0x9f939aa 0x9f94026 0x26ea5d3 0xa5a1f30 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-26T03:15:22.726 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9e28178 0x9e28461 0x9e88dff 0x9e895f2 0x9e89860 0x9e899a8 0x9e89e67 /lib64/libc.so.6+0x3fc2f 0x2a549c2 0x7d837d2 0x7d9fd5e 0x7e419e3 0x7dc12dd 0x7877bf3 0x78788e8 0x79adc2a 0x7836cfc 0x78b1d9e 0x78fa531 0x78fa7aa 0x799b982 0x799bae1 0x79add8d 0x7868874 0x798a5f1 0x798a680 0x798a724 0x73e442a 0x7404ce9 0x740998a 0x754d7e2 0x9ee2cc7 0x9e36f9c 0x9f10737 0x9f78f1a 0x9f7a738 0x9bf83c1 0x9bf8bfc 0xecf14d /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb46f44 2026-02-26T03:15:22.764 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9e28178 0x9e28461 0x9e88dff 0x9e895f2 0x9e89860 0x9e899a8 0x9e89e67 /lib64/libc.so.6+0x3fc2f 0x2a55839 0x7d837b9 0x7d9fd5e 0x7e419e3 0x7dc12dd 0x7877bf3 0x78788e8 0x79adc2a 0x7836cfc 0x78b1d9e 0x78fa531 0x78fa7aa 0x799b982 0x799bae1 0x79add8d 0x7868874 0x798a5f1 0x798a680 0x798a724 0x73e442a 0x7404ce9 0x740998a 0x754d7e2 0x9ee2cc7 0x9e36f9c 0x9f10737 0x9f78f1a 0x9f939aa 0x9f94026 0x26ea5d3 0xa5a1f30 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-26T03:15:22.764 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9e28178 0x9e28461 0x9e88dff 0x9e895f2 0x9e89860 0x9e899a8 0x9e89e67 /lib64/libc.so.6+0x3fc2f /lib64/libc.so.6+0x8cc0c /lib64/libasan.so.8+0x10069c /lib64/libasan.so.8+0xc65b9 /lib64/libasan.so.8+0x15197 0x2a55a3f 0x7d837b9 0x7d9fd5e 0x7e419e3 0x7dc12dd 0x7877bf3 0x78788e8 0x79adc2a 0x7836cfc 0x78b1d9e 0x78fa531 0x78fa7aa 0x799b982 0x799bae1 0x79add8d 0x7868874 0x798a5f1 0x798a680 0x798a724 0x73e442a 0x7404ce9 0x740998a 0x754d7e2 0x9ee2cc7 0x9e36f9c 0x9f10737 0x9f78f1a 0x9f939aa 0x9f94026 0x26ea5d3 0xa5a1f30 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-26T03:15:22.908 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9e28178 0x9e28461 0x9e88dff 0x9e895f2 0x9e89860 0x9e899a8 0x9e89e67 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc597 /lib64/libasan.so.8+0x8eea /lib64/libasan.so.8+0xedc45 0xe1d59b 0x9d48d49 0x78947dd 0x7bea228 0x7bf3e60 0x7a431c9 0x7a807bd 0x711f05d 0x6f43702 0x6f45a6a 0x7483f52 0x72a690f 0x72a6a11 0x72a6b09 0x7360706 0x73607bf 0x7360972 0x7360aaa 0x7360b25 0x7360baa 0x7360d05 0x7423961 0x7483fdb 0x728dda4 0x72a6c86 0x73b49a4 0x743027a 0x74302f5 0x7430370 0x74f3b82 0x75ebd86 0x9ee2cc7 0x9e36f9c 0x9f10737 0x9f78f1a 0x9f939aa 0x9f94026 0x26ea5d3 0xa5a1f30 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-26T03:15:22.909 INFO:teuthology.orchestra.run.trial086.stderr:kernel callstack: 0xffffffffffffff80 0xffffffff9dc9431b 0xffffffff9de1feb5 0xffffffff9de203b0 0xffffffff9dc9525e 0xffffffff9dfe7269 0xffffffff9dfca7d5 0xffffffff9dfd4bab 0xffffffff9dfd500b 0xffffffff9dc910d2 0xffffffff9e950451 0xffffffff9ea00ba2 2026-02-26T03:15:22.909 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9e28178 0x9e28461 0x9e88dff 0x9e895f2 0x9e89860 0x9e899a8 0x9e89e67 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc589 /lib64/libasan.so.8+0x8eea /lib64/libasan.so.8+0xedc45 0xe1d59b 0x9d258d6 0x9d25a92 0x9d25bfb 0x9d25d26 0x9d26250 0x9d42adb 0x9d477c3 0x9d07d91 0x9d06d91 0x7bea2f1 0x7bf3e60 0x7a431c9 0x7a807bd 0x711f05d 0x6f43702 0x6f45a6a 0x7483f52 0x72a690f 0x72a6a11 0x72a6b09 0x7360706 0x73607bf 0x7360972 0x7360aaa 0x7360b25 0x7360baa 0x7360d05 0x7423961 0x7483fdb 0x728dda4 0x72a6c86 0x73b49a4 0x743027a 0x74302f5 0x7430370 0x74f3b82 0x75ebd86 0x9ee2cc7 0x9e36f9c 0x9f10737 0x9f78f1a 0x9f939aa 0x9f94026 0x26ea5d3 0xa5a1f30 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-26T03:15:22.909 INFO:teuthology.orchestra.run.trial086.stderr:kernel callstack: 0xffffffffffffff80 0xffffffff9dc91052 0xffffffff9e950451 0xffffffff9ea00ba2 2026-02-26T03:15:22.991 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9e28178 0x9e28461 0x9e88dff 0x9e895f2 0x9e89860 0x9e899a8 0x9e89e67 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc6592 /lib64/libasan.so.8+0x15197 0x2a55a3f 0x7d837b9 0x7d9fd5e 0x7e419e3 0x7dc12dd 0x7877bf3 0x78788e8 0x79adc2a 0x7836cfc 0x78b1d9e 0x78fa531 0x78fa7aa 0x799b982 0x799bae1 0x79add8d 0x7868874 0x798a5f1 0x798a680 0x798a724 0x73e442a 0x7404ce9 0x740998a 0x754d7e2 0x9ee2cc7 0x9e36f9c 0x9f10737 0x9f78f1a 0x9f7a738 0x9bf83c1 0x9bf8bfc 0xecf14d /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb46f44 2026-02-26T03:15:23.003 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9e28178 0x9e28461 0x9e88dff 0x9e895f2 0x9e89860 0x9e899a8 0x9e89e67 /lib64/libc.so.6+0x3fc2f 0x2a55363 0x7d837f4 0x7d9fd5e 0x7e419e3 0x7dc12dd 0x7877bf3 0x78788e8 0x79adc2a 0x7836cfc 0x78b1d9e 0x78fa531 0x78fa7aa 0x799b982 0x799bae1 0x79add8d 0x7868874 0x798a5f1 0x798a680 0x798a724 0x73e442a 0x7404ce9 0x740998a 0x754d7e2 0x9ee2cc7 0x9e36f9c 0x9f10737 0x9f78f1a 0x9f939aa 0x9f94026 0x26ea5d3 0xa5a1f30 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-26T03:15:23.004 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9e28178 0x9e28461 0x9e88dff 0x9e895f2 0x9e89860 0x9e899a8 0x9e89e67 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1006a8 /lib64/libasan.so.8+0xc65b9 /lib64/libasan.so.8+0x15197 0x2a55a3f 0x7d837b9 0x7d9fd5e 0x7e419e3 0x7dc12dd 0x7877bf3 0x78788e8 0x79adc2a 0x7836cfc 0x78b1d9e 0x78fa531 0x78fa7aa 0x799b982 0x799bae1 0x79add8d 0x7868874 0x798a5f1 0x798a680 0x798a724 0x73e442a 0x7404ce9 0x740998a 0x754d7e2 0x9ee2cc7 0x9e36f9c 0x9f10737 0x9f78f1a 0x9f939aa 0x9f94026 0x26ea5d3 0xa5a1f30 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-26T03:15:25.185 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:15:25.185 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:15:25.185 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:15:25.186 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:15:25.186 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:15:25.186 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:15:25.218 DEBUG:teuthology.orchestra.run.trial086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-26T03:15:25.244 DEBUG:teuthology.orchestra.run.trial086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-26T03:15:25.394 INFO:teuthology.orchestra.run.trial086.stderr:INFO  osd - OSD::main: parsing early config 2026-02-26T03:15:25.454 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:15:25,452 seastar - Reactor backend: linux-aio 2026-02-26T03:15:25.472 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:15:25,470 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:15:25.472 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:15:25,470 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:15:25.474 INFO:teuthology.orchestra.run.trial086.stderr:==40095==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:15:25.529 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:15:25,526 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-26T03:15:25.529 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:15:25,526 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-26T03:15:25.529 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:15:25,526 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-26T03:15:25.529 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:15:25,526 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 3 2026-02-26T03:15:25.530 INFO:teuthology.orchestra.run.trial086.stderr:DEBUG 2026-02-26 03:15:25,526 [shard 0:main] seastar - reactor::drain 2026-02-26T03:15:27.584 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:15:27.584 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:15:27.584 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:15:27.584 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:15:27.584 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:15:27.584 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:15:27.604 INFO:teuthology.orchestra.run.trial086.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-26T03:15:27.604 INFO:teuthology.orchestra.run.trial086.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-26T03:15:27.656 INFO:teuthology.orchestra.run.trial086.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-26T03:15:27.656 INFO:teuthology.orchestra.run.trial086.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-26T03:15:27.662 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:15:27,660 seastar - Reactor backend: linux-aio 2026-02-26T03:15:27.671 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:15:27,668 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:15:27.671 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:15:27,668 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:15:27.673 INFO:teuthology.orchestra.run.trial086.stderr:==40093==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:15:27.674 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:15:27,671 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-26T03:15:27.731 INFO:teuthology.orchestra.run.trial086.stderr:DEBUG 2026-02-26 03:15:27,729 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-26T03:15:27.810 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9e28178 0x9e28461 0x9e88dff 0x9e895f2 0x9e89860 0x9e899a8 0x9e89e67 /lib64/libc.so.6+0x3fc2f 0x9d33784 0x9d33e86 0x9d34209 0x9d44360 0x9d477c3 0x9d07d91 0x9d06d91 0x7bea2f1 0x7bf3e60 0x7a431c9 0x7a807bd 0x711f05d 0x6fa06ea 0x6fa44eb 0x6faa095 0x7419054 0x743ba5c 0x728f369 0x728f461 0x736153a 0x73615f3 0x73617aa 0x743badd 0x728f4de 0x728f563 0x72bb301 0x7423ee4 0x7423f69 0x7424047 0x72a6c86 0x73b49a4 0x743027a 0x74302f5 0x7430370 0x74f3b82 0x75ebd86 0x9ee2cc7 0x9e36f9c 0x9f10737 0x9f78f1a 0x9f939aa 0x9f94026 0x26ea5d3 0xa5a1f30 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-26T03:15:27.810 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9e28178 0x9e28461 0x9e88dff 0x9e895f2 0x9e89860 0x9e899a8 0x9e89e67 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x15865 0x10908ef 0xf2e0dc 0x9c50c5c 0x9c50f59 0x9c511cc 0x9c51482 0x9c51a44 0x9c59eeb 0x9c5a5cb 0x9d43118 0x9d477c3 0x9d07d91 0x9d06d91 0x7bea2f1 0x7bf3e60 0x7a431c9 0x7a807bd 0x711f05d 0x6fa06ea 0x6fa44eb 0x6faa095 0x7419054 0x743ba5c 0x728f369 0x728f461 0x736153a 0x73615f3 0x73617aa 0x743badd 0x728f4de 0x728f563 0x72bb301 0x7423ee4 0x7423f69 0x7424047 0x72a6c86 0x73b49a4 0x743027a 0x74302f5 0x7430370 0x74f3b82 0x75ebd86 0x9ee2cc7 0x9e36f9c 0x9f10737 0x9f78f1a 0x9f939aa 0x9f94026 0x26ea5d3 0xa5a1f30 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-26T03:15:27.907 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9e28178 0x9e28461 0x9e88dff 0x9e895f2 0x9e89860 0x9e899a8 0x9e89e67 /lib64/libc.so.6+0x3fc2f 0x2a55954 0x7d837b9 0x7d9fd5e 0x7e419e3 0x7dc12dd 0x7877bf3 0x78788e8 0x79adc2a 0x7836cfc 0x78b1d9e 0x78fa531 0x78fa7aa 0x799b982 0x799bae1 0x79add8d 0x7868874 0x798a5f1 0x798a680 0x798a724 0x73e442a 0x7404ce9 0x740998a 0x754d7e2 0x9ee2cc7 0x9e36f9c 0x9f10737 0x9f78f1a 0x9f7a738 0x9bf83c1 0x9bf8bfc 0xecf14d /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb46f44 2026-02-26T03:15:27.946 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9e28178 0x9e28461 0x9e88dff 0x9e895f2 0x9e89860 0x9e899a8 0x9e89e67 /lib64/libc.so.6+0x3fc2f 0x2a55a3f 0x7d837b9 0x7d9fd5e 0x7e419e3 0x7dc12dd 0x7877bf3 0x78788e8 0x79adc2a 0x7836cfc 0x78b1d9e 0x78fa531 0x78fa7aa 0x799b982 0x799bae1 0x79add8d 0x7868874 0x798a5f1 0x798a680 0x798a724 0x73e442a 0x7404ce9 0x740998a 0x754d7e2 0x9ee2cc7 0x9e36f9c 0x9f10737 0x9f78f1a 0x9f939aa 0x9f94026 0x26ea5d3 0xa5a1f30 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-26T03:15:27.947 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9e28178 0x9e28461 0x9e88dff 0x9e895f2 0x9e89860 0x9e899a8 0x9e89e67 /lib64/libc.so.6+0x3fc2f 0x2a54d2f 0x7d837e7 0x7d9fd5e 0x7e419e3 0x7dc12dd 0x7877bf3 0x78788e8 0x79adc2a 0x7836cfc 0x78b1d9e 0x78fa531 0x78fa7aa 0x799b982 0x799bae1 0x79add8d 0x7868874 0x798a5f1 0x798a680 0x798a724 0x73e442a 0x7404ce9 0x740998a 0x754d7e2 0x9ee2cc7 0x9e36f9c 0x9f10737 0x9f78f1a 0x9f939aa 0x9f94026 0x26ea5d3 0xa5a1f30 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-26T03:15:28.091 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9e28178 0x9e28461 0x9e88dff 0x9e895f2 0x9e89860 0x9e899a8 0x9e89e67 /lib64/libc.so.6+0x3fc2f /lib64/ld-linux-x86-64.so.2+0x16ebc /lib64/libasan.so.8+0xc65b1 /lib64/libasan.so.8+0x15197 0x316f517 0x9c511ba 0x9c51482 0x9c51f31 0x9c5242f 0x9c52a5f 0x9c52bc9 0x9d32f39 0x9d45d3c 0x9d07d91 0x9d06d91 0x7bea2f1 0x7bf3e60 0x7a431c9 0x7a807bd 0x711f05d 0x6f43702 0x6f45a6a 0x7483f52 0x72a690f 0x72a6a11 0x72a6b09 0x7360706 0x73607bf 0x7360972 0x7360aaa 0x7360b25 0x7360baa 0x7360d05 0x7423961 0x7483fdb 0x728dda4 0x72a6c86 0x73b49a4 0x743027a 0x74302f5 0x7430370 0x74f3b82 0x75ebd86 0x9ee2cc7 0x9e36f9c 0x9f10737 0x9f78f1a 0x9f939aa 0x9f94026 0x26ea5d3 0xa5a1f30 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-26T03:15:28.092 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9e28178 0x9e28461 0x9e88dff 0x9e895f2 0x9e89860 0x9e899a8 0x9e89e67 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc65c2 /lib64/libasan.so.8+0x157c7 0x10908ef 0xf2e0dc 0x9c50a8f 0x9c50f59 0x9c511cc 0x9c51482 0x9c51f31 0x9c5242f 0x9c52a5f 0x9c52bc9 0x9d32f39 0x9d45d3c 0x9d07d91 0x9d06d91 0x7bea2f1 0x7bf3e60 0x7a431c9 0x7a807bd 0x711f05d 0x6f43702 0x6f45a6a 0x7483f52 0x72a690f 0x72a6a11 0x72a6b09 0x7360706 0x73607bf 0x7360972 0x7360aaa 0x7360b25 0x7360baa 0x7360d05 0x7423961 0x7483fdb 0x728dda4 0x72a6c86 0x73b49a4 0x743027a 0x74302f5 0x7430370 0x74f3b82 0x75ebd86 0x9ee2cc7 0x9e36f9c 0x9f10737 0x9f78f1a 0x9f939aa 0x9f94026 0x26ea5d3 0xa5a1f30 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-26T03:15:28.142 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 32 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9e28178 0x9e28461 0x9e88dff 0x9e895f2 0x9e89860 0x9e899a8 0x9e89e67 /lib64/libc.so.6+0x3fc2f 0x2a55888 0x7d837b9 0x7d9fd5e 0x7e419e3 0x7dc12dd 0x7877bf3 0x78788e8 0x79adc2a 0x7836cfc 0x78b1d9e 0x78fa531 0x78fa7aa 0x799b982 0x799bae1 0x79add8d 0x7868874 0x798a5f1 0x798a680 0x798a724 0x73e442a 0x7404ce9 0x740998a 0x754d7e2 0x9ee2cc7 0x9e36f9c 0x9f10737 0x9f78f1a 0x9f7a738 0x9bf83c1 0x9bf8bfc 0xecf14d /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb46f44 2026-02-26T03:15:28.187 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9e28178 0x9e28461 0x9e88dff 0x9e895f2 0x9e89860 0x9e899a8 0x9e89e67 /lib64/libc.so.6+0x3fc2f 0x2a559ce 0x7d837b9 0x7d9fd5e 0x7e419e3 0x7dc12dd 0x7877bf3 0x78788e8 0x79adc2a 0x7836cfc 0x78b1d9e 0x78fa531 0x78fa7aa 0x799b982 0x799bae1 0x79add8d 0x7868874 0x798a5f1 0x798a680 0x798a724 0x73e442a 0x7404ce9 0x740998a 0x754d7e2 0x9ee2cc7 0x9e36f9c 0x9f10737 0x9f78f1a 0x9f939aa 0x9f94026 0x26ea5d3 0xa5a1f30 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-26T03:15:28.187 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9e28178 0x9e28461 0x9e88dff 0x9e895f2 0x9e89860 0x9e899a8 0x9e89e67 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x10069f /lib64/libasan.so.8+0xc65b9 /lib64/libasan.so.8+0x15197 0x2a55a3f 0x7d837b9 0x7d9fd5e 0x7e419e3 0x7dc12dd 0x7877bf3 0x78788e8 0x79adc2a 0x7836cfc 0x78b1d9e 0x78fa531 0x78fa7aa 0x799b982 0x799bae1 0x79add8d 0x7868874 0x798a5f1 0x798a680 0x798a724 0x73e442a 0x7404ce9 0x740998a 0x754d7e2 0x9ee2cc7 0x9e36f9c 0x9f10737 0x9f78f1a 0x9f939aa 0x9f94026 0x26ea5d3 0xa5a1f30 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-26T03:15:28.199 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 90 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9e28178 0x9e28461 0x9e88dff 0x9e895f2 0x9e89860 0x9e899a8 0x9e89e67 /lib64/libc.so.6+0x3fc2f 0x2a54a02 0x7d837d2 0x7d9fd5e 0x7e419e3 0x7dc12dd 0x7877bf3 0x78788e8 0x79adc2a 0x7836cfc 0x78b1d9e 0x78fa531 0x78fa7aa 0x799b982 0x799bae1 0x79add8d 0x7868874 0x798a5f1 0x798a680 0x798a724 0x73e442a 0x7404ce9 0x740998a 0x754d7e2 0x9ee2cc7 0x9e36f9c 0x9f10737 0x9f78f1a 0x9f7a738 0x9bf83c1 0x9bf8bfc 0xecf14d /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb46f44 2026-02-26T03:15:30.367 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:15:30.367 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:15:30.367 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:15:30.367 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:15:30.367 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:15:30.367 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:15:30.402 DEBUG:teuthology.orchestra.run.trial086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-26T03:15:30.427 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-26T03:15:30.428 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-26T03:15:30.428 DEBUG:teuthology.orchestra.run.trial086:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-26T03:15:30.492 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-26T03:15:30.492 DEBUG:teuthology.orchestra.run.trial086:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-26T03:15:30.555 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-26T03:15:30.556 DEBUG:teuthology.orchestra.run.trial086:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-26T03:15:30.619 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-26T03:15:30.620 DEBUG:teuthology.orchestra.run.trial086:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-26T03:15:30.682 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-26T03:15:30.683 DEBUG:teuthology.orchestra.run.trial086:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-26T03:15:30.747 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-26T03:15:30.747 DEBUG:teuthology.orchestra.run.trial086:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-26T03:15:30.803 INFO:tasks.ceph:Adding keys to all mons... 2026-02-26T03:15:30.803 DEBUG:teuthology.orchestra.run.trial086:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-26T03:15:30.865 INFO:teuthology.orchestra.run.trial086.stdout:[mgr.x] 2026-02-26T03:15:30.866 INFO:teuthology.orchestra.run.trial086.stdout: key = AQC6up9pIAbqFhAATzj8xxg/n4r57b4W1QY3Jg== 2026-02-26T03:15:30.866 INFO:teuthology.orchestra.run.trial086.stdout:[osd.0] 2026-02-26T03:15:30.866 INFO:teuthology.orchestra.run.trial086.stdout: key = AQDAup9prJt1DxAAosqwWElVg1jGmDwxRd9SCA== 2026-02-26T03:15:30.866 INFO:teuthology.orchestra.run.trial086.stdout:[osd.1] 2026-02-26T03:15:30.866 INFO:teuthology.orchestra.run.trial086.stdout: key = AQDFup9pk6M+FBAAc2aOABQJ/aaPg2yTawiiiw== 2026-02-26T03:15:30.866 INFO:teuthology.orchestra.run.trial086.stdout:[osd.2] 2026-02-26T03:15:30.866 INFO:teuthology.orchestra.run.trial086.stdout: key = AQDKup9pyMflIBAAowEL96NXZYi+aaERV7WzHw== 2026-02-26T03:15:30.866 INFO:teuthology.orchestra.run.trial086.stdout:[osd.3] 2026-02-26T03:15:30.866 INFO:teuthology.orchestra.run.trial086.stdout: key = AQDPup9pllmyKxAAmdSv9G/J9swczR1NvN7kZQ== 2026-02-26T03:15:30.866 INFO:teuthology.orchestra.run.trial086.stdout:[client.0] 2026-02-26T03:15:30.866 INFO:teuthology.orchestra.run.trial086.stdout: key = AQC6up9prAWdGRAAao/ldzV0i+hk4Xdk+asKGQ== 2026-02-26T03:15:30.867 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-26T03:15:30.954 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T03:15:31.003 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T03:15:31.054 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T03:15:31.104 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T03:15:31.154 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-26T03:15:31.205 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-26T03:15:31.206 DEBUG:teuthology.orchestra.run.trial086:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-26T03:15:31.230 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-26T03:15:31.316 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:31.313+0000 7f0b7c8b4c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:31.316 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:31.313+0000 7f0b7c8b4c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:31.328 DEBUG:teuthology.orchestra.run.trial086:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-26T03:15:31.351 DEBUG:teuthology.orchestra.run.trial086:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-26T03:15:31.407 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-26T03:15:31.407 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-26T03:15:31.408 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-26T03:15:31.449 INFO:tasks.ceph.mon.a:Started 2026-02-26T03:15:31.450 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-26T03:15:31.450 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-26T03:15:31.450 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-26T03:15:31.451 INFO:tasks.ceph.mgr.x:Started 2026-02-26T03:15:31.452 DEBUG:tasks.ceph:set 0 configs 2026-02-26T03:15:31.452 DEBUG:teuthology.orchestra.run.trial086:> sudo ceph --cluster ceph config dump 2026-02-26T03:15:31.513 INFO:tasks.ceph.mgr.x.trial086.stderr:2026-02-26T03:15:31.509+0000 7f3df25bdfc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:31.513 INFO:tasks.ceph.mon.a.trial086.stderr:2026-02-26T03:15:31.509+0000 7f92d7ae1c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:31.514 INFO:tasks.ceph.mon.a.trial086.stderr:2026-02-26T03:15:31.509+0000 7f92d7ae1c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:31.514 INFO:tasks.ceph.mon.a.trial086.stderr:2026-02-26T03:15:31.509+0000 7f92d7ae1c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:31.527 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:31.521+0000 7faea085a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:31.532 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:31.529+0000 7faea085a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:31.566 INFO:teuthology.orchestra.run.trial086.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-26T03:15:31.574 INFO:tasks.ceph:Setting crush tunables to default 2026-02-26T03:15:31.574 DEBUG:teuthology.orchestra.run.trial086:> sudo ceph --cluster ceph osd crush tunables default 2026-02-26T03:15:31.648 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:31.641+0000 7f6e9679c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:31.650 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:31.646+0000 7f6e9679c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:31.684 INFO:teuthology.orchestra.run.trial086.stderr:adjusted tunables profile to default 2026-02-26T03:15:31.693 INFO:tasks.ceph:check_enable_crimson: True 2026-02-26T03:15:31.693 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2026-02-26T03:15:31.693 DEBUG:teuthology.orchestra.run.trial086:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2026-02-26T03:15:31.717 INFO:tasks.ceph.mgr.x.trial086.stderr:2026-02-26T03:15:31.713+0000 7f3df25bdfc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:31.717 INFO:tasks.ceph.mgr.x.trial086.stderr:2026-02-26T03:15:31.714+0000 7f3df25bdfc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:31.766 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:31.760+0000 7fafc619c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:31.768 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:31.765+0000 7fafc619c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:31.807 INFO:tasks.ceph.mon.a.trial086.stderr:2026-02-26T03:15:31.804+0000 7f92cf1f1640 -1 WARNING: experimental feature 'crimson' is enabled 2026-02-26T03:15:31.807 INFO:tasks.ceph.mon.a.trial086.stderr:Please be aware that this feature is experimental, untested, 2026-02-26T03:15:31.808 INFO:tasks.ceph.mon.a.trial086.stderr:unsupported, and may result in data corruption, data loss, 2026-02-26T03:15:31.808 INFO:tasks.ceph.mon.a.trial086.stderr:and/or irreparable damage to your cluster. Do not use 2026-02-26T03:15:31.808 INFO:tasks.ceph.mon.a.trial086.stderr:feature with important data. 2026-02-26T03:15:31.808 INFO:tasks.ceph.mon.a.trial086.stderr: 2026-02-26T03:15:32.557 INFO:tasks.ceph.mgr.x.trial086.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-26T03:15:32.557 INFO:tasks.ceph.mgr.x.trial086.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-26T03:15:32.557 INFO:tasks.ceph.mgr.x.trial086.stderr: from numpy import show_config as show_numpy_config 2026-02-26T03:15:32.695 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-26T03:15:32.695 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-26T03:15:32.695 DEBUG:teuthology.orchestra.run.trial086:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-26T03:15:32.760 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-26T03:15:32.761 DEBUG:teuthology.orchestra.run.trial086:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-26T03:15:32.826 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-26T03:15:32.826 DEBUG:teuthology.orchestra.run.trial086:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-26T03:15:32.891 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-26T03:15:32.891 DEBUG:teuthology.orchestra.run.trial086:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-26T03:15:32.954 DEBUG:teuthology.orchestra.run.trial086:> sudo ceph --cluster ceph osd new b692f9c9-579d-4a92-b02c-beefe594ff12 0 2026-02-26T03:15:33.067 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:33.059+0000 7f306ce5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:33.069 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:33.066+0000 7f306ce5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:33.107 INFO:teuthology.orchestra.run.trial086.stdout:0 2026-02-26T03:15:33.115 DEBUG:teuthology.orchestra.run.trial086:> sudo ceph --cluster ceph osd new 1935ef84-dee5-4745-8c38-6435b71c819c 1 2026-02-26T03:15:33.187 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:33.180+0000 7f38c3ccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:33.189 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:33.186+0000 7f38c3ccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:33.228 INFO:teuthology.orchestra.run.trial086.stdout:1 2026-02-26T03:15:33.236 DEBUG:teuthology.orchestra.run.trial086:> sudo ceph --cluster ceph osd new bf958cf8-549c-42c6-9510-269812a65fb6 2 2026-02-26T03:15:33.310 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:33.303+0000 7ffa43a5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:33.312 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:33.308+0000 7ffa43a5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:33.350 INFO:teuthology.orchestra.run.trial086.stdout:2 2026-02-26T03:15:33.359 DEBUG:teuthology.orchestra.run.trial086:> sudo ceph --cluster ceph osd new cf449d79-9ec0-4e20-a163-3ce8ac17c2cb 3 2026-02-26T03:15:33.434 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:33.426+0000 7fa0773e4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:33.436 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:33.433+0000 7fa0773e4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:33.474 INFO:teuthology.orchestra.run.trial086.stdout:3 2026-02-26T03:15:33.483 DEBUG:teuthology.orchestra.run.trial086:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2026-02-26T03:15:33.510 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-26T03:15:33.511 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2026-02-26T03:15:33.553 INFO:tasks.ceph.osd.0:Started 2026-02-26T03:15:33.553 DEBUG:teuthology.orchestra.run.trial086:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2026-02-26T03:15:33.582 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-26T03:15:33.583 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2026-02-26T03:15:33.626 INFO:tasks.ceph.osd.1:Started 2026-02-26T03:15:33.626 DEBUG:teuthology.orchestra.run.trial086:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2026-02-26T03:15:33.654 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-26T03:15:33.654 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2026-02-26T03:15:33.698 INFO:tasks.ceph.osd.2:Started 2026-02-26T03:15:33.698 DEBUG:teuthology.orchestra.run.trial086:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.3.log 2026-02-26T03:15:33.728 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-26T03:15:33.729 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2026-02-26T03:15:33.772 INFO:tasks.ceph.osd.3:Started 2026-02-26T03:15:33.772 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-26T03:15:33.850 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:33.845+0000 7faf7fec2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:33.853 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:33.850+0000 7faf7fec2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:33.888 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:15:33.888 INFO:teuthology.orchestra.run.trial086.stdout:{"epoch":7,"fsid":"a3320112-ec0c-4bb6-bf8e-5331f894afbc","created":"2026-02-26T03:15:31.523265+0000","modified":"2026-02-26T03:15:33.471683+0000","last_up_change":"0.000000","last_in_change":"2026-02-26T03:15:33.471683+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"b692f9c9-579d-4a92-b02c-beefe594ff12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1935ef84-dee5-4745-8c38-6435b71c819c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"bf958cf8-549c-42c6-9510-269812a65fb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cf449d79-9ec0-4e20-a163-3ce8ac17c2cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-26T03:15:33.897 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-26T03:15:33.897 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-26T03:15:34.300 DEBUG:teuthology.orchestra.run.trial086:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-26T03:15:34.369 INFO:teuthology.misc.health.trial086.stderr:2026-02-26T03:15:34.363+0000 7f0ef6f5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:34.371 INFO:teuthology.misc.health.trial086.stderr:2026-02-26T03:15:34.367+0000 7f0ef6f5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:34.403 INFO:teuthology.misc.health.trial086.stdout: 2026-02-26T03:15:34.403 INFO:teuthology.misc.health.trial086.stdout:{"epoch":7,"fsid":"a3320112-ec0c-4bb6-bf8e-5331f894afbc","created":"2026-02-26T03:15:31.523265+0000","modified":"2026-02-26T03:15:33.471683+0000","last_up_change":"0.000000","last_in_change":"2026-02-26T03:15:33.471683+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"b692f9c9-579d-4a92-b02c-beefe594ff12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1935ef84-dee5-4745-8c38-6435b71c819c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"bf958cf8-549c-42c6-9510-269812a65fb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cf449d79-9ec0-4e20-a163-3ce8ac17c2cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-26T03:15:34.411 DEBUG:teuthology.misc:0 of 4 OSDs are up 2026-02-26T03:15:34.947 INFO:tasks.ceph.mgr.x.trial086.stderr:2026-02-26T03:15:34.943+0000 7f3d0d51f640 -1 mgr.server handle_report got status from non-daemon mon.a 2026-02-26T03:15:40.814 DEBUG:teuthology.orchestra.run.trial086:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-26T03:15:40.880 INFO:teuthology.misc.health.trial086.stderr:2026-02-26T03:15:40.875+0000 7f1964e06640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:40.882 INFO:teuthology.misc.health.trial086.stderr:2026-02-26T03:15:40.879+0000 7f1964e06640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:41.004 INFO:teuthology.misc.health.trial086.stdout: 2026-02-26T03:15:41.004 INFO:teuthology.misc.health.trial086.stdout:{"epoch":7,"fsid":"a3320112-ec0c-4bb6-bf8e-5331f894afbc","created":"2026-02-26T03:15:31.523265+0000","modified":"2026-02-26T03:15:33.471683+0000","last_up_change":"0.000000","last_in_change":"2026-02-26T03:15:33.471683+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"b692f9c9-579d-4a92-b02c-beefe594ff12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1935ef84-dee5-4745-8c38-6435b71c819c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"bf958cf8-549c-42c6-9510-269812a65fb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cf449d79-9ec0-4e20-a163-3ce8ac17c2cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-26T03:15:41.014 DEBUG:teuthology.misc:0 of 4 OSDs are up 2026-02-26T03:15:47.417 DEBUG:teuthology.orchestra.run.trial086:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-26T03:15:47.486 INFO:teuthology.misc.health.trial086.stderr:2026-02-26T03:15:47.480+0000 7f86c19cc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:47.488 INFO:teuthology.misc.health.trial086.stderr:2026-02-26T03:15:47.485+0000 7f86c19cc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:47.602 INFO:teuthology.misc.health.trial086.stdout: 2026-02-26T03:15:47.602 INFO:teuthology.misc.health.trial086.stdout:{"epoch":13,"fsid":"a3320112-ec0c-4bb6-bf8e-5331f894afbc","created":"2026-02-26T03:15:31.523265+0000","modified":"2026-02-26T03:15:47.071753+0000","last_up_change":"2026-02-26T03:15:45.062898+0000","last_in_change":"2026-02-26T03:15:33.471683+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-26T03:15:45.957480+0000","flags":294913,"flags_names":"hashpspool,creating,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b692f9c9-579d-4a92-b02c-beefe594ff12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6809","nonce":1229323153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6810","nonce":1229323153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6816","nonce":1229323153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6817","nonce":1229323153}]},"public_addr":"10.20.193.86:6809/1229323153","cluster_addr":"10.20.193.86:6810/1229323153","heartbeat_back_addr":"10.20.193.86:6816/1229323153","heartbeat_front_addr":"10.20.193.86:6817/1229323153","state":["exists","up"]},{"osd":1,"uuid":"1935ef84-dee5-4745-8c38-6435b71c819c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6803","nonce":2744027137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6802","nonce":2744027137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6808","nonce":2744027137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6811","nonce":2744027137}]},"public_addr":"10.20.193.86:6803/2744027137","cluster_addr":"10.20.193.86:6802/2744027137","heartbeat_back_addr":"10.20.193.86:6808/2744027137","heartbeat_front_addr":"10.20.193.86:6811/2744027137","state":["exists","up"]},{"osd":2,"uuid":"bf958cf8-549c-42c6-9510-269812a65fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6805","nonce":3653919688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6804","nonce":3653919688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6813","nonce":3653919688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6812","nonce":3653919688}]},"public_addr":"10.20.193.86:6805/3653919688","cluster_addr":"10.20.193.86:6804/3653919688","heartbeat_back_addr":"10.20.193.86:6813/3653919688","heartbeat_front_addr":"10.20.193.86:6812/3653919688","state":["exists","up"]},{"osd":3,"uuid":"cf449d79-9ec0-4e20-a163-3ce8ac17c2cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6806","nonce":2128187350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6807","nonce":2128187350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6815","nonce":2128187350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6814","nonce":2128187350}]},"public_addr":"10.20.193.86:6806/2128187350","cluster_addr":"10.20.193.86:6807/2128187350","heartbeat_back_addr":"10.20.193.86:6815/2128187350","heartbeat_front_addr":"10.20.193.86:6814/2128187350","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-26T03:15:47.611 DEBUG:teuthology.misc:4 of 4 OSDs are up 2026-02-26T03:15:47.611 INFO:tasks.ceph:Creating RBD pool 2026-02-26T03:15:47.611 DEBUG:teuthology.orchestra.run.trial086:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-26T03:15:47.683 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:47.676+0000 7f49142cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:47.686 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:47.682+0000 7f49142cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:48.080 INFO:teuthology.orchestra.run.trial086.stderr:pool 'rbd' created 2026-02-26T03:15:48.092 DEBUG:teuthology.orchestra.run.trial086:> rbd --cluster ceph pool init rbd 2026-02-26T03:15:48.134 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:48.131+0000 7f9195d09240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:48.135 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:48.131+0000 7f9195d09240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:48.138 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:48.134+0000 7f9195d09240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:51.117 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-26T03:15:51.117 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2026-02-26T03:15:51.118 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-26T03:15:51.231 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:51.225+0000 7f2affeb7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:51.234 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:51.230+0000 7f2affeb7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:51.346 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:15:51.356 INFO:teuthology.orchestra.run.trial086.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2026-02-26T03:15:51.357 INFO:tasks.ceph_manager:config epoch is 1 2026-02-26T03:15:51.357 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-26T03:15:51.357 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-26T03:15:51.357 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-26T03:15:51.433 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:51.427+0000 7fa8a0a5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:51.435 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:51.432+0000 7fa8a0a5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:51.578 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:15:51.587 INFO:teuthology.orchestra.run.trial086.stdout:{"epoch":5,"flags":0,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6800","nonce":2861266087},{"type":"v1","addr":"10.20.193.86:6801","nonce":2861266087}]},"active_addr":"10.20.193.86:6801/2861266087","active_change":"2026-02-26T03:15:33.939356+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[],"modules":["iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.86:0","nonce":2272316920}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.86:0","nonce":531568116}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.86:0","nonce":2277160122}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.86:0","nonce":2796852406}]}]} 2026-02-26T03:15:51.592 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-26T03:15:51.592 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-26T03:15:51.593 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-26T03:15:51.668 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:51.662+0000 7f3fa630b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:51.670 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:51.667+0000 7f3fa630b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:51.782 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:15:51.782 INFO:teuthology.orchestra.run.trial086.stdout:{"epoch":17,"fsid":"a3320112-ec0c-4bb6-bf8e-5331f894afbc","created":"2026-02-26T03:15:31.523265+0000","modified":"2026-02-26T03:15:51.083432+0000","last_up_change":"2026-02-26T03:15:45.062898+0000","last_in_change":"2026-02-26T03:15:33.471683+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-26T03:15:45.957480+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-26T03:15:47.799106+0000","flags":270337,"flags_names":"hashpspool,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b692f9c9-579d-4a92-b02c-beefe594ff12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6809","nonce":1229323153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6810","nonce":1229323153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6816","nonce":1229323153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6817","nonce":1229323153}]},"public_addr":"10.20.193.86:6809/1229323153","cluster_addr":"10.20.193.86:6810/1229323153","heartbeat_back_addr":"10.20.193.86:6816/1229323153","heartbeat_front_addr":"10.20.193.86:6817/1229323153","state":["exists","up"]},{"osd":1,"uuid":"1935ef84-dee5-4745-8c38-6435b71c819c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6803","nonce":2744027137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6802","nonce":2744027137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6808","nonce":2744027137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6811","nonce":2744027137}]},"public_addr":"10.20.193.86:6803/2744027137","cluster_addr":"10.20.193.86:6802/2744027137","heartbeat_back_addr":"10.20.193.86:6808/2744027137","heartbeat_front_addr":"10.20.193.86:6811/2744027137","state":["exists","up"]},{"osd":2,"uuid":"bf958cf8-549c-42c6-9510-269812a65fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6805","nonce":3653919688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6804","nonce":3653919688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6813","nonce":3653919688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6812","nonce":3653919688}]},"public_addr":"10.20.193.86:6805/3653919688","cluster_addr":"10.20.193.86:6804/3653919688","heartbeat_back_addr":"10.20.193.86:6813/3653919688","heartbeat_front_addr":"10.20.193.86:6812/3653919688","state":["exists","up"]},{"osd":3,"uuid":"cf449d79-9ec0-4e20-a163-3ce8ac17c2cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6806","nonce":2128187350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6807","nonce":2128187350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6815","nonce":2128187350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6814","nonce":2128187350}]},"public_addr":"10.20.193.86:6806/2128187350","cluster_addr":"10.20.193.86:6807/2128187350","heartbeat_back_addr":"10.20.193.86:6815/2128187350","heartbeat_front_addr":"10.20.193.86:6814/2128187350","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-26T03:15:51.791 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-26T03:15:51.791 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-26T03:15:51.866 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:51.859+0000 7f5aceb93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:51.868 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:51.865+0000 7f5aceb93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:51.979 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:15:51.980 INFO:teuthology.orchestra.run.trial086.stdout:{"epoch":17,"fsid":"a3320112-ec0c-4bb6-bf8e-5331f894afbc","created":"2026-02-26T03:15:31.523265+0000","modified":"2026-02-26T03:15:51.083432+0000","last_up_change":"2026-02-26T03:15:45.062898+0000","last_in_change":"2026-02-26T03:15:33.471683+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-26T03:15:45.957480+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-26T03:15:47.799106+0000","flags":270337,"flags_names":"hashpspool,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b692f9c9-579d-4a92-b02c-beefe594ff12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6809","nonce":1229323153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6810","nonce":1229323153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6816","nonce":1229323153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6817","nonce":1229323153}]},"public_addr":"10.20.193.86:6809/1229323153","cluster_addr":"10.20.193.86:6810/1229323153","heartbeat_back_addr":"10.20.193.86:6816/1229323153","heartbeat_front_addr":"10.20.193.86:6817/1229323153","state":["exists","up"]},{"osd":1,"uuid":"1935ef84-dee5-4745-8c38-6435b71c819c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6803","nonce":2744027137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6802","nonce":2744027137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6808","nonce":2744027137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6811","nonce":2744027137}]},"public_addr":"10.20.193.86:6803/2744027137","cluster_addr":"10.20.193.86:6802/2744027137","heartbeat_back_addr":"10.20.193.86:6808/2744027137","heartbeat_front_addr":"10.20.193.86:6811/2744027137","state":["exists","up"]},{"osd":2,"uuid":"bf958cf8-549c-42c6-9510-269812a65fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6805","nonce":3653919688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6804","nonce":3653919688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6813","nonce":3653919688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6812","nonce":3653919688}]},"public_addr":"10.20.193.86:6805/3653919688","cluster_addr":"10.20.193.86:6804/3653919688","heartbeat_back_addr":"10.20.193.86:6813/3653919688","heartbeat_front_addr":"10.20.193.86:6812/3653919688","state":["exists","up"]},{"osd":3,"uuid":"cf449d79-9ec0-4e20-a163-3ce8ac17c2cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6806","nonce":2128187350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6807","nonce":2128187350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6815","nonce":2128187350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6814","nonce":2128187350}]},"public_addr":"10.20.193.86:6806/2128187350","cluster_addr":"10.20.193.86:6807/2128187350","heartbeat_back_addr":"10.20.193.86:6815/2128187350","heartbeat_front_addr":"10.20.193.86:6814/2128187350","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-26T03:15:51.990 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-26T03:15:51.991 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-26T03:15:51.991 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-26T03:15:51.992 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-26T03:15:52.073 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:52.067+0000 7fb23a25a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:52.074 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:52.067+0000 7f742410b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:52.074 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:52.067+0000 7fc5c5b5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:52.076 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:52.070+0000 7fd36950b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:52.076 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:52.072+0000 7f742410b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:52.076 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:52.072+0000 7fb23a25a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:52.076 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:52.073+0000 7fc5c5b5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:52.078 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:52.075+0000 7fd36950b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:52.094 INFO:teuthology.orchestra.run.trial086.stdout:42949672968 2026-02-26T03:15:52.094 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-26T03:15:52.095 INFO:teuthology.orchestra.run.trial086.stdout:47244640263 2026-02-26T03:15:52.095 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-26T03:15:52.095 INFO:teuthology.orchestra.run.trial086.stdout:42949672968 2026-02-26T03:15:52.096 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-26T03:15:52.098 INFO:teuthology.orchestra.run.trial086.stdout:47244640263 2026-02-26T03:15:52.098 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-26T03:15:52.178 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:52.172+0000 7fc0fffe4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:52.179 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:52.173+0000 7f429fe5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:52.179 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:52.174+0000 7f49b34cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:52.180 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:52.173+0000 7f10e98cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:52.180 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:52.177+0000 7fc0fffe4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:52.181 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:52.178+0000 7f429fe5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:52.182 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:52.179+0000 7f10e98cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:52.182 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:52.179+0000 7f49b34cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:52.294 INFO:teuthology.orchestra.run.trial086.stdout:47244640263 2026-02-26T03:15:52.298 INFO:teuthology.orchestra.run.trial086.stdout:47244640261 2026-02-26T03:15:52.304 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640263 got 47244640263 for osd.0 2026-02-26T03:15:52.305 DEBUG:teuthology.parallel:result is None 2026-02-26T03:15:52.305 INFO:teuthology.orchestra.run.trial086.stdout:42949672968 2026-02-26T03:15:52.308 INFO:teuthology.orchestra.run.trial086.stdout:42949672968 2026-02-26T03:15:52.310 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640263 got 47244640261 for osd.3 2026-02-26T03:15:52.316 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672968 got 42949672968 for osd.2 2026-02-26T03:15:52.316 DEBUG:teuthology.parallel:result is None 2026-02-26T03:15:52.320 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672968 got 42949672968 for osd.1 2026-02-26T03:15:52.320 DEBUG:teuthology.parallel:result is None 2026-02-26T03:15:53.311 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-26T03:15:53.387 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:53.381+0000 7f81367cc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:53.390 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:53.386+0000 7f81367cc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:53.499 INFO:teuthology.orchestra.run.trial086.stdout:47244640261 2026-02-26T03:15:53.508 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640263 got 47244640261 for osd.3 2026-02-26T03:15:54.509 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-26T03:15:54.587 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:54.581+0000 7fc4a4435640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:54.590 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:54.586+0000 7fc4a31ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:54.700 INFO:teuthology.orchestra.run.trial086.stdout:47244640263 2026-02-26T03:15:54.709 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640263 got 47244640263 for osd.3 2026-02-26T03:15:54.709 DEBUG:teuthology.parallel:result is None 2026-02-26T03:15:54.709 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-26T03:15:54.709 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-26T03:15:54.786 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:54.780+0000 7f318bc5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:54.788 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:54.785+0000 7f318a9d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:54.897 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:15:54.898 INFO:teuthology.orchestra.run.trial086.stderr:dumped all 2026-02-26T03:15:54.907 INFO:teuthology.orchestra.run.trial086.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2026-02-26T03:15:53.943368+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2656,"kb_used_data":2656,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209188256,"statfs":{"total":214211493888,"available":214208774144,"internally_reserved":0,"allocated":2719744,"data_stored":2719744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":590387,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.858586"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-26T03:15:51.095822+0000","last_change":"2026-02-26T03:15:51.098108+0000","last_active":"2026-02-26T03:15:51.095822+0000","last_peered":"2026-02-26T03:15:51.095822+0000","last_clean":"2026-02-26T03:15:51.095822+0000","last_became_active":"2026-02-26T03:15:49.138231+0000","last_became_peered":"2026-02-26T03:15:49.138231+0000","last_unstale":"2026-02-26T03:15:51.095822+0000","last_undegraded":"2026-02-26T03:15:51.095822+0000","last_fullsized":"2026-02-26T03:15:51.095822+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-26T03:15:51.094346+0000","last_change":"2026-02-26T03:15:51.097363+0000","last_active":"2026-02-26T03:15:51.094346+0000","last_peered":"2026-02-26T03:15:51.094346+0000","last_clean":"2026-02-26T03:15:51.094346+0000","last_became_active":"2026-02-26T03:15:49.113767+0000","last_became_peered":"2026-02-26T03:15:49.113767+0000","last_unstale":"2026-02-26T03:15:51.094346+0000","last_undegraded":"2026-02-26T03:15:51.094346+0000","last_fullsized":"2026-02-26T03:15:51.094346+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-26T03:15:51.096601+0000","last_change":"2026-02-26T03:15:51.102561+0000","last_active":"2026-02-26T03:15:51.096601+0000","last_peered":"2026-02-26T03:15:51.096601+0000","last_clean":"2026-02-26T03:15:51.096601+0000","last_became_active":"2026-02-26T03:15:49.133400+0000","last_became_peered":"2026-02-26T03:15:49.133400+0000","last_unstale":"2026-02-26T03:15:51.096601+0000","last_undegraded":"2026-02-26T03:15:51.096601+0000","last_fullsized":"2026-02-26T03:15:51.096601+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-26T03:15:51.094640+0000","last_change":"2026-02-26T03:15:51.097251+0000","last_active":"2026-02-26T03:15:51.094640+0000","last_peered":"2026-02-26T03:15:51.094640+0000","last_clean":"2026-02-26T03:15:51.094640+0000","last_became_active":"2026-02-26T03:15:49.115240+0000","last_became_peered":"2026-02-26T03:15:49.115240+0000","last_unstale":"2026-02-26T03:15:51.094640+0000","last_undegraded":"2026-02-26T03:15:51.094640+0000","last_fullsized":"2026-02-26T03:15:51.094640+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-26T03:15:51.100441+0000","last_change":"2026-02-26T03:15:51.101920+0000","last_active":"2026-02-26T03:15:51.100441+0000","last_peered":"2026-02-26T03:15:51.100441+0000","last_clean":"2026-02-26T03:15:51.100441+0000","last_became_active":"2026-02-26T03:15:49.135739+0000","last_became_peered":"2026-02-26T03:15:49.135739+0000","last_unstale":"2026-02-26T03:15:51.100441+0000","last_undegraded":"2026-02-26T03:15:51.100441+0000","last_fullsized":"2026-02-26T03:15:51.100441+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-26T03:15:51.093251+0000","last_change":"2026-02-26T03:15:51.097070+0000","last_active":"2026-02-26T03:15:51.093251+0000","last_peered":"2026-02-26T03:15:51.093251+0000","last_clean":"2026-02-26T03:15:51.093251+0000","last_became_active":"2026-02-26T03:15:49.129694+0000","last_became_peered":"2026-02-26T03:15:49.129694+0000","last_unstale":"2026-02-26T03:15:51.093251+0000","last_undegraded":"2026-02-26T03:15:51.093251+0000","last_fullsized":"2026-02-26T03:15:51.093251+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-26T03:15:51.093257+0000","last_change":"2026-02-26T03:15:51.098257+0000","last_active":"2026-02-26T03:15:51.093257+0000","last_peered":"2026-02-26T03:15:51.093257+0000","last_clean":"2026-02-26T03:15:51.093257+0000","last_became_active":"2026-02-26T03:15:49.118473+0000","last_became_peered":"2026-02-26T03:15:49.118473+0000","last_unstale":"2026-02-26T03:15:51.093257+0000","last_undegraded":"2026-02-26T03:15:51.093257+0000","last_fullsized":"2026-02-26T03:15:51.093257+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-26T03:15:51.093860+0000","last_change":"2026-02-26T03:15:51.098328+0000","last_active":"2026-02-26T03:15:51.093860+0000","last_peered":"2026-02-26T03:15:51.093860+0000","last_clean":"2026-02-26T03:15:51.093860+0000","last_became_active":"2026-02-26T03:15:49.113988+0000","last_became_peered":"2026-02-26T03:15:49.113988+0000","last_unstale":"2026-02-26T03:15:51.093860+0000","last_undegraded":"2026-02-26T03:15:51.093860+0000","last_fullsized":"2026-02-26T03:15:51.093860+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":87,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-26T03:15:51.093199+0000","last_change":"2026-02-26T03:15:47.110154+0000","last_active":"2026-02-26T03:15:51.093199+0000","last_peered":"2026-02-26T03:15:51.093199+0000","last_clean":"2026-02-26T03:15:51.093199+0000","last_became_active":"2026-02-26T03:15:47.100608+0000","last_became_peered":"2026-02-26T03:15:47.100608+0000","last_unstale":"2026-02-26T03:15:51.093199+0000","last_undegraded":"2026-02-26T03:15:51.093199+0000","last_fullsized":"2026-02-26T03:15:51.093199+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:46.067961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:46.067961+0000","last_clean_scrub_stamp":"2026-02-26T03:15:46.067961+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160658620416,"available":160656949248,"internally_reserved":0,"allocated":1671168,"data_stored":1671168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551820800,"internally_reserved":0,"allocated":1052672,"data_stored":1052672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":268,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297460,"statfs":{"total":53552873472,"available":53552599040,"internally_reserved":0,"allocated":274432,"data_stored":274432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1028,"kb_used_data":1028,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296700,"statfs":{"total":53552873472,"available":53551820800,"internally_reserved":0,"allocated":1052672,"data_stored":1052672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640263,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":336,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297392,"statfs":{"total":53552873472,"available":53552529408,"internally_reserved":0,"allocated":344064,"data_stored":344064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640263,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1024,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296704,"statfs":{"total":53552873472,"available":53551824896,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53552873472,"available":53551820800,"internally_reserved":0,"allocated":1052672,"data_stored":1052672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53551820800,"internally_reserved":0,"allocated":1052672,"data_stored":1052672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53552599040,"internally_reserved":0,"allocated":274432,"data_stored":274432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53552529408,"internally_reserved":0,"allocated":344064,"data_stored":344064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-26T03:15:54.908 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-26T03:15:54.982 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:54.976+0000 7fab8ca35640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:54.984 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:54.981+0000 7fab8ca35640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:55.095 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:15:55.096 INFO:teuthology.orchestra.run.trial086.stderr:dumped all 2026-02-26T03:15:55.106 INFO:teuthology.orchestra.run.trial086.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2026-02-26T03:15:53.943368+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2656,"kb_used_data":2656,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209188256,"statfs":{"total":214211493888,"available":214208774144,"internally_reserved":0,"allocated":2719744,"data_stored":2719744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":590387,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.858586"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-26T03:15:51.095822+0000","last_change":"2026-02-26T03:15:51.098108+0000","last_active":"2026-02-26T03:15:51.095822+0000","last_peered":"2026-02-26T03:15:51.095822+0000","last_clean":"2026-02-26T03:15:51.095822+0000","last_became_active":"2026-02-26T03:15:49.138231+0000","last_became_peered":"2026-02-26T03:15:49.138231+0000","last_unstale":"2026-02-26T03:15:51.095822+0000","last_undegraded":"2026-02-26T03:15:51.095822+0000","last_fullsized":"2026-02-26T03:15:51.095822+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-26T03:15:51.094346+0000","last_change":"2026-02-26T03:15:51.097363+0000","last_active":"2026-02-26T03:15:51.094346+0000","last_peered":"2026-02-26T03:15:51.094346+0000","last_clean":"2026-02-26T03:15:51.094346+0000","last_became_active":"2026-02-26T03:15:49.113767+0000","last_became_peered":"2026-02-26T03:15:49.113767+0000","last_unstale":"2026-02-26T03:15:51.094346+0000","last_undegraded":"2026-02-26T03:15:51.094346+0000","last_fullsized":"2026-02-26T03:15:51.094346+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-26T03:15:51.096601+0000","last_change":"2026-02-26T03:15:51.102561+0000","last_active":"2026-02-26T03:15:51.096601+0000","last_peered":"2026-02-26T03:15:51.096601+0000","last_clean":"2026-02-26T03:15:51.096601+0000","last_became_active":"2026-02-26T03:15:49.133400+0000","last_became_peered":"2026-02-26T03:15:49.133400+0000","last_unstale":"2026-02-26T03:15:51.096601+0000","last_undegraded":"2026-02-26T03:15:51.096601+0000","last_fullsized":"2026-02-26T03:15:51.096601+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-26T03:15:51.094640+0000","last_change":"2026-02-26T03:15:51.097251+0000","last_active":"2026-02-26T03:15:51.094640+0000","last_peered":"2026-02-26T03:15:51.094640+0000","last_clean":"2026-02-26T03:15:51.094640+0000","last_became_active":"2026-02-26T03:15:49.115240+0000","last_became_peered":"2026-02-26T03:15:49.115240+0000","last_unstale":"2026-02-26T03:15:51.094640+0000","last_undegraded":"2026-02-26T03:15:51.094640+0000","last_fullsized":"2026-02-26T03:15:51.094640+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-26T03:15:51.100441+0000","last_change":"2026-02-26T03:15:51.101920+0000","last_active":"2026-02-26T03:15:51.100441+0000","last_peered":"2026-02-26T03:15:51.100441+0000","last_clean":"2026-02-26T03:15:51.100441+0000","last_became_active":"2026-02-26T03:15:49.135739+0000","last_became_peered":"2026-02-26T03:15:49.135739+0000","last_unstale":"2026-02-26T03:15:51.100441+0000","last_undegraded":"2026-02-26T03:15:51.100441+0000","last_fullsized":"2026-02-26T03:15:51.100441+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-26T03:15:51.093251+0000","last_change":"2026-02-26T03:15:51.097070+0000","last_active":"2026-02-26T03:15:51.093251+0000","last_peered":"2026-02-26T03:15:51.093251+0000","last_clean":"2026-02-26T03:15:51.093251+0000","last_became_active":"2026-02-26T03:15:49.129694+0000","last_became_peered":"2026-02-26T03:15:49.129694+0000","last_unstale":"2026-02-26T03:15:51.093251+0000","last_undegraded":"2026-02-26T03:15:51.093251+0000","last_fullsized":"2026-02-26T03:15:51.093251+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-26T03:15:51.093257+0000","last_change":"2026-02-26T03:15:51.098257+0000","last_active":"2026-02-26T03:15:51.093257+0000","last_peered":"2026-02-26T03:15:51.093257+0000","last_clean":"2026-02-26T03:15:51.093257+0000","last_became_active":"2026-02-26T03:15:49.118473+0000","last_became_peered":"2026-02-26T03:15:49.118473+0000","last_unstale":"2026-02-26T03:15:51.093257+0000","last_undegraded":"2026-02-26T03:15:51.093257+0000","last_fullsized":"2026-02-26T03:15:51.093257+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-26T03:15:51.093860+0000","last_change":"2026-02-26T03:15:51.098328+0000","last_active":"2026-02-26T03:15:51.093860+0000","last_peered":"2026-02-26T03:15:51.093860+0000","last_clean":"2026-02-26T03:15:51.093860+0000","last_became_active":"2026-02-26T03:15:49.113988+0000","last_became_peered":"2026-02-26T03:15:49.113988+0000","last_unstale":"2026-02-26T03:15:51.093860+0000","last_undegraded":"2026-02-26T03:15:51.093860+0000","last_fullsized":"2026-02-26T03:15:51.093860+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":87,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-26T03:15:51.093199+0000","last_change":"2026-02-26T03:15:47.110154+0000","last_active":"2026-02-26T03:15:51.093199+0000","last_peered":"2026-02-26T03:15:51.093199+0000","last_clean":"2026-02-26T03:15:51.093199+0000","last_became_active":"2026-02-26T03:15:47.100608+0000","last_became_peered":"2026-02-26T03:15:47.100608+0000","last_unstale":"2026-02-26T03:15:51.093199+0000","last_undegraded":"2026-02-26T03:15:51.093199+0000","last_fullsized":"2026-02-26T03:15:51.093199+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:46.067961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:46.067961+0000","last_clean_scrub_stamp":"2026-02-26T03:15:46.067961+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160658620416,"available":160656949248,"internally_reserved":0,"allocated":1671168,"data_stored":1671168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551820800,"internally_reserved":0,"allocated":1052672,"data_stored":1052672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":268,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297460,"statfs":{"total":53552873472,"available":53552599040,"internally_reserved":0,"allocated":274432,"data_stored":274432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1028,"kb_used_data":1028,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296700,"statfs":{"total":53552873472,"available":53551820800,"internally_reserved":0,"allocated":1052672,"data_stored":1052672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640263,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":336,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297392,"statfs":{"total":53552873472,"available":53552529408,"internally_reserved":0,"allocated":344064,"data_stored":344064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640263,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1024,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296704,"statfs":{"total":53552873472,"available":53551824896,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53552873472,"available":53551820800,"internally_reserved":0,"allocated":1052672,"data_stored":1052672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53551820800,"internally_reserved":0,"allocated":1052672,"data_stored":1052672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53552599040,"internally_reserved":0,"allocated":274432,"data_stored":274432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53552529408,"internally_reserved":0,"allocated":344064,"data_stored":344064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-26T03:15:55.106 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-26T03:15:55.107 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-26T03:15:55.107 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-26T03:15:55.107 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T03:15:55.180 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:55.175+0000 7f8f1c70b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:55.182 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:55.178+0000 7f8f1c70b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:55.320 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:15:55.321 INFO:teuthology.orchestra.run.trial086.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-26T03:15:55.331 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-26T03:15:55.331 INFO:teuthology.run_tasks:Running task ceph_objectstore_tool... 2026-02-26T03:15:55.360 INFO:tasks.ceph_objectstore_tool:crimson_objectstore_tool is True... 2026-02-26T03:15:55.360 DEBUG:tasks.ceph_objectstore_tool:{'crimson_objectstore_tool': True, 'objects': 5, 'pgnum': 8} 2026-02-26T03:15:55.360 DEBUG:tasks.ceph_objectstore_tool:{'help': False, 'version': False, 'interactive_on_error': False, 'suite_path': None, 'archive': '/home/teuthworker/mnt/teuthology/shraddhaag-2026-02-26_02:22:56-crimson-rados-main-distro-debug-trial/71141', 'owner': 'scheduled_shraddhaag@soko04.front.sepia.ceph.com', 'name': 'shraddhaag-2026-02-26_02:22:56-crimson-rados-main-distro-debug-trial', 'lock': False, 'block': False, 'os_type': None, 'machine_type': 'trial', 'verbose': True, 'os_version': None, 'description': 'crimson-rados/objectstore_tool/{0-crimson_install clusters/fixed-1-num-threads-3 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/seastore-segmented tasks/crimson_obejctstore_tool}', '': True, 'config': {'archive_path': '/home/teuthworker/mnt/teuthology/shraddhaag-2026-02-26_02:22:56-crimson-rados-main-distro-debug-trial/71141', 'branch': 'main', 'description': 'crimson-rados/objectstore_tool/{0-crimson_install clusters/fixed-1-num-threads-3 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/seastore-segmented tasks/crimson_obejctstore_tool}', 'email': None, 'first_in_suite': False, 'flavor': 'debug', 'job_id': '71141', 'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'shraddhaag-2026-02-26_02:22:56-crimson-rados-main-distro-debug-trial', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'crimson cpu num': 3, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'seastore cachepin size pershard': '64M', 'seastore max concurrent transactions': 8}}, 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(OBJECT_', 'for optimal performance'], 'sha1': 'abffb617683951511fccf3c3cab6e219f2ec83a8'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'debug', 'sha1': 'abffb617683951511fccf3c3cab6e219f2ec83a8'}}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '1f87b69b1a8041112e26ae0ea3c0a2a0fd14d996'}}, 'owner': 'scheduled_shraddhaag@soko04.front.sepia.ceph.com', 'priority': 101, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']], 'seed': 5117, 'sha1': 'abffb617683951511fccf3c3cab6e219f2ec83a8', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_1f87b69b1a8041112e26ae0ea3c0a2a0fd14d996/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph.git', 'suite_sha1': '1f87b69b1a8041112e26ae0ea3c0a2a0fd14d996', 'targets': {'trial086.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFzLQ+FYcHHEfCmaFhBrcEvCWXKjPerr+rd8rp1wgifljnpypm/n2+T+h+1Aeefjd2NuqoyVbafkuf7cx2HK3d0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'flavor': 'debug', 'sha1': 'abffb617683951511fccf3c3cab6e219f2ec83a8'}}, {'pexec': {'all': ['sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson']}}, {'install': None}, {'ceph': {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson cpu num': 3, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'seastore cachepin size pershard': '64M', 'seastore max concurrent transactions': 8}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}}, 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(OBJECT_', 'for optimal performance'], 'sha1': 'abffb617683951511fccf3c3cab6e219f2ec83a8', 'cluster': 'ceph'}}, {'ceph_objectstore_tool': {'crimson_objectstore_tool': True, 'objects': 5, 'pgnum': 8}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '6e3d0419ccca0e75a03e08feb708946e198236f4', 'timestamp': '2026-02-26_02:22:56', 'tube': 'trial', 'user': 'shraddhaag', 'verbose': False, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.904699'}, 'summary': {'success': True, 'owner': 'scheduled_shraddhaag@soko04.front.sepia.ceph.com', 'description': 'crimson-rados/objectstore_tool/{0-crimson_install clusters/fixed-1-num-threads-3 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/seastore-segmented tasks/crimson_obejctstore_tool}', 'flavor': 'debug'}, 'cluster': Cluster(remotes=[[Remote(name='ubuntu@trial086.front.sepia.ceph.com'), ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']]]), 'do_ship_utilities': False, 'daemons': , 'ceph': {'ceph': Namespace(conf=ConfigObj({'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.86', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'fsid': 'a3320112-ec0c-4bb6-bf8e-5331f894afbc'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': 'true', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'crimson cpu num': 3, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'seastore cachepin size pershard': '64M', 'seastore max concurrent transactions': 8}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'osd pool default crimson': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}}), mons={'mon.a': '10.20.193.86'}, fsid='a3320112-ec0c-4bb6-bf8e-5331f894afbc', thrashers=[], watched_processes=[], watchdog=)}, 'disk_config': Namespace(remote_to_roles_to_dev={Remote(name='ubuntu@trial086.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}}, remote_to_roles_to_dev_mount_options={Remote(name='ubuntu@trial086.front.sepia.ceph.com'): {'osd.0': ['noatime'], 'osd.1': ['noatime'], 'osd.2': ['noatime'], 'osd.3': ['noatime']}}, remote_to_roles_to_dev_fstype={Remote(name='ubuntu@trial086.front.sepia.ceph.com'): {'osd.0': 'xfs', 'osd.1': 'xfs', 'osd.2': 'xfs', 'osd.3': 'xfs'}}), 'managers': {'ceph': }, 'conf_epoch': 1} 2026-02-26T03:15:55.362 DEBUG:tasks.ceph_objectstore_tool:ubuntu@trial086.front.sepia.ceph.com 2026-02-26T03:15:55.362 INFO:tasks.ceph_objectstore_tool:OSDS 2026-02-26T03:15:55.362 INFO:tasks.ceph_objectstore_tool:ubuntu@trial086.front.sepia.ceph.com[mon.a,mgr.x,osd.0,osd.1,osd.2,osd.3,client.0] 2026-02-26T03:15:55.362 INFO:tasks.ceph_objectstore_tool:{Remote(name='ubuntu@trial086.front.sepia.ceph.com'): ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']} 2026-02-26T03:15:55.363 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2026-02-26T03:15:55.438 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:55.432+0000 7f08bcf7e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:55.440 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:55.437+0000 7f08bcf7e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:55.550 INFO:teuthology.orchestra.run.trial086.stdout:epoch 17 2026-02-26T03:15:55.550 INFO:teuthology.orchestra.run.trial086.stdout:fsid a3320112-ec0c-4bb6-bf8e-5331f894afbc 2026-02-26T03:15:55.551 INFO:teuthology.orchestra.run.trial086.stdout:created 2026-02-26T03:15:31.523265+0000 2026-02-26T03:15:55.551 INFO:teuthology.orchestra.run.trial086.stdout:modified 2026-02-26T03:15:51.083432+0000 2026-02-26T03:15:55.551 INFO:teuthology.orchestra.run.trial086.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2026-02-26T03:15:55.551 INFO:teuthology.orchestra.run.trial086.stdout:crush_version 5 2026-02-26T03:15:55.551 INFO:teuthology.orchestra.run.trial086.stdout:full_ratio 0.95 2026-02-26T03:15:55.551 INFO:teuthology.orchestra.run.trial086.stdout:backfillfull_ratio 0.9 2026-02-26T03:15:55.551 INFO:teuthology.orchestra.run.trial086.stdout:nearfull_ratio 0.85 2026-02-26T03:15:55.551 INFO:teuthology.orchestra.run.trial086.stdout:require_min_compat_client luminous 2026-02-26T03:15:55.551 INFO:teuthology.orchestra.run.trial086.stdout:min_compat_client jewel 2026-02-26T03:15:55.552 INFO:teuthology.orchestra.run.trial086.stdout:require_osd_release tentacle 2026-02-26T03:15:55.552 INFO:teuthology.orchestra.run.trial086.stdout:stretch_mode_enabled false 2026-02-26T03:15:55.552 INFO:teuthology.orchestra.run.trial086.stdout:allow_crimson=true 2026-02-26T03:15:55.552 INFO:teuthology.orchestra.run.trial086.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 14 flags hashpspool,crimson stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 4.00 2026-02-26T03:15:55.552 INFO:teuthology.orchestra.run.trial086.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 17 flags hashpspool,selfmanaged_snaps,crimson stripe_width 0 application rbd read_balance_score 2.50 2026-02-26T03:15:55.552 INFO:teuthology.orchestra.run.trial086.stdout: removed_snaps_queue [2~1] 2026-02-26T03:15:55.552 INFO:teuthology.orchestra.run.trial086.stdout:max_osd 4 2026-02-26T03:15:55.552 INFO:teuthology.orchestra.run.trial086.stdout:osd.0 up in weight 1 up_from 11 up_thru 0 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6809/1229323153 v2:10.20.193.86:6810/1229323153 exists,up b692f9c9-579d-4a92-b02c-beefe594ff12 2026-02-26T03:15:55.552 INFO:teuthology.orchestra.run.trial086.stdout:osd.1 up in weight 1 up_from 10 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6803/2744027137 v2:10.20.193.86:6802/2744027137 exists,up 1935ef84-dee5-4745-8c38-6435b71c819c 2026-02-26T03:15:55.552 INFO:teuthology.orchestra.run.trial086.stdout:osd.2 up in weight 1 up_from 10 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6805/3653919688 v2:10.20.193.86:6804/3653919688 exists,up bf958cf8-549c-42c6-9510-269812a65fb6 2026-02-26T03:15:55.553 INFO:teuthology.orchestra.run.trial086.stdout:osd.3 up in weight 1 up_from 11 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6806/2128187350 v2:10.20.193.86:6807/2128187350 exists,up cf449d79-9ec0-4e20-a163-3ce8ac17c2cb 2026-02-26T03:15:55.559 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 11 up_thru 0 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6809/1229323153 v2:10.20.193.86:6810/1229323153 exists,up b692f9c9-579d-4a92-b02c-beefe594ff12', 'osd.1 up in weight 1 up_from 10 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6803/2744027137 v2:10.20.193.86:6802/2744027137 exists,up 1935ef84-dee5-4745-8c38-6435b71c819c', 'osd.2 up in weight 1 up_from 10 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6805/3653919688 v2:10.20.193.86:6804/3653919688 exists,up bf958cf8-549c-42c6-9510-269812a65fb6', 'osd.3 up in weight 1 up_from 11 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6806/2128187350 v2:10.20.193.86:6807/2128187350 exists,up cf449d79-9ec0-4e20-a163-3ce8ac17c2cb'] 2026-02-26T03:15:55.560 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2026-02-26T03:15:55.634 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:55.629+0000 7facc9d74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:55.637 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:55.633+0000 7facc9d74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:55.748 INFO:teuthology.orchestra.run.trial086.stdout:epoch 17 2026-02-26T03:15:55.748 INFO:teuthology.orchestra.run.trial086.stdout:fsid a3320112-ec0c-4bb6-bf8e-5331f894afbc 2026-02-26T03:15:55.748 INFO:teuthology.orchestra.run.trial086.stdout:created 2026-02-26T03:15:31.523265+0000 2026-02-26T03:15:55.748 INFO:teuthology.orchestra.run.trial086.stdout:modified 2026-02-26T03:15:51.083432+0000 2026-02-26T03:15:55.748 INFO:teuthology.orchestra.run.trial086.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2026-02-26T03:15:55.748 INFO:teuthology.orchestra.run.trial086.stdout:crush_version 5 2026-02-26T03:15:55.748 INFO:teuthology.orchestra.run.trial086.stdout:full_ratio 0.95 2026-02-26T03:15:55.748 INFO:teuthology.orchestra.run.trial086.stdout:backfillfull_ratio 0.9 2026-02-26T03:15:55.748 INFO:teuthology.orchestra.run.trial086.stdout:nearfull_ratio 0.85 2026-02-26T03:15:55.748 INFO:teuthology.orchestra.run.trial086.stdout:require_min_compat_client luminous 2026-02-26T03:15:55.748 INFO:teuthology.orchestra.run.trial086.stdout:min_compat_client jewel 2026-02-26T03:15:55.748 INFO:teuthology.orchestra.run.trial086.stdout:require_osd_release tentacle 2026-02-26T03:15:55.748 INFO:teuthology.orchestra.run.trial086.stdout:stretch_mode_enabled false 2026-02-26T03:15:55.748 INFO:teuthology.orchestra.run.trial086.stdout:allow_crimson=true 2026-02-26T03:15:55.748 INFO:teuthology.orchestra.run.trial086.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 14 flags hashpspool,crimson stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 4.00 2026-02-26T03:15:55.748 INFO:teuthology.orchestra.run.trial086.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 17 flags hashpspool,selfmanaged_snaps,crimson stripe_width 0 application rbd read_balance_score 2.50 2026-02-26T03:15:55.748 INFO:teuthology.orchestra.run.trial086.stdout: removed_snaps_queue [2~1] 2026-02-26T03:15:55.748 INFO:teuthology.orchestra.run.trial086.stdout:max_osd 4 2026-02-26T03:15:55.748 INFO:teuthology.orchestra.run.trial086.stdout:osd.0 up in weight 1 up_from 11 up_thru 0 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6809/1229323153 v2:10.20.193.86:6810/1229323153 exists,up b692f9c9-579d-4a92-b02c-beefe594ff12 2026-02-26T03:15:55.748 INFO:teuthology.orchestra.run.trial086.stdout:osd.1 up in weight 1 up_from 10 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6803/2744027137 v2:10.20.193.86:6802/2744027137 exists,up 1935ef84-dee5-4745-8c38-6435b71c819c 2026-02-26T03:15:55.748 INFO:teuthology.orchestra.run.trial086.stdout:osd.2 up in weight 1 up_from 10 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6805/3653919688 v2:10.20.193.86:6804/3653919688 exists,up bf958cf8-549c-42c6-9510-269812a65fb6 2026-02-26T03:15:55.748 INFO:teuthology.orchestra.run.trial086.stdout:osd.3 up in weight 1 up_from 11 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6806/2128187350 v2:10.20.193.86:6807/2128187350 exists,up cf449d79-9ec0-4e20-a163-3ce8ac17c2cb 2026-02-26T03:15:55.758 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 11 up_thru 0 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6809/1229323153 v2:10.20.193.86:6810/1229323153 exists,up b692f9c9-579d-4a92-b02c-beefe594ff12', 'osd.1 up in weight 1 up_from 10 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6803/2744027137 v2:10.20.193.86:6802/2744027137 exists,up 1935ef84-dee5-4745-8c38-6435b71c819c', 'osd.2 up in weight 1 up_from 10 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6805/3653919688 v2:10.20.193.86:6804/3653919688 exists,up bf958cf8-549c-42c6-9510-269812a65fb6', 'osd.3 up in weight 1 up_from 11 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6806/2128187350 v2:10.20.193.86:6807/2128187350 exists,up cf449d79-9ec0-4e20-a163-3ce8ac17c2cb'] 2026-02-26T03:15:55.759 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2026-02-26T03:15:55.833 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:55.828+0000 7fb746d0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:55.835 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:55.832+0000 7fb746d0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:55.946 INFO:teuthology.orchestra.run.trial086.stdout:epoch 17 2026-02-26T03:15:55.946 INFO:teuthology.orchestra.run.trial086.stdout:fsid a3320112-ec0c-4bb6-bf8e-5331f894afbc 2026-02-26T03:15:55.946 INFO:teuthology.orchestra.run.trial086.stdout:created 2026-02-26T03:15:31.523265+0000 2026-02-26T03:15:55.946 INFO:teuthology.orchestra.run.trial086.stdout:modified 2026-02-26T03:15:51.083432+0000 2026-02-26T03:15:55.947 INFO:teuthology.orchestra.run.trial086.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2026-02-26T03:15:55.947 INFO:teuthology.orchestra.run.trial086.stdout:crush_version 5 2026-02-26T03:15:55.947 INFO:teuthology.orchestra.run.trial086.stdout:full_ratio 0.95 2026-02-26T03:15:55.947 INFO:teuthology.orchestra.run.trial086.stdout:backfillfull_ratio 0.9 2026-02-26T03:15:55.947 INFO:teuthology.orchestra.run.trial086.stdout:nearfull_ratio 0.85 2026-02-26T03:15:55.947 INFO:teuthology.orchestra.run.trial086.stdout:require_min_compat_client luminous 2026-02-26T03:15:55.947 INFO:teuthology.orchestra.run.trial086.stdout:min_compat_client jewel 2026-02-26T03:15:55.947 INFO:teuthology.orchestra.run.trial086.stdout:require_osd_release tentacle 2026-02-26T03:15:55.947 INFO:teuthology.orchestra.run.trial086.stdout:stretch_mode_enabled false 2026-02-26T03:15:55.947 INFO:teuthology.orchestra.run.trial086.stdout:allow_crimson=true 2026-02-26T03:15:55.947 INFO:teuthology.orchestra.run.trial086.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 14 flags hashpspool,crimson stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 4.00 2026-02-26T03:15:55.948 INFO:teuthology.orchestra.run.trial086.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 17 flags hashpspool,selfmanaged_snaps,crimson stripe_width 0 application rbd read_balance_score 2.50 2026-02-26T03:15:55.948 INFO:teuthology.orchestra.run.trial086.stdout: removed_snaps_queue [2~1] 2026-02-26T03:15:55.948 INFO:teuthology.orchestra.run.trial086.stdout:max_osd 4 2026-02-26T03:15:55.948 INFO:teuthology.orchestra.run.trial086.stdout:osd.0 up in weight 1 up_from 11 up_thru 0 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6809/1229323153 v2:10.20.193.86:6810/1229323153 exists,up b692f9c9-579d-4a92-b02c-beefe594ff12 2026-02-26T03:15:55.948 INFO:teuthology.orchestra.run.trial086.stdout:osd.1 up in weight 1 up_from 10 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6803/2744027137 v2:10.20.193.86:6802/2744027137 exists,up 1935ef84-dee5-4745-8c38-6435b71c819c 2026-02-26T03:15:55.948 INFO:teuthology.orchestra.run.trial086.stdout:osd.2 up in weight 1 up_from 10 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6805/3653919688 v2:10.20.193.86:6804/3653919688 exists,up bf958cf8-549c-42c6-9510-269812a65fb6 2026-02-26T03:15:55.948 INFO:teuthology.orchestra.run.trial086.stdout:osd.3 up in weight 1 up_from 11 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6806/2128187350 v2:10.20.193.86:6807/2128187350 exists,up cf449d79-9ec0-4e20-a163-3ce8ac17c2cb 2026-02-26T03:15:55.956 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 11 up_thru 0 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6809/1229323153 v2:10.20.193.86:6810/1229323153 exists,up b692f9c9-579d-4a92-b02c-beefe594ff12', 'osd.1 up in weight 1 up_from 10 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6803/2744027137 v2:10.20.193.86:6802/2744027137 exists,up 1935ef84-dee5-4745-8c38-6435b71c819c', 'osd.2 up in weight 1 up_from 10 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6805/3653919688 v2:10.20.193.86:6804/3653919688 exists,up bf958cf8-549c-42c6-9510-269812a65fb6', 'osd.3 up in weight 1 up_from 11 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6806/2128187350 v2:10.20.193.86:6807/2128187350 exists,up cf449d79-9ec0-4e20-a163-3ce8ac17c2cb'] 2026-02-26T03:15:55.956 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2026-02-26T03:15:56.032 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:56.026+0000 7f2b219f5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:56.034 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:56.031+0000 7f2b219f5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:56.149 INFO:teuthology.orchestra.run.trial086.stdout:epoch 17 2026-02-26T03:15:56.149 INFO:teuthology.orchestra.run.trial086.stdout:fsid a3320112-ec0c-4bb6-bf8e-5331f894afbc 2026-02-26T03:15:56.149 INFO:teuthology.orchestra.run.trial086.stdout:created 2026-02-26T03:15:31.523265+0000 2026-02-26T03:15:56.149 INFO:teuthology.orchestra.run.trial086.stdout:modified 2026-02-26T03:15:51.083432+0000 2026-02-26T03:15:56.149 INFO:teuthology.orchestra.run.trial086.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2026-02-26T03:15:56.149 INFO:teuthology.orchestra.run.trial086.stdout:crush_version 5 2026-02-26T03:15:56.149 INFO:teuthology.orchestra.run.trial086.stdout:full_ratio 0.95 2026-02-26T03:15:56.149 INFO:teuthology.orchestra.run.trial086.stdout:backfillfull_ratio 0.9 2026-02-26T03:15:56.149 INFO:teuthology.orchestra.run.trial086.stdout:nearfull_ratio 0.85 2026-02-26T03:15:56.149 INFO:teuthology.orchestra.run.trial086.stdout:require_min_compat_client luminous 2026-02-26T03:15:56.149 INFO:teuthology.orchestra.run.trial086.stdout:min_compat_client jewel 2026-02-26T03:15:56.149 INFO:teuthology.orchestra.run.trial086.stdout:require_osd_release tentacle 2026-02-26T03:15:56.149 INFO:teuthology.orchestra.run.trial086.stdout:stretch_mode_enabled false 2026-02-26T03:15:56.149 INFO:teuthology.orchestra.run.trial086.stdout:allow_crimson=true 2026-02-26T03:15:56.149 INFO:teuthology.orchestra.run.trial086.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 14 flags hashpspool,crimson stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 4.00 2026-02-26T03:15:56.149 INFO:teuthology.orchestra.run.trial086.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 17 flags hashpspool,selfmanaged_snaps,crimson stripe_width 0 application rbd read_balance_score 2.50 2026-02-26T03:15:56.149 INFO:teuthology.orchestra.run.trial086.stdout: removed_snaps_queue [2~1] 2026-02-26T03:15:56.150 INFO:teuthology.orchestra.run.trial086.stdout:max_osd 4 2026-02-26T03:15:56.150 INFO:teuthology.orchestra.run.trial086.stdout:osd.0 up in weight 1 up_from 11 up_thru 0 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6809/1229323153 v2:10.20.193.86:6810/1229323153 exists,up b692f9c9-579d-4a92-b02c-beefe594ff12 2026-02-26T03:15:56.150 INFO:teuthology.orchestra.run.trial086.stdout:osd.1 up in weight 1 up_from 10 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6803/2744027137 v2:10.20.193.86:6802/2744027137 exists,up 1935ef84-dee5-4745-8c38-6435b71c819c 2026-02-26T03:15:56.150 INFO:teuthology.orchestra.run.trial086.stdout:osd.2 up in weight 1 up_from 10 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6805/3653919688 v2:10.20.193.86:6804/3653919688 exists,up bf958cf8-549c-42c6-9510-269812a65fb6 2026-02-26T03:15:56.150 INFO:teuthology.orchestra.run.trial086.stdout:osd.3 up in weight 1 up_from 11 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6806/2128187350 v2:10.20.193.86:6807/2128187350 exists,up cf449d79-9ec0-4e20-a163-3ce8ac17c2cb 2026-02-26T03:15:56.159 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 11 up_thru 0 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6809/1229323153 v2:10.20.193.86:6810/1229323153 exists,up b692f9c9-579d-4a92-b02c-beefe594ff12', 'osd.1 up in weight 1 up_from 10 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6803/2744027137 v2:10.20.193.86:6802/2744027137 exists,up 1935ef84-dee5-4745-8c38-6435b71c819c', 'osd.2 up in weight 1 up_from 10 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6805/3653919688 v2:10.20.193.86:6804/3653919688 exists,up bf958cf8-549c-42c6-9510-269812a65fb6', 'osd.3 up in weight 1 up_from 11 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6806/2128187350 v2:10.20.193.86:6807/2128187350 exists,up cf449d79-9ec0-4e20-a163-3ce8ac17c2cb'] 2026-02-26T03:15:56.159 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noout 2026-02-26T03:15:56.236 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:56.229+0000 7f53579dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:56.238 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:56.234+0000 7f53579dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:57.103 INFO:teuthology.orchestra.run.trial086.stderr:noout is set 2026-02-26T03:15:57.119 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodown 2026-02-26T03:15:57.194 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:57.188+0000 7f86017b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:57.197 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:57.194+0000 7f86017b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:58.104 INFO:teuthology.orchestra.run.trial086.stderr:nodown is set 2026-02-26T03:15:58.119 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config show 2026-02-26T03:15:58.198 INFO:teuthology.orchestra.run.trial086.stdout:{ 2026-02-26T03:15:58.198 INFO:teuthology.orchestra.run.trial086.stdout: "name": "osd.0", 2026-02-26T03:15:58.198 INFO:teuthology.orchestra.run.trial086.stdout: "cluster": "ceph", 2026-02-26T03:15:58.198 INFO:teuthology.orchestra.run.trial086.stdout: "admin_socket": "/var/run/ceph/ceph-osd.0.asok", 2026-02-26T03:15:58.199 INFO:teuthology.orchestra.run.trial086.stdout: "admin_socket_mode": "", 2026-02-26T03:15:58.199 INFO:teuthology.orchestra.run.trial086.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2026-02-26T03:15:58.199 INFO:teuthology.orchestra.run.trial086.stdout: "auth_client_required": "cephx, none", 2026-02-26T03:15:58.199 INFO:teuthology.orchestra.run.trial086.stdout: "auth_cluster_required": "cephx", 2026-02-26T03:15:58.199 INFO:teuthology.orchestra.run.trial086.stdout: "auth_debug": "true", 2026-02-26T03:15:58.199 INFO:teuthology.orchestra.run.trial086.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2026-02-26T03:15:58.199 INFO:teuthology.orchestra.run.trial086.stdout: "auth_mon_ticket_ttl": "259200.000000", 2026-02-26T03:15:58.199 INFO:teuthology.orchestra.run.trial086.stdout: "auth_service_required": "cephx", 2026-02-26T03:15:58.199 INFO:teuthology.orchestra.run.trial086.stdout: "auth_service_ticket_ttl": "3600.000000", 2026-02-26T03:15:58.199 INFO:teuthology.orchestra.run.trial086.stdout: "auth_supported": "cephx", 2026-02-26T03:15:58.199 INFO:teuthology.orchestra.run.trial086.stdout: "bdev_aio": "true", 2026-02-26T03:15:58.200 INFO:teuthology.orchestra.run.trial086.stdout: "bdev_aio_max_queue_depth": "1024", 2026-02-26T03:15:58.200 INFO:teuthology.orchestra.run.trial086.stdout: "bdev_aio_poll_ms": "250", 2026-02-26T03:15:58.200 INFO:teuthology.orchestra.run.trial086.stdout: "bdev_aio_reap_max": "16", 2026-02-26T03:15:58.200 INFO:teuthology.orchestra.run.trial086.stdout: "bdev_aio_submit_retry_initial_delay_us": "125", 2026-02-26T03:15:58.200 INFO:teuthology.orchestra.run.trial086.stdout: "bdev_aio_submit_retry_max": "16", 2026-02-26T03:15:58.200 INFO:teuthology.orchestra.run.trial086.stdout: "bdev_async_discard": "false", 2026-02-26T03:15:58.200 INFO:teuthology.orchestra.run.trial086.stdout: "bdev_async_discard_max_pending": "1000000", 2026-02-26T03:15:58.200 INFO:teuthology.orchestra.run.trial086.stdout: "bdev_async_discard_threads": "0", 2026-02-26T03:15:58.200 INFO:teuthology.orchestra.run.trial086.stdout: "bdev_block_size": "4096", 2026-02-26T03:15:58.200 INFO:teuthology.orchestra.run.trial086.stdout: "bdev_debug_aio": "true", 2026-02-26T03:15:58.200 INFO:teuthology.orchestra.run.trial086.stdout: "bdev_debug_aio_log_age": "5.000000", 2026-02-26T03:15:58.200 INFO:teuthology.orchestra.run.trial086.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2026-02-26T03:15:58.201 INFO:teuthology.orchestra.run.trial086.stdout: "bdev_debug_discard_sleep": "0", 2026-02-26T03:15:58.201 INFO:teuthology.orchestra.run.trial086.stdout: "bdev_debug_inflight_ios": "false", 2026-02-26T03:15:58.201 INFO:teuthology.orchestra.run.trial086.stdout: "bdev_discard_max_bytes": "10737418240", 2026-02-26T03:15:58.201 INFO:teuthology.orchestra.run.trial086.stdout: "bdev_enable_discard": "false", 2026-02-26T03:15:58.201 INFO:teuthology.orchestra.run.trial086.stdout: "bdev_flock_retry": "3", 2026-02-26T03:15:58.201 INFO:teuthology.orchestra.run.trial086.stdout: "bdev_flock_retry_interval": "0.100000", 2026-02-26T03:15:58.201 INFO:teuthology.orchestra.run.trial086.stdout: "bdev_inject_crash": "0", 2026-02-26T03:15:58.201 INFO:teuthology.orchestra.run.trial086.stdout: "bdev_inject_crash_flush_delay": "2", 2026-02-26T03:15:58.201 INFO:teuthology.orchestra.run.trial086.stdout: "bdev_ioring": "false", 2026-02-26T03:15:58.201 INFO:teuthology.orchestra.run.trial086.stdout: "bdev_ioring_hipri": "false", 2026-02-26T03:15:58.201 INFO:teuthology.orchestra.run.trial086.stdout: "bdev_ioring_sqthread_poll": "false", 2026-02-26T03:15:58.201 INFO:teuthology.orchestra.run.trial086.stdout: "bdev_max_discard_length": "2147483648", 2026-02-26T03:15:58.202 INFO:teuthology.orchestra.run.trial086.stdout: "bdev_nvme_unbind_from_kernel": "false", 2026-02-26T03:15:58.202 INFO:teuthology.orchestra.run.trial086.stdout: "bdev_read_buffer_alignment": "4096", 2026-02-26T03:15:58.202 INFO:teuthology.orchestra.run.trial086.stdout: "bdev_read_preallocated_huge_buffers": "", 2026-02-26T03:15:58.202 INFO:teuthology.orchestra.run.trial086.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2026-02-26T03:15:58.202 INFO:teuthology.orchestra.run.trial086.stdout: "bdev_stalled_read_warn_threshold": "1", 2026-02-26T03:15:58.202 INFO:teuthology.orchestra.run.trial086.stdout: "bdev_type": "", 2026-02-26T03:15:58.202 INFO:teuthology.orchestra.run.trial086.stdout: "bluefs_alloc_size": "1048576", 2026-02-26T03:15:58.202 INFO:teuthology.orchestra.run.trial086.stdout: "bluefs_allocator": "hybrid", 2026-02-26T03:15:58.202 INFO:teuthology.orchestra.run.trial086.stdout: "bluefs_buffered_io": "true", 2026-02-26T03:15:58.202 INFO:teuthology.orchestra.run.trial086.stdout: "bluefs_check_for_zeros": "false", 2026-02-26T03:15:58.202 INFO:teuthology.orchestra.run.trial086.stdout: "bluefs_check_volume_selector_often": "false", 2026-02-26T03:15:58.202 INFO:teuthology.orchestra.run.trial086.stdout: "bluefs_check_volume_selector_on_umount": "false", 2026-02-26T03:15:58.203 INFO:teuthology.orchestra.run.trial086.stdout: "bluefs_compact_log_sync": "false", 2026-02-26T03:15:58.203 INFO:teuthology.orchestra.run.trial086.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2026-02-26T03:15:58.203 INFO:teuthology.orchestra.run.trial086.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2026-02-26T03:15:58.203 INFO:teuthology.orchestra.run.trial086.stdout: "bluefs_log_compact_min_size": "16777216", 2026-02-26T03:15:58.203 INFO:teuthology.orchestra.run.trial086.stdout: "bluefs_log_replay_check_allocations": "true", 2026-02-26T03:15:58.203 INFO:teuthology.orchestra.run.trial086.stdout: "bluefs_max_log_runway": "4194304", 2026-02-26T03:15:58.203 INFO:teuthology.orchestra.run.trial086.stdout: "bluefs_max_prefetch": "1048576", 2026-02-26T03:15:58.203 INFO:teuthology.orchestra.run.trial086.stdout: "bluefs_min_flush_size": "524288", 2026-02-26T03:15:58.203 INFO:teuthology.orchestra.run.trial086.stdout: "bluefs_min_log_runway": "1048576", 2026-02-26T03:15:58.203 INFO:teuthology.orchestra.run.trial086.stdout: "bluefs_replay_recovery": "false", 2026-02-26T03:15:58.204 INFO:teuthology.orchestra.run.trial086.stdout: "bluefs_replay_recovery_disable_compact": "false", 2026-02-26T03:15:58.204 INFO:teuthology.orchestra.run.trial086.stdout: "bluefs_shared_alloc_size": "65536", 2026-02-26T03:15:58.204 INFO:teuthology.orchestra.run.trial086.stdout: "bluefs_sync_write": "false", 2026-02-26T03:15:58.204 INFO:teuthology.orchestra.run.trial086.stdout: "bluefs_wal_envelope_mode": "true", 2026-02-26T03:15:58.204 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2026-02-26T03:15:58.204 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2026-02-26T03:15:58.204 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2026-02-26T03:15:58.204 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_allocation_from_file": "true", 2026-02-26T03:15:58.204 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_allocator": "hybrid", 2026-02-26T03:15:58.204 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_allocator_lookup_policy": "auto", 2026-02-26T03:15:58.204 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_async_db_compaction": "true", 2026-02-26T03:15:58.204 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2026-02-26T03:15:58.205 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2026-02-26T03:15:58.205 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2026-02-26T03:15:58.205 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2026-02-26T03:15:58.205 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_bdev_label_multi": "true", 2026-02-26T03:15:58.205 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2026-02-26T03:15:58.205 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_bdev_label_require_all": "true", 2026-02-26T03:15:58.205 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2026-02-26T03:15:58.205 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_bitmapallocator_span_size": "1024", 2026-02-26T03:15:58.205 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_blobid_prealloc": "10240", 2026-02-26T03:15:58.205 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_block_create": "true", 2026-02-26T03:15:58.205 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_block_db_create": "false", 2026-02-26T03:15:58.206 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_block_db_path": "", 2026-02-26T03:15:58.206 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_block_db_size": "0", 2026-02-26T03:15:58.206 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_block_path": "", 2026-02-26T03:15:58.206 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_block_preallocate_file": "false", 2026-02-26T03:15:58.206 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_block_size": "107374182400", 2026-02-26T03:15:58.206 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_block_wal_create": "false", 2026-02-26T03:15:58.206 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_block_wal_path": "", 2026-02-26T03:15:58.206 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_block_wal_size": "100663296", 2026-02-26T03:15:58.206 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_bluefs": "true", 2026-02-26T03:15:58.206 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2026-02-26T03:15:58.206 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_bluefs_env_mirror": "false", 2026-02-26T03:15:58.206 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_bluefs_max_free": "10737418240", 2026-02-26T03:15:58.206 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_btree2_alloc_weight_factor": "2.000000", 2026-02-26T03:15:58.207 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2026-02-26T03:15:58.207 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2026-02-26T03:15:58.207 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2026-02-26T03:15:58.207 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2026-02-26T03:15:58.207 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2026-02-26T03:15:58.207 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_cache_autotune": "true", 2026-02-26T03:15:58.207 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_cache_autotune_interval": "5.000000", 2026-02-26T03:15:58.207 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2026-02-26T03:15:58.207 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_cache_kv_ratio": "0.450000", 2026-02-26T03:15:58.207 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_cache_meta_ratio": "0.450000", 2026-02-26T03:15:58.207 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_cache_size": "0", 2026-02-26T03:15:58.207 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_cache_size_hdd": "1073741824", 2026-02-26T03:15:58.207 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_cache_size_ssd": "3221225472", 2026-02-26T03:15:58.208 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_cache_trim_interval": "0.050000", 2026-02-26T03:15:58.208 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2026-02-26T03:15:58.208 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_cache_type": "2q", 2026-02-26T03:15:58.208 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2026-02-26T03:15:58.208 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_clone_cow": "true", 2026-02-26T03:15:58.208 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_compression_algorithm": "snappy", 2026-02-26T03:15:58.208 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_compression_max_blob_size": "0", 2026-02-26T03:15:58.208 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2026-02-26T03:15:58.208 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2026-02-26T03:15:58.208 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_compression_min_blob_size": "0", 2026-02-26T03:15:58.208 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2026-02-26T03:15:58.208 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2026-02-26T03:15:58.209 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_compression_mode": "none", 2026-02-26T03:15:58.209 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_compression_required_ratio": "0.875000", 2026-02-26T03:15:58.209 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_csum_type": "crc32c", 2026-02-26T03:15:58.209 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2026-02-26T03:15:58.209 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_debug_enforce_settings": "default", 2026-02-26T03:15:58.209 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_debug_extent_map_encode_check": "false", 2026-02-26T03:15:58.209 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_debug_freelist": "false", 2026-02-26T03:15:58.209 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_debug_fsck_abort": "false", 2026-02-26T03:15:58.209 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2026-02-26T03:15:58.209 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2026-02-26T03:15:58.209 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_debug_inject_read_err": "false", 2026-02-26T03:15:58.209 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_debug_legacy_omap": "false", 2026-02-26T03:15:58.209 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_debug_no_reuse_blocks": "false", 2026-02-26T03:15:58.209 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_debug_omit_block_device_write": "false", 2026-02-26T03:15:58.210 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_debug_omit_kv_commit": "false", 2026-02-26T03:15:58.210 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_debug_onode_segmentation_random": "false", 2026-02-26T03:15:58.210 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2026-02-26T03:15:58.210 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_debug_prefragment_max": "1048576", 2026-02-26T03:15:58.210 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_debug_random_read_err": "0.000000", 2026-02-26T03:15:58.210 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2026-02-26T03:15:58.210 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_debug_small_allocations": "0", 2026-02-26T03:15:58.210 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2026-02-26T03:15:58.210 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_default_buffered_read": "true", 2026-02-26T03:15:58.210 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_default_buffered_write": "false", 2026-02-26T03:15:58.210 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_deferred_batch_ops": "0", 2026-02-26T03:15:58.210 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2026-02-26T03:15:58.210 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2026-02-26T03:15:58.211 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_discard_on_mkfs": "true", 2026-02-26T03:15:58.211 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_elastic_shared_blobs": "true", 2026-02-26T03:15:58.211 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2026-02-26T03:15:58.211 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_extent_map_shard_max_size": "1200", 2026-02-26T03:15:58.211 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_extent_map_shard_min_size": "150", 2026-02-26T03:15:58.211 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_extent_map_shard_target_size": "500", 2026-02-26T03:15:58.211 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2026-02-26T03:15:58.211 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_fail_eio": "false", 2026-02-26T03:15:58.211 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_fragmentation_check_period": "3600", 2026-02-26T03:15:58.211 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_freelist_blocks_per_key": "128", 2026-02-26T03:15:58.211 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2026-02-26T03:15:58.211 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2026-02-26T03:15:58.211 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2026-02-26T03:15:58.212 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_fsck_on_mkfs": "true", 2026-02-26T03:15:58.212 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2026-02-26T03:15:58.212 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_fsck_on_mount": "false", 2026-02-26T03:15:58.212 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_fsck_on_mount_deep": "false", 2026-02-26T03:15:58.212 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_fsck_on_umount": "false", 2026-02-26T03:15:58.212 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_fsck_on_umount_deep": "false", 2026-02-26T03:15:58.212 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2026-02-26T03:15:58.212 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_fsck_quick_fix_threads": "2", 2026-02-26T03:15:58.212 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2026-02-26T03:15:58.212 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2026-02-26T03:15:58.212 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_gc_enable_blob_threshold": "0", 2026-02-26T03:15:58.212 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_gc_enable_total_threshold": "0", 2026-02-26T03:15:58.212 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2026-02-26T03:15:58.213 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_ignore_data_csum": "false", 2026-02-26T03:15:58.213 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2026-02-26T03:15:58.213 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_kvbackend": "rocksdb", 2026-02-26T03:15:58.213 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_log_collection_list_age": "60.000000", 2026-02-26T03:15:58.213 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2026-02-26T03:15:58.213 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_log_op_age": "5.000000", 2026-02-26T03:15:58.213 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_max_alloc_size": "0", 2026-02-26T03:15:58.213 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_max_blob_size": "0", 2026-02-26T03:15:58.213 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_max_blob_size_hdd": "65536", 2026-02-26T03:15:58.214 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_max_blob_size_ssd": "65536", 2026-02-26T03:15:58.214 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_max_defer_interval": "3.000000", 2026-02-26T03:15:58.214 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_max_deferred_txc": "32", 2026-02-26T03:15:58.214 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_min_alloc_size": "0", 2026-02-26T03:15:58.214 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_min_alloc_size_hdd": "4096", 2026-02-26T03:15:58.214 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_min_alloc_size_ssd": "4096", 2026-02-26T03:15:58.214 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_nid_prealloc": "1024", 2026-02-26T03:15:58.214 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_onode_segment_size": "0", 2026-02-26T03:15:58.214 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_prefer_deferred_size": "0", 2026-02-26T03:15:58.214 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2026-02-26T03:15:58.214 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2026-02-26T03:15:58.214 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_qfsck_on_mount": "true", 2026-02-26T03:15:58.214 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_recompression_min_gain": "1.200000", 2026-02-26T03:15:58.215 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_retry_disk_reads": "3", 2026-02-26T03:15:58.215 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_rocksdb_cf": "true", 2026-02-26T03:15:58.215 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-26T03:15:58.215 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2026-02-26T03:15:58.215 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_rocksdb_options_annex": "", 2026-02-26T03:15:58.215 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2026-02-26T03:15:58.215 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_slow_ops_warn_threshold": "1", 2026-02-26T03:15:58.215 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_spdk_coremask": "0x1", 2026-02-26T03:15:58.215 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_spdk_io_sleep": "5", 2026-02-26T03:15:58.215 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_spdk_max_io_completion": "0", 2026-02-26T03:15:58.215 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_spdk_mem": "512", 2026-02-26T03:15:58.215 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_sync_submit_transaction": "false", 2026-02-26T03:15:58.216 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_throttle_bytes": "67108864", 2026-02-26T03:15:58.216 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_throttle_cost_per_io": "0", 2026-02-26T03:15:58.216 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2026-02-26T03:15:58.216 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2026-02-26T03:15:58.216 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2026-02-26T03:15:58.216 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_throttle_trace_rate": "0.000000", 2026-02-26T03:15:58.216 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_tracing": "false", 2026-02-26T03:15:58.216 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2026-02-26T03:15:58.216 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2026-02-26T03:15:58.216 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_volume_selection_reserved": "0", 2026-02-26T03:15:58.216 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2026-02-26T03:15:58.216 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2026-02-26T03:15:58.216 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_warn_on_free_fragmentation": "0.800000", 2026-02-26T03:15:58.217 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_warn_on_legacy_statfs": "true", 2026-02-26T03:15:58.217 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2026-02-26T03:15:58.217 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2026-02-26T03:15:58.217 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2026-02-26T03:15:58.217 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_write_v2": "false", 2026-02-26T03:15:58.217 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_write_v2_random": "false", 2026-02-26T03:15:58.217 INFO:teuthology.orchestra.run.trial086.stdout: "bluestore_zero_block_detection": "false", 2026-02-26T03:15:58.217 INFO:teuthology.orchestra.run.trial086.stdout: "breakpad": "false", 2026-02-26T03:15:58.217 INFO:teuthology.orchestra.run.trial086.stdout: "ceph_assert_supresssions": "", 2026-02-26T03:15:58.217 INFO:teuthology.orchestra.run.trial086.stdout: "cephadm_path": "/usr/sbin/cephadm", 2026-02-26T03:15:58.217 INFO:teuthology.orchestra.run.trial086.stdout: "cephfs_mirror_action_update_interval": "2", 2026-02-26T03:15:58.217 INFO:teuthology.orchestra.run.trial086.stdout: "cephfs_mirror_directory_scan_interval": "10", 2026-02-26T03:15:58.218 INFO:teuthology.orchestra.run.trial086.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2026-02-26T03:15:58.218 INFO:teuthology.orchestra.run.trial086.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2026-02-26T03:15:58.218 INFO:teuthology.orchestra.run.trial086.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2026-02-26T03:15:58.218 INFO:teuthology.orchestra.run.trial086.stdout: "cephfs_mirror_mount_timeout": "10", 2026-02-26T03:15:58.218 INFO:teuthology.orchestra.run.trial086.stdout: "cephfs_mirror_perf_stats_prio": "5", 2026-02-26T03:15:58.218 INFO:teuthology.orchestra.run.trial086.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2026-02-26T03:15:58.218 INFO:teuthology.orchestra.run.trial086.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2026-02-26T03:15:58.218 INFO:teuthology.orchestra.run.trial086.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2026-02-26T03:15:58.218 INFO:teuthology.orchestra.run.trial086.stdout: "cephsqlite_blocklist_dead_locker": "true", 2026-02-26T03:15:58.218 INFO:teuthology.orchestra.run.trial086.stdout: "cephsqlite_lock_renewal_interval": "2000", 2026-02-26T03:15:58.218 INFO:teuthology.orchestra.run.trial086.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2026-02-26T03:15:58.218 INFO:teuthology.orchestra.run.trial086.stdout: "cephx_cluster_require_signatures": "false", 2026-02-26T03:15:58.219 INFO:teuthology.orchestra.run.trial086.stdout: "cephx_cluster_require_version": "2", 2026-02-26T03:15:58.219 INFO:teuthology.orchestra.run.trial086.stdout: "cephx_require_signatures": "false", 2026-02-26T03:15:58.219 INFO:teuthology.orchestra.run.trial086.stdout: "cephx_require_version": "2", 2026-02-26T03:15:58.219 INFO:teuthology.orchestra.run.trial086.stdout: "cephx_service_require_signatures": "false", 2026-02-26T03:15:58.219 INFO:teuthology.orchestra.run.trial086.stdout: "cephx_service_require_version": "2", 2026-02-26T03:15:58.219 INFO:teuthology.orchestra.run.trial086.stdout: "cephx_sign_messages": "true", 2026-02-26T03:15:58.219 INFO:teuthology.orchestra.run.trial086.stdout: "chdir": "", 2026-02-26T03:15:58.219 INFO:teuthology.orchestra.run.trial086.stdout: "client_acl_type": "", 2026-02-26T03:15:58.219 INFO:teuthology.orchestra.run.trial086.stdout: "client_asio_thread_count": "2", 2026-02-26T03:15:58.219 INFO:teuthology.orchestra.run.trial086.stdout: "client_cache_mid": "0.750000", 2026-02-26T03:15:58.219 INFO:teuthology.orchestra.run.trial086.stdout: "client_cache_size": "16384", 2026-02-26T03:15:58.219 INFO:teuthology.orchestra.run.trial086.stdout: "client_caps_release_delay": "5", 2026-02-26T03:15:58.219 INFO:teuthology.orchestra.run.trial086.stdout: "client_check_pool_perm": "true", 2026-02-26T03:15:58.219 INFO:teuthology.orchestra.run.trial086.stdout: "client_collect_and_send_global_metrics": "false", 2026-02-26T03:15:58.220 INFO:teuthology.orchestra.run.trial086.stdout: "client_debug_force_sync_read": "false", 2026-02-26T03:15:58.220 INFO:teuthology.orchestra.run.trial086.stdout: "client_debug_getattr_caps": "false", 2026-02-26T03:15:58.220 INFO:teuthology.orchestra.run.trial086.stdout: "client_debug_inject_features": "", 2026-02-26T03:15:58.220 INFO:teuthology.orchestra.run.trial086.stdout: "client_debug_inject_tick_delay": "0", 2026-02-26T03:15:58.220 INFO:teuthology.orchestra.run.trial086.stdout: "client_die_on_failed_dentry_invalidate": "true", 2026-02-26T03:15:58.220 INFO:teuthology.orchestra.run.trial086.stdout: "client_die_on_failed_remount": "false", 2026-02-26T03:15:58.220 INFO:teuthology.orchestra.run.trial086.stdout: "client_dirsize_rbytes": "true", 2026-02-26T03:15:58.220 INFO:teuthology.orchestra.run.trial086.stdout: "client_file_blockdiff_max_concurrent_object_scans": "16", 2026-02-26T03:15:58.220 INFO:teuthology.orchestra.run.trial086.stdout: "client_force_lazyio": "false", 2026-02-26T03:15:58.220 INFO:teuthology.orchestra.run.trial086.stdout: "client_fs": "", 2026-02-26T03:15:58.220 INFO:teuthology.orchestra.run.trial086.stdout: "client_fscrypt_as": "true", 2026-02-26T03:15:58.220 INFO:teuthology.orchestra.run.trial086.stdout: "client_fscrypt_dummy_encryption": "false", 2026-02-26T03:15:58.221 INFO:teuthology.orchestra.run.trial086.stdout: "client_inject_fixed_oldest_tid": "false", 2026-02-26T03:15:58.221 INFO:teuthology.orchestra.run.trial086.stdout: "client_inject_release_failure": "false", 2026-02-26T03:15:58.221 INFO:teuthology.orchestra.run.trial086.stdout: "client_inject_write_delay_secs": "0", 2026-02-26T03:15:58.221 INFO:teuthology.orchestra.run.trial086.stdout: "client_max_inline_size": "4096", 2026-02-26T03:15:58.221 INFO:teuthology.orchestra.run.trial086.stdout: "client_max_retries_on_remount_failure": "5", 2026-02-26T03:15:58.221 INFO:teuthology.orchestra.run.trial086.stdout: "client_mds_namespace": "", 2026-02-26T03:15:58.221 INFO:teuthology.orchestra.run.trial086.stdout: "client_metadata": "", 2026-02-26T03:15:58.221 INFO:teuthology.orchestra.run.trial086.stdout: "client_mount_gid": "-1", 2026-02-26T03:15:58.221 INFO:teuthology.orchestra.run.trial086.stdout: "client_mount_timeout": "300", 2026-02-26T03:15:58.221 INFO:teuthology.orchestra.run.trial086.stdout: "client_mount_uid": "-1", 2026-02-26T03:15:58.221 INFO:teuthology.orchestra.run.trial086.stdout: "client_mountpoint": "/", 2026-02-26T03:15:58.221 INFO:teuthology.orchestra.run.trial086.stdout: "client_notify_timeout": "10", 2026-02-26T03:15:58.221 INFO:teuthology.orchestra.run.trial086.stdout: "client_oc": "true", 2026-02-26T03:15:58.222 INFO:teuthology.orchestra.run.trial086.stdout: "client_oc_max_dirty": "104857600", 2026-02-26T03:15:58.222 INFO:teuthology.orchestra.run.trial086.stdout: "client_oc_max_dirty_age": "5.000000", 2026-02-26T03:15:58.222 INFO:teuthology.orchestra.run.trial086.stdout: "client_oc_max_objects": "1000", 2026-02-26T03:15:58.222 INFO:teuthology.orchestra.run.trial086.stdout: "client_oc_size": "209715200", 2026-02-26T03:15:58.222 INFO:teuthology.orchestra.run.trial086.stdout: "client_oc_target_dirty": "8388608", 2026-02-26T03:15:58.222 INFO:teuthology.orchestra.run.trial086.stdout: "client_permissions": "true", 2026-02-26T03:15:58.222 INFO:teuthology.orchestra.run.trial086.stdout: "client_quota": "true", 2026-02-26T03:15:58.222 INFO:teuthology.orchestra.run.trial086.stdout: "client_quota_df": "true", 2026-02-26T03:15:58.222 INFO:teuthology.orchestra.run.trial086.stdout: "client_readahead_max_bytes": "0", 2026-02-26T03:15:58.222 INFO:teuthology.orchestra.run.trial086.stdout: "client_readahead_max_periods": "4", 2026-02-26T03:15:58.222 INFO:teuthology.orchestra.run.trial086.stdout: "client_readahead_min": "131072", 2026-02-26T03:15:58.222 INFO:teuthology.orchestra.run.trial086.stdout: "client_reconnect_stale": "false", 2026-02-26T03:15:58.222 INFO:teuthology.orchestra.run.trial086.stdout: "client_respect_subvolume_snapshot_visibility": "false", 2026-02-26T03:15:58.223 INFO:teuthology.orchestra.run.trial086.stdout: "client_shutdown_timeout": "30", 2026-02-26T03:15:58.223 INFO:teuthology.orchestra.run.trial086.stdout: "client_snapdir": ".snap", 2026-02-26T03:15:58.223 INFO:teuthology.orchestra.run.trial086.stdout: "client_tick_interval": "1", 2026-02-26T03:15:58.223 INFO:teuthology.orchestra.run.trial086.stdout: "client_trace": "", 2026-02-26T03:15:58.223 INFO:teuthology.orchestra.run.trial086.stdout: "client_try_dentry_invalidate": "false", 2026-02-26T03:15:58.223 INFO:teuthology.orchestra.run.trial086.stdout: "client_use_faked_inos": "false", 2026-02-26T03:15:58.223 INFO:teuthology.orchestra.run.trial086.stdout: "client_use_random_mds": "false", 2026-02-26T03:15:58.223 INFO:teuthology.orchestra.run.trial086.stdout: "clog_to_graylog": "false", 2026-02-26T03:15:58.223 INFO:teuthology.orchestra.run.trial086.stdout: "clog_to_graylog_host": "127.0.0.1", 2026-02-26T03:15:58.223 INFO:teuthology.orchestra.run.trial086.stdout: "clog_to_graylog_port": "12201", 2026-02-26T03:15:58.223 INFO:teuthology.orchestra.run.trial086.stdout: "clog_to_monitors": "default=true", 2026-02-26T03:15:58.224 INFO:teuthology.orchestra.run.trial086.stdout: "clog_to_syslog": "false", 2026-02-26T03:15:58.224 INFO:teuthology.orchestra.run.trial086.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2026-02-26T03:15:58.224 INFO:teuthology.orchestra.run.trial086.stdout: "clog_to_syslog_level": "info", 2026-02-26T03:15:58.224 INFO:teuthology.orchestra.run.trial086.stdout: "cluster_addr": "-", 2026-02-26T03:15:58.224 INFO:teuthology.orchestra.run.trial086.stdout: "cluster_network": "", 2026-02-26T03:15:58.224 INFO:teuthology.orchestra.run.trial086.stdout: "cluster_network_interface": "", 2026-02-26T03:15:58.224 INFO:teuthology.orchestra.run.trial086.stdout: "compressor_zlib_isal": "false", 2026-02-26T03:15:58.224 INFO:teuthology.orchestra.run.trial086.stdout: "compressor_zlib_level": "5", 2026-02-26T03:15:58.224 INFO:teuthology.orchestra.run.trial086.stdout: "compressor_zlib_winsize": "-15", 2026-02-26T03:15:58.224 INFO:teuthology.orchestra.run.trial086.stdout: "compressor_zstd_level": "1", 2026-02-26T03:15:58.224 INFO:teuthology.orchestra.run.trial086.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2026-02-26T03:15:58.224 INFO:teuthology.orchestra.run.trial086.stdout: "crash_dir": "/var/lib/ceph/crash", 2026-02-26T03:15:58.225 INFO:teuthology.orchestra.run.trial086.stdout: "crimson_allow_pg_split": "true", 2026-02-26T03:15:58.225 INFO:teuthology.orchestra.run.trial086.stdout: "crimson_bluestore_cpu_set": "", 2026-02-26T03:15:58.225 INFO:teuthology.orchestra.run.trial086.stdout: "crimson_bluestore_num_threads": "6", 2026-02-26T03:15:58.225 INFO:teuthology.orchestra.run.trial086.stdout: "crimson_cpu_num": "3", 2026-02-26T03:15:58.225 INFO:teuthology.orchestra.run.trial086.stdout: "crimson_cpu_set": "", 2026-02-26T03:15:58.225 INFO:teuthology.orchestra.run.trial086.stdout: "crimson_osd_obc_lru_size": "10", 2026-02-26T03:15:58.225 INFO:teuthology.orchestra.run.trial086.stdout: "crimson_osd_scheduler_concurrency": "0", 2026-02-26T03:15:58.225 INFO:teuthology.orchestra.run.trial086.stdout: "crimson_osd_stat_interval": "0", 2026-02-26T03:15:58.225 INFO:teuthology.orchestra.run.trial086.stdout: "crimson_poll_mode": "false", 2026-02-26T03:15:58.226 INFO:teuthology.orchestra.run.trial086.stdout: "crimson_reactor_idle_poll_time_us": "200", 2026-02-26T03:15:58.226 INFO:teuthology.orchestra.run.trial086.stdout: "crimson_reactor_io_latency_goal_ms": "0.000000", 2026-02-26T03:15:58.226 INFO:teuthology.orchestra.run.trial086.stdout: "crimson_reactor_task_quota_ms": "0.500000", 2026-02-26T03:15:58.226 INFO:teuthology.orchestra.run.trial086.stdout: "crush_location": "", 2026-02-26T03:15:58.226 INFO:teuthology.orchestra.run.trial086.stdout: "crush_location_hook": "", 2026-02-26T03:15:58.226 INFO:teuthology.orchestra.run.trial086.stdout: "crush_location_hook_timeout": "10", 2026-02-26T03:15:58.226 INFO:teuthology.orchestra.run.trial086.stdout: "d4n_writecache_enabled": "false", 2026-02-26T03:15:58.226 INFO:teuthology.orchestra.run.trial086.stdout: "daemonize": "false", 2026-02-26T03:15:58.226 INFO:teuthology.orchestra.run.trial086.stdout: "daos_pool": "tank", 2026-02-26T03:15:58.226 INFO:teuthology.orchestra.run.trial086.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2026-02-26T03:15:58.226 INFO:teuthology.orchestra.run.trial086.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2026-02-26T03:15:58.226 INFO:teuthology.orchestra.run.trial086.stdout: "dbstore_db_name_prefix": "dbstore", 2026-02-26T03:15:58.226 INFO:teuthology.orchestra.run.trial086.stdout: "debug_alienstore": "0/5", 2026-02-26T03:15:58.227 INFO:teuthology.orchestra.run.trial086.stdout: "debug_allow_any_pool_priority": "false", 2026-02-26T03:15:58.227 INFO:teuthology.orchestra.run.trial086.stdout: "debug_asok": "1/5", 2026-02-26T03:15:58.227 INFO:teuthology.orchestra.run.trial086.stdout: "debug_asok_assert_abort": "false", 2026-02-26T03:15:58.227 INFO:teuthology.orchestra.run.trial086.stdout: "debug_asserts_on_shutdown": "true", 2026-02-26T03:15:58.227 INFO:teuthology.orchestra.run.trial086.stdout: "debug_auth": "1/5", 2026-02-26T03:15:58.227 INFO:teuthology.orchestra.run.trial086.stdout: "debug_bdev": "1/3", 2026-02-26T03:15:58.227 INFO:teuthology.orchestra.run.trial086.stdout: "debug_bluefs": "1/5", 2026-02-26T03:15:58.227 INFO:teuthology.orchestra.run.trial086.stdout: "debug_bluestore": "1/5", 2026-02-26T03:15:58.227 INFO:teuthology.orchestra.run.trial086.stdout: "debug_bluestore_compression": "1/5", 2026-02-26T03:15:58.227 INFO:teuthology.orchestra.run.trial086.stdout: "debug_buffer": "0/1", 2026-02-26T03:15:58.227 INFO:teuthology.orchestra.run.trial086.stdout: "debug_ceph_dedup": "0/5", 2026-02-26T03:15:58.227 INFO:teuthology.orchestra.run.trial086.stdout: "debug_ceph_exporter": "1/5", 2026-02-26T03:15:58.228 INFO:teuthology.orchestra.run.trial086.stdout: "debug_cephfs_mirror": "0/5", 2026-02-26T03:15:58.228 INFO:teuthology.orchestra.run.trial086.stdout: "debug_cephsqlite": "0/5", 2026-02-26T03:15:58.228 INFO:teuthology.orchestra.run.trial086.stdout: "debug_client": "0/5", 2026-02-26T03:15:58.228 INFO:teuthology.orchestra.run.trial086.stdout: "debug_compressor": "1/5", 2026-02-26T03:15:58.228 INFO:teuthology.orchestra.run.trial086.stdout: "debug_context": "0/1", 2026-02-26T03:15:58.228 INFO:teuthology.orchestra.run.trial086.stdout: "debug_crimson_interrupt": "0/5", 2026-02-26T03:15:58.229 INFO:teuthology.orchestra.run.trial086.stdout: "debug_crush": "1/1", 2026-02-26T03:15:58.229 INFO:teuthology.orchestra.run.trial086.stdout: "debug_crypto": "1/5", 2026-02-26T03:15:58.229 INFO:teuthology.orchestra.run.trial086.stdout: "debug_cyanstore": "0/5", 2026-02-26T03:15:58.229 INFO:teuthology.orchestra.run.trial086.stdout: "debug_deliberately_leak_memory": "false", 2026-02-26T03:15:58.229 INFO:teuthology.orchestra.run.trial086.stdout: "debug_disable_randomized_ping": "false", 2026-02-26T03:15:58.229 INFO:teuthology.orchestra.run.trial086.stdout: "debug_dpdk": "1/5", 2026-02-26T03:15:58.229 INFO:teuthology.orchestra.run.trial086.stdout: "debug_eventtrace": "1/5", 2026-02-26T03:15:58.230 INFO:teuthology.orchestra.run.trial086.stdout: "debug_filer": "0/1", 2026-02-26T03:15:58.230 INFO:teuthology.orchestra.run.trial086.stdout: "debug_filestore": "1/3", 2026-02-26T03:15:58.230 INFO:teuthology.orchestra.run.trial086.stdout: "debug_finisher": "1/1", 2026-02-26T03:15:58.230 INFO:teuthology.orchestra.run.trial086.stdout: "debug_fuse": "1/5", 2026-02-26T03:15:58.230 INFO:teuthology.orchestra.run.trial086.stdout: "debug_heartbeat_testing_span": "0", 2026-02-26T03:15:58.230 INFO:teuthology.orchestra.run.trial086.stdout: "debug_heartbeatmap": "1/5", 2026-02-26T03:15:58.230 INFO:teuthology.orchestra.run.trial086.stdout: "debug_immutable_obj_cache": "0/5", 2026-02-26T03:15:58.231 INFO:teuthology.orchestra.run.trial086.stdout: "debug_javaclient": "1/5", 2026-02-26T03:15:58.231 INFO:teuthology.orchestra.run.trial086.stdout: "debug_journal": "1/3", 2026-02-26T03:15:58.231 INFO:teuthology.orchestra.run.trial086.stdout: "debug_journaler": "0/5", 2026-02-26T03:15:58.231 INFO:teuthology.orchestra.run.trial086.stdout: "debug_kstore": "1/5", 2026-02-26T03:15:58.231 INFO:teuthology.orchestra.run.trial086.stdout: "debug_lockdep": "0/1", 2026-02-26T03:15:58.231 INFO:teuthology.orchestra.run.trial086.stdout: "debug_mclock": "1/5", 2026-02-26T03:15:58.231 INFO:teuthology.orchestra.run.trial086.stdout: "debug_mds": "1/5", 2026-02-26T03:15:58.231 INFO:teuthology.orchestra.run.trial086.stdout: "debug_mds_balancer": "1/5", 2026-02-26T03:15:58.231 INFO:teuthology.orchestra.run.trial086.stdout: "debug_mds_locker": "1/5", 2026-02-26T03:15:58.231 INFO:teuthology.orchestra.run.trial086.stdout: "debug_mds_log": "1/5", 2026-02-26T03:15:58.231 INFO:teuthology.orchestra.run.trial086.stdout: "debug_mds_log_expire": "1/5", 2026-02-26T03:15:58.231 INFO:teuthology.orchestra.run.trial086.stdout: "debug_mds_migrator": "1/5", 2026-02-26T03:15:58.232 INFO:teuthology.orchestra.run.trial086.stdout: "debug_mds_quiesce": "3/5", 2026-02-26T03:15:58.232 INFO:teuthology.orchestra.run.trial086.stdout: "debug_memstore": "1/5", 2026-02-26T03:15:58.232 INFO:teuthology.orchestra.run.trial086.stdout: "debug_mgr": "2/5", 2026-02-26T03:15:58.232 INFO:teuthology.orchestra.run.trial086.stdout: "debug_mgrc": "1/5", 2026-02-26T03:15:58.232 INFO:teuthology.orchestra.run.trial086.stdout: "debug_mon": "1/5", 2026-02-26T03:15:58.232 INFO:teuthology.orchestra.run.trial086.stdout: "debug_monc": "20/20", 2026-02-26T03:15:58.232 INFO:teuthology.orchestra.run.trial086.stdout: "debug_ms": "20/20", 2026-02-26T03:15:58.232 INFO:teuthology.orchestra.run.trial086.stdout: "debug_none": "0/5", 2026-02-26T03:15:58.232 INFO:teuthology.orchestra.run.trial086.stdout: "debug_objclass": "0/5", 2026-02-26T03:15:58.232 INFO:teuthology.orchestra.run.trial086.stdout: "debug_objectcacher": "0/5", 2026-02-26T03:15:58.232 INFO:teuthology.orchestra.run.trial086.stdout: "debug_objecter": "0/1", 2026-02-26T03:15:58.232 INFO:teuthology.orchestra.run.trial086.stdout: "debug_optracker": "0/5", 2026-02-26T03:15:58.232 INFO:teuthology.orchestra.run.trial086.stdout: "debug_osd": "20/20", 2026-02-26T03:15:58.233 INFO:teuthology.orchestra.run.trial086.stdout: "debug_paxos": "1/5", 2026-02-26T03:15:58.233 INFO:teuthology.orchestra.run.trial086.stdout: "debug_perfcounter": "1/5", 2026-02-26T03:15:58.233 INFO:teuthology.orchestra.run.trial086.stdout: "debug_prioritycache": "1/5", 2026-02-26T03:15:58.233 INFO:teuthology.orchestra.run.trial086.stdout: "debug_rados": "0/5", 2026-02-26T03:15:58.233 INFO:teuthology.orchestra.run.trial086.stdout: "debug_rbd": "0/5", 2026-02-26T03:15:58.233 INFO:teuthology.orchestra.run.trial086.stdout: "debug_rbd_mirror": "0/5", 2026-02-26T03:15:58.233 INFO:teuthology.orchestra.run.trial086.stdout: "debug_rbd_pwl": "0/5", 2026-02-26T03:15:58.233 INFO:teuthology.orchestra.run.trial086.stdout: "debug_rbd_replay": "0/5", 2026-02-26T03:15:58.233 INFO:teuthology.orchestra.run.trial086.stdout: "debug_refs": "0/0", 2026-02-26T03:15:58.233 INFO:teuthology.orchestra.run.trial086.stdout: "debug_reserver": "1/1", 2026-02-26T03:15:58.233 INFO:teuthology.orchestra.run.trial086.stdout: "debug_rgw": "1/5", 2026-02-26T03:15:58.233 INFO:teuthology.orchestra.run.trial086.stdout: "debug_rgw_access": "1/5", 2026-02-26T03:15:58.234 INFO:teuthology.orchestra.run.trial086.stdout: "debug_rgw_bucket_logging": "1/5", 2026-02-26T03:15:58.234 INFO:teuthology.orchestra.run.trial086.stdout: "debug_rgw_datacache": "1/5", 2026-02-26T03:15:58.234 INFO:teuthology.orchestra.run.trial086.stdout: "debug_rgw_dbstore": "1/5", 2026-02-26T03:15:58.234 INFO:teuthology.orchestra.run.trial086.stdout: "debug_rgw_dedup": "1/5", 2026-02-26T03:15:58.234 INFO:teuthology.orchestra.run.trial086.stdout: "debug_rgw_flight": "1/5", 2026-02-26T03:15:58.234 INFO:teuthology.orchestra.run.trial086.stdout: "debug_rgw_lifecycle": "1/5", 2026-02-26T03:15:58.234 INFO:teuthology.orchestra.run.trial086.stdout: "debug_rgw_notification": "1/5", 2026-02-26T03:15:58.234 INFO:teuthology.orchestra.run.trial086.stdout: "debug_rgw_restore": "1/5", 2026-02-26T03:15:58.234 INFO:teuthology.orchestra.run.trial086.stdout: "debug_rgw_sync": "1/5", 2026-02-26T03:15:58.234 INFO:teuthology.orchestra.run.trial086.stdout: "debug_rocksdb": "4/5", 2026-02-26T03:15:58.235 INFO:teuthology.orchestra.run.trial086.stdout: "debug_seastore": "20/20", 2026-02-26T03:15:58.235 INFO:teuthology.orchestra.run.trial086.stdout: "debug_seastore_backref": "20/20", 2026-02-26T03:15:58.235 INFO:teuthology.orchestra.run.trial086.stdout: "debug_seastore_cache": "20/20", 2026-02-26T03:15:58.235 INFO:teuthology.orchestra.run.trial086.stdout: "debug_seastore_cleaner": "20/20", 2026-02-26T03:15:58.235 INFO:teuthology.orchestra.run.trial086.stdout: "debug_seastore_device": "20/20", 2026-02-26T03:15:58.235 INFO:teuthology.orchestra.run.trial086.stdout: "debug_seastore_epm": "20/20", 2026-02-26T03:15:58.235 INFO:teuthology.orchestra.run.trial086.stdout: "debug_seastore_fixedkv_tree": "20/20", 2026-02-26T03:15:58.235 INFO:teuthology.orchestra.run.trial086.stdout: "debug_seastore_journal": "20/20", 2026-02-26T03:15:58.235 INFO:teuthology.orchestra.run.trial086.stdout: "debug_seastore_lba": "20/20", 2026-02-26T03:15:58.235 INFO:teuthology.orchestra.run.trial086.stdout: "debug_seastore_odata": "20/20", 2026-02-26T03:15:58.235 INFO:teuthology.orchestra.run.trial086.stdout: "debug_seastore_omap": "20/20", 2026-02-26T03:15:58.235 INFO:teuthology.orchestra.run.trial086.stdout: "debug_seastore_onode": "20/20", 2026-02-26T03:15:58.235 INFO:teuthology.orchestra.run.trial086.stdout: "debug_seastore_t": "20/20", 2026-02-26T03:15:58.235 INFO:teuthology.orchestra.run.trial086.stdout: "debug_seastore_tm": "20/20", 2026-02-26T03:15:58.236 INFO:teuthology.orchestra.run.trial086.stdout: "debug_striper": "0/1", 2026-02-26T03:15:58.236 INFO:teuthology.orchestra.run.trial086.stdout: "debug_test": "0/5", 2026-02-26T03:15:58.236 INFO:teuthology.orchestra.run.trial086.stdout: "debug_throttle": "1/1", 2026-02-26T03:15:58.236 INFO:teuthology.orchestra.run.trial086.stdout: "debug_timer": "0/1", 2026-02-26T03:15:58.236 INFO:teuthology.orchestra.run.trial086.stdout: "debug_tp": "0/5", 2026-02-26T03:15:58.236 INFO:teuthology.orchestra.run.trial086.stdout: "debug_trace": "1/5", 2026-02-26T03:15:58.236 INFO:teuthology.orchestra.run.trial086.stdout: "defer_client_eviction_on_laggy_osds": "false", 2026-02-26T03:15:58.236 INFO:teuthology.orchestra.run.trial086.stdout: "device_failure_prediction_mode": "none", 2026-02-26T03:15:58.236 INFO:teuthology.orchestra.run.trial086.stdout: "ec_extent_cache_size": "10485760", 2026-02-26T03:15:58.236 INFO:teuthology.orchestra.run.trial086.stdout: "ec_pdw_write_mode": "0", 2026-02-26T03:15:58.236 INFO:teuthology.orchestra.run.trial086.stdout: "enable_availability_tracking": "false", 2026-02-26T03:15:58.236 INFO:teuthology.orchestra.run.trial086.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "crimson", 2026-02-26T03:15:58.236 INFO:teuthology.orchestra.run.trial086.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2026-02-26T03:15:58.236 INFO:teuthology.orchestra.run.trial086.stdout: "err_to_graylog": "false", 2026-02-26T03:15:58.237 INFO:teuthology.orchestra.run.trial086.stdout: "err_to_journald": "false", 2026-02-26T03:15:58.237 INFO:teuthology.orchestra.run.trial086.stdout: "err_to_stderr": "true", 2026-02-26T03:15:58.237 INFO:teuthology.orchestra.run.trial086.stdout: "err_to_syslog": "false", 2026-02-26T03:15:58.237 INFO:teuthology.orchestra.run.trial086.stdout: "event_tracing": "false", 2026-02-26T03:15:58.237 INFO:teuthology.orchestra.run.trial086.stdout: "exporter_addr": "0.0.0.0", 2026-02-26T03:15:58.237 INFO:teuthology.orchestra.run.trial086.stdout: "exporter_cert_file": "", 2026-02-26T03:15:58.237 INFO:teuthology.orchestra.run.trial086.stdout: "exporter_http_port": "9926", 2026-02-26T03:15:58.237 INFO:teuthology.orchestra.run.trial086.stdout: "exporter_key_file": "", 2026-02-26T03:15:58.237 INFO:teuthology.orchestra.run.trial086.stdout: "exporter_prio_limit": "5", 2026-02-26T03:15:58.237 INFO:teuthology.orchestra.run.trial086.stdout: "exporter_sock_dir": "/var/run/ceph/", 2026-02-26T03:15:58.237 INFO:teuthology.orchestra.run.trial086.stdout: "exporter_sort_metrics": "true", 2026-02-26T03:15:58.237 INFO:teuthology.orchestra.run.trial086.stdout: "exporter_stats_period": "5", 2026-02-26T03:15:58.237 INFO:teuthology.orchestra.run.trial086.stdout: "fake_statfs_for_testing": "0", 2026-02-26T03:15:58.237 INFO:teuthology.orchestra.run.trial086.stdout: "fatal_signal_handlers": "true", 2026-02-26T03:15:58.237 INFO:teuthology.orchestra.run.trial086.stdout: "filer_max_purge_ops": "10", 2026-02-26T03:15:58.238 INFO:teuthology.orchestra.run.trial086.stdout: "filer_max_truncate_ops": "128", 2026-02-26T03:15:58.238 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_apply_finisher_threads": "3", 2026-02-26T03:15:58.238 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_blackhole": "false", 2026-02-26T03:15:58.238 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_btrfs_clone_range": "true", 2026-02-26T03:15:58.238 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_btrfs_snap": "true", 2026-02-26T03:15:58.238 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_caller_concurrency": "10", 2026-02-26T03:15:58.238 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_collect_device_partition_information": "true", 2026-02-26T03:15:58.238 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_commit_timeout": "600.000000", 2026-02-26T03:15:58.238 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_debug_inject_read_err": "false", 2026-02-26T03:15:58.238 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_debug_omap_check": "false", 2026-02-26T03:15:58.238 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_debug_verify_split": "false", 2026-02-26T03:15:58.238 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_dump_file": "", 2026-02-26T03:15:58.238 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2026-02-26T03:15:58.238 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_expected_throughput_ops": "200.000000", 2026-02-26T03:15:58.239 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_fadvise": "true", 2026-02-26T03:15:58.239 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_fail_eio": "true", 2026-02-26T03:15:58.239 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_fd_cache_shards": "16", 2026-02-26T03:15:58.239 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_fd_cache_size": "128", 2026-02-26T03:15:58.239 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_fiemap": "false", 2026-02-26T03:15:58.239 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_fiemap_threshold": "4096", 2026-02-26T03:15:58.239 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_fsync_flushes_journal_data": "false", 2026-02-26T03:15:58.239 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_index_retry_probability": "0.000000", 2026-02-26T03:15:58.239 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_inject_stall": "0", 2026-02-26T03:15:58.239 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_journal_parallel": "false", 2026-02-26T03:15:58.239 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_journal_trailing": "false", 2026-02-26T03:15:58.239 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_journal_writeahead": "false", 2026-02-26T03:15:58.239 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_kill_at": "0", 2026-02-26T03:15:58.239 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_max_alloc_hint_size": "1048576", 2026-02-26T03:15:58.240 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_max_inline_xattr_size": "0", 2026-02-26T03:15:58.240 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2026-02-26T03:15:58.240 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_max_inline_xattr_size_other": "512", 2026-02-26T03:15:58.240 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2026-02-26T03:15:58.240 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_max_inline_xattrs": "0", 2026-02-26T03:15:58.240 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2026-02-26T03:15:58.240 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_max_inline_xattrs_other": "2", 2026-02-26T03:15:58.240 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_max_inline_xattrs_xfs": "10", 2026-02-26T03:15:58.240 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_max_sync_interval": "5.000000", 2026-02-26T03:15:58.240 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_max_xattr_value_size": "0", 2026-02-26T03:15:58.240 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2026-02-26T03:15:58.240 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_max_xattr_value_size_other": "1024", 2026-02-26T03:15:58.240 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2026-02-26T03:15:58.240 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_merge_threshold": "-10", 2026-02-26T03:15:58.240 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_min_sync_interval": "0.010000", 2026-02-26T03:15:58.241 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_odsync_write": "false", 2026-02-26T03:15:58.241 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_omap_backend": "rocksdb", 2026-02-26T03:15:58.241 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_omap_backend_path": "", 2026-02-26T03:15:58.241 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_omap_header_cache_size": "1024", 2026-02-26T03:15:58.241 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_ondisk_finisher_threads": "3", 2026-02-26T03:15:58.241 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_op_thread_suicide_timeout": "180", 2026-02-26T03:15:58.241 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_op_thread_timeout": "60", 2026-02-26T03:15:58.241 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_op_threads": "2", 2026-02-26T03:15:58.241 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_punch_hole": "false", 2026-02-26T03:15:58.241 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2026-02-26T03:15:58.241 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2026-02-26T03:15:58.241 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2026-02-26T03:15:58.241 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_queue_high_threshhold": "0.900000", 2026-02-26T03:15:58.241 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_queue_low_threshhold": "0.300000", 2026-02-26T03:15:58.241 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_queue_max_bytes": "104857600", 2026-02-26T03:15:58.241 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2026-02-26T03:15:58.242 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2026-02-26T03:15:58.242 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2026-02-26T03:15:58.242 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_queue_max_ops": "50", 2026-02-26T03:15:58.242 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2026-02-26T03:15:58.242 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_seek_data_hole": "false", 2026-02-26T03:15:58.242 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_sloppy_crc": "false", 2026-02-26T03:15:58.242 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_sloppy_crc_block_size": "65536", 2026-02-26T03:15:58.242 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_splice": "false", 2026-02-26T03:15:58.242 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_split_multiple": "2", 2026-02-26T03:15:58.242 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_split_rand_factor": "20", 2026-02-26T03:15:58.242 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_update_to": "1000", 2026-02-26T03:15:58.242 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2026-02-26T03:15:58.242 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2026-02-26T03:15:58.242 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2026-02-26T03:15:58.242 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2026-02-26T03:15:58.242 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2026-02-26T03:15:58.243 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2026-02-26T03:15:58.243 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_wbthrottle_enable": "true", 2026-02-26T03:15:58.243 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2026-02-26T03:15:58.243 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2026-02-26T03:15:58.243 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2026-02-26T03:15:58.243 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2026-02-26T03:15:58.243 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2026-02-26T03:15:58.243 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2026-02-26T03:15:58.243 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_xfs_extsize": "false", 2026-02-26T03:15:58.243 INFO:teuthology.orchestra.run.trial086.stdout: "filestore_zfs_snap": "false", 2026-02-26T03:15:58.243 INFO:teuthology.orchestra.run.trial086.stdout: "fio_dir": "/tmp/fio", 2026-02-26T03:15:58.243 INFO:teuthology.orchestra.run.trial086.stdout: "fsid": "a3320112-ec0c-4bb6-bf8e-5331f894afbc", 2026-02-26T03:15:58.243 INFO:teuthology.orchestra.run.trial086.stdout: "fuse_allow_other": "true", 2026-02-26T03:15:58.243 INFO:teuthology.orchestra.run.trial086.stdout: "fuse_atomic_o_trunc": "true", 2026-02-26T03:15:58.244 INFO:teuthology.orchestra.run.trial086.stdout: "fuse_big_writes": "true", 2026-02-26T03:15:58.244 INFO:teuthology.orchestra.run.trial086.stdout: "fuse_debug": "false", 2026-02-26T03:15:58.244 INFO:teuthology.orchestra.run.trial086.stdout: "fuse_default_permissions": "false", 2026-02-26T03:15:58.244 INFO:teuthology.orchestra.run.trial086.stdout: "fuse_disable_pagecache": "false", 2026-02-26T03:15:58.244 INFO:teuthology.orchestra.run.trial086.stdout: "fuse_max_write": "0", 2026-02-26T03:15:58.244 INFO:teuthology.orchestra.run.trial086.stdout: "fuse_multithreaded": "true", 2026-02-26T03:15:58.244 INFO:teuthology.orchestra.run.trial086.stdout: "fuse_require_active_mds": "true", 2026-02-26T03:15:58.244 INFO:teuthology.orchestra.run.trial086.stdout: "fuse_set_user_groups": "true", 2026-02-26T03:15:58.244 INFO:teuthology.orchestra.run.trial086.stdout: "fuse_splice_move": "true", 2026-02-26T03:15:58.244 INFO:teuthology.orchestra.run.trial086.stdout: "fuse_splice_read": "true", 2026-02-26T03:15:58.244 INFO:teuthology.orchestra.run.trial086.stdout: "fuse_splice_write": "true", 2026-02-26T03:15:58.244 INFO:teuthology.orchestra.run.trial086.stdout: "fuse_syncfs_on_mksnap": "true", 2026-02-26T03:15:58.244 INFO:teuthology.orchestra.run.trial086.stdout: "fuse_use_invalidate_cb": "true", 2026-02-26T03:15:58.244 INFO:teuthology.orchestra.run.trial086.stdout: "gss_ktab_client_file": "/var/lib/ceph/osd.0/gss_client_osd.0.ktab", 2026-02-26T03:15:58.245 INFO:teuthology.orchestra.run.trial086.stdout: "gss_target_name": "ceph", 2026-02-26T03:15:58.245 INFO:teuthology.orchestra.run.trial086.stdout: "heartbeat_file": "", 2026-02-26T03:15:58.245 INFO:teuthology.orchestra.run.trial086.stdout: "heartbeat_inject_failure": "0", 2026-02-26T03:15:58.245 INFO:teuthology.orchestra.run.trial086.stdout: "heartbeat_interval": "5", 2026-02-26T03:15:58.245 INFO:teuthology.orchestra.run.trial086.stdout: "host": "", 2026-02-26T03:15:58.245 INFO:teuthology.orchestra.run.trial086.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2026-02-26T03:15:58.245 INFO:teuthology.orchestra.run.trial086.stdout: "immutable_object_cache_max_inflight_ops": "128", 2026-02-26T03:15:58.245 INFO:teuthology.orchestra.run.trial086.stdout: "immutable_object_cache_max_size": "1073741824", 2026-02-26T03:15:58.245 INFO:teuthology.orchestra.run.trial086.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2026-02-26T03:15:58.245 INFO:teuthology.orchestra.run.trial086.stdout: "immutable_object_cache_qos_bps_burst": "0", 2026-02-26T03:15:58.245 INFO:teuthology.orchestra.run.trial086.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2026-02-26T03:15:58.245 INFO:teuthology.orchestra.run.trial086.stdout: "immutable_object_cache_qos_bps_limit": "0", 2026-02-26T03:15:58.245 INFO:teuthology.orchestra.run.trial086.stdout: "immutable_object_cache_qos_iops_burst": "0", 2026-02-26T03:15:58.245 INFO:teuthology.orchestra.run.trial086.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2026-02-26T03:15:58.245 INFO:teuthology.orchestra.run.trial086.stdout: "immutable_object_cache_qos_iops_limit": "0", 2026-02-26T03:15:58.245 INFO:teuthology.orchestra.run.trial086.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2026-02-26T03:15:58.245 INFO:teuthology.orchestra.run.trial086.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2026-02-26T03:15:58.246 INFO:teuthology.orchestra.run.trial086.stdout: "immutable_object_cache_watermark": "0.900000", 2026-02-26T03:15:58.246 INFO:teuthology.orchestra.run.trial086.stdout: "inject_early_sigterm": "false", 2026-02-26T03:15:58.246 INFO:teuthology.orchestra.run.trial086.stdout: "jaeger_agent_port": "6799", 2026-02-26T03:15:58.246 INFO:teuthology.orchestra.run.trial086.stdout: "jaeger_tracing_enable": "false", 2026-02-26T03:15:58.246 INFO:teuthology.orchestra.run.trial086.stdout: "journal_aio": "true", 2026-02-26T03:15:58.246 INFO:teuthology.orchestra.run.trial086.stdout: "journal_align_min_size": "65536", 2026-02-26T03:15:58.246 INFO:teuthology.orchestra.run.trial086.stdout: "journal_block_align": "true", 2026-02-26T03:15:58.246 INFO:teuthology.orchestra.run.trial086.stdout: "journal_block_size": "4096", 2026-02-26T03:15:58.246 INFO:teuthology.orchestra.run.trial086.stdout: "journal_dio": "true", 2026-02-26T03:15:58.246 INFO:teuthology.orchestra.run.trial086.stdout: "journal_discard": "false", 2026-02-26T03:15:58.246 INFO:teuthology.orchestra.run.trial086.stdout: "journal_force_aio": "false", 2026-02-26T03:15:58.246 INFO:teuthology.orchestra.run.trial086.stdout: "journal_ignore_corruption": "false", 2026-02-26T03:15:58.246 INFO:teuthology.orchestra.run.trial086.stdout: "journal_max_write_bytes": "10485760", 2026-02-26T03:15:58.246 INFO:teuthology.orchestra.run.trial086.stdout: "journal_max_write_entries": "100", 2026-02-26T03:15:58.246 INFO:teuthology.orchestra.run.trial086.stdout: "journal_replay_from": "0", 2026-02-26T03:15:58.246 INFO:teuthology.orchestra.run.trial086.stdout: "journal_throttle_high_multiple": "0.000000", 2026-02-26T03:15:58.246 INFO:teuthology.orchestra.run.trial086.stdout: "journal_throttle_high_threshhold": "0.900000", 2026-02-26T03:15:58.247 INFO:teuthology.orchestra.run.trial086.stdout: "journal_throttle_low_threshhold": "0.600000", 2026-02-26T03:15:58.247 INFO:teuthology.orchestra.run.trial086.stdout: "journal_throttle_max_multiple": "0.000000", 2026-02-26T03:15:58.247 INFO:teuthology.orchestra.run.trial086.stdout: "journal_write_header_frequency": "0", 2026-02-26T03:15:58.247 INFO:teuthology.orchestra.run.trial086.stdout: "journal_zero_on_create": "true", 2026-02-26T03:15:58.247 INFO:teuthology.orchestra.run.trial086.stdout: "journaler_prefetch_periods": "10", 2026-02-26T03:15:58.247 INFO:teuthology.orchestra.run.trial086.stdout: "journaler_prezero_periods": "5", 2026-02-26T03:15:58.247 INFO:teuthology.orchestra.run.trial086.stdout: "journaler_write_head_interval": "15", 2026-02-26T03:15:58.247 INFO:teuthology.orchestra.run.trial086.stdout: "key": "", 2026-02-26T03:15:58.247 INFO:teuthology.orchestra.run.trial086.stdout: "keyfile": "", 2026-02-26T03:15:58.247 INFO:teuthology.orchestra.run.trial086.stdout: "keyring": "/var/lib/ceph/osd/ceph-0/keyring", 2026-02-26T03:15:58.247 INFO:teuthology.orchestra.run.trial086.stdout: "librados_thread_count": "2", 2026-02-26T03:15:58.247 INFO:teuthology.orchestra.run.trial086.stdout: "lockdep": "false", 2026-02-26T03:15:58.247 INFO:teuthology.orchestra.run.trial086.stdout: "lockdep_force_backtrace": "false", 2026-02-26T03:15:58.247 INFO:teuthology.orchestra.run.trial086.stdout: "log_coarse_timestamps": "true", 2026-02-26T03:15:58.247 INFO:teuthology.orchestra.run.trial086.stdout: "log_file": "/var/log/ceph/ceph-osd.0.log", 2026-02-26T03:15:58.247 INFO:teuthology.orchestra.run.trial086.stdout: "log_flush_on_exit": "false", 2026-02-26T03:15:58.247 INFO:teuthology.orchestra.run.trial086.stdout: "log_graylog_host": "127.0.0.1", 2026-02-26T03:15:58.247 INFO:teuthology.orchestra.run.trial086.stdout: "log_graylog_port": "12201", 2026-02-26T03:15:58.247 INFO:teuthology.orchestra.run.trial086.stdout: "log_max_new": "1000", 2026-02-26T03:15:58.248 INFO:teuthology.orchestra.run.trial086.stdout: "log_max_recent": "10000", 2026-02-26T03:15:58.248 INFO:teuthology.orchestra.run.trial086.stdout: "log_stderr_prefix": "", 2026-02-26T03:15:58.248 INFO:teuthology.orchestra.run.trial086.stdout: "log_stop_at_utilization": "0.970000", 2026-02-26T03:15:58.248 INFO:teuthology.orchestra.run.trial086.stdout: "log_to_file": "true", 2026-02-26T03:15:58.248 INFO:teuthology.orchestra.run.trial086.stdout: "log_to_graylog": "false", 2026-02-26T03:15:58.248 INFO:teuthology.orchestra.run.trial086.stdout: "log_to_journald": "false", 2026-02-26T03:15:58.248 INFO:teuthology.orchestra.run.trial086.stdout: "log_to_stderr": "false", 2026-02-26T03:15:58.248 INFO:teuthology.orchestra.run.trial086.stdout: "log_to_syslog": "false", 2026-02-26T03:15:58.248 INFO:teuthology.orchestra.run.trial086.stdout: "max_rotating_auth_attempts": "10", 2026-02-26T03:15:58.248 INFO:teuthology.orchestra.run.trial086.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2026-02-26T03:15:58.248 INFO:teuthology.orchestra.run.trial086.stdout: "mds_action_on_write_error": "1", 2026-02-26T03:15:58.248 INFO:teuthology.orchestra.run.trial086.stdout: "mds_allow_async_dirops": "true", 2026-02-26T03:15:58.248 INFO:teuthology.orchestra.run.trial086.stdout: "mds_allow_batched_ops": "true", 2026-02-26T03:15:58.248 INFO:teuthology.orchestra.run.trial086.stdout: "mds_alternate_name_max": "8192", 2026-02-26T03:15:58.248 INFO:teuthology.orchestra.run.trial086.stdout: "mds_asio_thread_count": "2", 2026-02-26T03:15:58.248 INFO:teuthology.orchestra.run.trial086.stdout: "mds_bal_export_pin": "true", 2026-02-26T03:15:58.248 INFO:teuthology.orchestra.run.trial086.stdout: "mds_bal_fragment_dirs": "true", 2026-02-26T03:15:58.248 INFO:teuthology.orchestra.run.trial086.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2026-02-26T03:15:58.248 INFO:teuthology.orchestra.run.trial086.stdout: "mds_bal_fragment_interval": "5", 2026-02-26T03:15:58.248 INFO:teuthology.orchestra.run.trial086.stdout: "mds_bal_fragment_size_max": "100000", 2026-02-26T03:15:58.249 INFO:teuthology.orchestra.run.trial086.stdout: "mds_bal_idle_threshold": "0.000000", 2026-02-26T03:15:58.249 INFO:teuthology.orchestra.run.trial086.stdout: "mds_bal_interval": "10", 2026-02-26T03:15:58.249 INFO:teuthology.orchestra.run.trial086.stdout: "mds_bal_max": "-1", 2026-02-26T03:15:58.249 INFO:teuthology.orchestra.run.trial086.stdout: "mds_bal_max_until": "-1", 2026-02-26T03:15:58.249 INFO:teuthology.orchestra.run.trial086.stdout: "mds_bal_merge_size": "50", 2026-02-26T03:15:58.249 INFO:teuthology.orchestra.run.trial086.stdout: "mds_bal_midchunk": "0.300000", 2026-02-26T03:15:58.249 INFO:teuthology.orchestra.run.trial086.stdout: "mds_bal_min_rebalance": "0.100000", 2026-02-26T03:15:58.249 INFO:teuthology.orchestra.run.trial086.stdout: "mds_bal_min_start": "0.200000", 2026-02-26T03:15:58.249 INFO:teuthology.orchestra.run.trial086.stdout: "mds_bal_minchunk": "0.001000", 2026-02-26T03:15:58.249 INFO:teuthology.orchestra.run.trial086.stdout: "mds_bal_mode": "0", 2026-02-26T03:15:58.249 INFO:teuthology.orchestra.run.trial086.stdout: "mds_bal_need_max": "1.200000", 2026-02-26T03:15:58.249 INFO:teuthology.orchestra.run.trial086.stdout: "mds_bal_need_min": "0.800000", 2026-02-26T03:15:58.249 INFO:teuthology.orchestra.run.trial086.stdout: "mds_bal_overload_epochs": "2", 2026-02-26T03:15:58.249 INFO:teuthology.orchestra.run.trial086.stdout: "mds_bal_replicate_threshold": "8000.000000", 2026-02-26T03:15:58.249 INFO:teuthology.orchestra.run.trial086.stdout: "mds_bal_sample_interval": "3.000000", 2026-02-26T03:15:58.249 INFO:teuthology.orchestra.run.trial086.stdout: "mds_bal_split_bits": "3", 2026-02-26T03:15:58.249 INFO:teuthology.orchestra.run.trial086.stdout: "mds_bal_split_rd": "25000.000000", 2026-02-26T03:15:58.249 INFO:teuthology.orchestra.run.trial086.stdout: "mds_bal_split_size": "10000", 2026-02-26T03:15:58.249 INFO:teuthology.orchestra.run.trial086.stdout: "mds_bal_split_wr": "10000.000000", 2026-02-26T03:15:58.250 INFO:teuthology.orchestra.run.trial086.stdout: "mds_bal_target_decay": "10.000000", 2026-02-26T03:15:58.250 INFO:teuthology.orchestra.run.trial086.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2026-02-26T03:15:58.250 INFO:teuthology.orchestra.run.trial086.stdout: "mds_beacon_grace": "15.000000", 2026-02-26T03:15:58.250 INFO:teuthology.orchestra.run.trial086.stdout: "mds_beacon_interval": "4.000000", 2026-02-26T03:15:58.250 INFO:teuthology.orchestra.run.trial086.stdout: "mds_beacon_mon_down_grace": "60", 2026-02-26T03:15:58.250 INFO:teuthology.orchestra.run.trial086.stdout: "mds_cache_memory_limit": "4294967296", 2026-02-26T03:15:58.250 INFO:teuthology.orchestra.run.trial086.stdout: "mds_cache_mid": "0.700000", 2026-02-26T03:15:58.250 INFO:teuthology.orchestra.run.trial086.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2026-02-26T03:15:58.250 INFO:teuthology.orchestra.run.trial086.stdout: "mds_cache_quiesce_delay": "0", 2026-02-26T03:15:58.250 INFO:teuthology.orchestra.run.trial086.stdout: "mds_cache_quiesce_sleep": "200", 2026-02-26T03:15:58.250 INFO:teuthology.orchestra.run.trial086.stdout: "mds_cache_quiesce_splitauth": "true", 2026-02-26T03:15:58.250 INFO:teuthology.orchestra.run.trial086.stdout: "mds_cache_quiesce_threshold": "524288", 2026-02-26T03:15:58.250 INFO:teuthology.orchestra.run.trial086.stdout: "mds_cache_release_free_interval": "10", 2026-02-26T03:15:58.250 INFO:teuthology.orchestra.run.trial086.stdout: "mds_cache_reservation": "0.050000", 2026-02-26T03:15:58.250 INFO:teuthology.orchestra.run.trial086.stdout: "mds_cache_trim_decay_rate": "1.000000", 2026-02-26T03:15:58.250 INFO:teuthology.orchestra.run.trial086.stdout: "mds_cache_trim_interval": "1", 2026-02-26T03:15:58.250 INFO:teuthology.orchestra.run.trial086.stdout: "mds_cache_trim_threshold": "262144", 2026-02-26T03:15:58.250 INFO:teuthology.orchestra.run.trial086.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2026-02-26T03:15:58.250 INFO:teuthology.orchestra.run.trial086.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2026-02-26T03:15:58.250 INFO:teuthology.orchestra.run.trial086.stdout: "mds_client_delegate_inos_pct": "50", 2026-02-26T03:15:58.250 INFO:teuthology.orchestra.run.trial086.stdout: "mds_client_prealloc_inos": "1000", 2026-02-26T03:15:58.250 INFO:teuthology.orchestra.run.trial086.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2026-02-26T03:15:58.251 INFO:teuthology.orchestra.run.trial086.stdout: "mds_connect_bootstrapping": "false", 2026-02-26T03:15:58.251 INFO:teuthology.orchestra.run.trial086.stdout: "mds_damage_table_max_entries": "10000", 2026-02-26T03:15:58.251 INFO:teuthology.orchestra.run.trial086.stdout: "mds_data": "/var/lib/ceph/mds/ceph-0", 2026-02-26T03:15:58.251 INFO:teuthology.orchestra.run.trial086.stdout: "mds_debug_auth_pins": "false", 2026-02-26T03:15:58.251 INFO:teuthology.orchestra.run.trial086.stdout: "mds_debug_frag": "false", 2026-02-26T03:15:58.251 INFO:teuthology.orchestra.run.trial086.stdout: "mds_debug_scatterstat": "false", 2026-02-26T03:15:58.251 INFO:teuthology.orchestra.run.trial086.stdout: "mds_debug_subtrees": "false", 2026-02-26T03:15:58.251 INFO:teuthology.orchestra.run.trial086.stdout: "mds_decay_halflife": "5.000000", 2026-02-26T03:15:58.251 INFO:teuthology.orchestra.run.trial086.stdout: "mds_default_dir_hash": "2", 2026-02-26T03:15:58.251 INFO:teuthology.orchestra.run.trial086.stdout: "mds_defer_session_stale": "true", 2026-02-26T03:15:58.251 INFO:teuthology.orchestra.run.trial086.stdout: "mds_delay_journal_replay_for_testing": "0", 2026-02-26T03:15:58.251 INFO:teuthology.orchestra.run.trial086.stdout: "mds_deny_all_reconnect": "false", 2026-02-26T03:15:58.251 INFO:teuthology.orchestra.run.trial086.stdout: "mds_dir_keys_per_op": "16384", 2026-02-26T03:15:58.251 INFO:teuthology.orchestra.run.trial086.stdout: "mds_dir_max_commit_size": "10", 2026-02-26T03:15:58.251 INFO:teuthology.orchestra.run.trial086.stdout: "mds_dir_max_entries": "0", 2026-02-26T03:15:58.251 INFO:teuthology.orchestra.run.trial086.stdout: "mds_dir_prefetch": "true", 2026-02-26T03:15:58.251 INFO:teuthology.orchestra.run.trial086.stdout: "mds_dirstat_min_interval": "1.000000", 2026-02-26T03:15:58.251 INFO:teuthology.orchestra.run.trial086.stdout: "mds_dump_cache_after_rejoin": "false", 2026-02-26T03:15:58.251 INFO:teuthology.orchestra.run.trial086.stdout: "mds_dump_cache_on_map": "false", 2026-02-26T03:15:58.251 INFO:teuthology.orchestra.run.trial086.stdout: "mds_dump_cache_threshold_file": "0", 2026-02-26T03:15:58.251 INFO:teuthology.orchestra.run.trial086.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2026-02-26T03:15:58.252 INFO:teuthology.orchestra.run.trial086.stdout: "mds_early_reply": "true", 2026-02-26T03:15:58.252 INFO:teuthology.orchestra.run.trial086.stdout: "mds_enable_op_tracker": "true", 2026-02-26T03:15:58.252 INFO:teuthology.orchestra.run.trial086.stdout: "mds_enforce_unique_name": "true", 2026-02-26T03:15:58.252 INFO:teuthology.orchestra.run.trial086.stdout: "mds_export_ephemeral_distributed": "true", 2026-02-26T03:15:58.252 INFO:teuthology.orchestra.run.trial086.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2026-02-26T03:15:58.252 INFO:teuthology.orchestra.run.trial086.stdout: "mds_export_ephemeral_random": "true", 2026-02-26T03:15:58.252 INFO:teuthology.orchestra.run.trial086.stdout: "mds_export_ephemeral_random_max": "0.010000", 2026-02-26T03:15:58.252 INFO:teuthology.orchestra.run.trial086.stdout: "mds_extraordinary_events_dump_interval": "0", 2026-02-26T03:15:58.252 INFO:teuthology.orchestra.run.trial086.stdout: "mds_file_blockdiff_max_concurrent_object_scans": "16", 2026-02-26T03:15:58.252 INFO:teuthology.orchestra.run.trial086.stdout: "mds_forward_all_requests_to_auth": "false", 2026-02-26T03:15:58.252 INFO:teuthology.orchestra.run.trial086.stdout: "mds_freeze_tree_timeout": "30.000000", 2026-02-26T03:15:58.252 INFO:teuthology.orchestra.run.trial086.stdout: "mds_fscrypt_last_block_max_size": "4096", 2026-02-26T03:15:58.252 INFO:teuthology.orchestra.run.trial086.stdout: "mds_go_bad_corrupt_dentry": "true", 2026-02-26T03:15:58.252 INFO:teuthology.orchestra.run.trial086.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2026-02-26T03:15:58.252 INFO:teuthology.orchestra.run.trial086.stdout: "mds_health_cache_threshold": "1.500000", 2026-02-26T03:15:58.252 INFO:teuthology.orchestra.run.trial086.stdout: "mds_health_summarize_threshold": "10", 2026-02-26T03:15:58.252 INFO:teuthology.orchestra.run.trial086.stdout: "mds_heartbeat_grace": "15.000000", 2026-02-26T03:15:58.252 INFO:teuthology.orchestra.run.trial086.stdout: "mds_heartbeat_reset_grace": "1000", 2026-02-26T03:15:58.252 INFO:teuthology.orchestra.run.trial086.stdout: "mds_inject_health_dummy": "false", 2026-02-26T03:15:58.252 INFO:teuthology.orchestra.run.trial086.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2026-02-26T03:15:58.252 INFO:teuthology.orchestra.run.trial086.stdout: "mds_inject_migrator_session_race": "false", 2026-02-26T03:15:58.253 INFO:teuthology.orchestra.run.trial086.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2026-02-26T03:15:58.253 INFO:teuthology.orchestra.run.trial086.stdout: "mds_inject_skip_replaying_inotable": "false", 2026-02-26T03:15:58.253 INFO:teuthology.orchestra.run.trial086.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2026-02-26T03:15:58.253 INFO:teuthology.orchestra.run.trial086.stdout: "mds_join_fs": "", 2026-02-26T03:15:58.253 INFO:teuthology.orchestra.run.trial086.stdout: "mds_journal_format": "1", 2026-02-26T03:15:58.253 INFO:teuthology.orchestra.run.trial086.stdout: "mds_kill_after_journal_logs_flushed": "false", 2026-02-26T03:15:58.253 INFO:teuthology.orchestra.run.trial086.stdout: "mds_kill_create_at": "0", 2026-02-26T03:15:58.253 INFO:teuthology.orchestra.run.trial086.stdout: "mds_kill_dirfrag_at": "0", 2026-02-26T03:15:58.253 INFO:teuthology.orchestra.run.trial086.stdout: "mds_kill_export_at": "0", 2026-02-26T03:15:58.253 INFO:teuthology.orchestra.run.trial086.stdout: "mds_kill_import_at": "0", 2026-02-26T03:15:58.253 INFO:teuthology.orchestra.run.trial086.stdout: "mds_kill_journal_at": "0", 2026-02-26T03:15:58.253 INFO:teuthology.orchestra.run.trial086.stdout: "mds_kill_journal_expire_at": "0", 2026-02-26T03:15:58.253 INFO:teuthology.orchestra.run.trial086.stdout: "mds_kill_journal_replay_at": "0", 2026-02-26T03:15:58.253 INFO:teuthology.orchestra.run.trial086.stdout: "mds_kill_link_at": "0", 2026-02-26T03:15:58.253 INFO:teuthology.orchestra.run.trial086.stdout: "mds_kill_mdstable_at": "0", 2026-02-26T03:15:58.253 INFO:teuthology.orchestra.run.trial086.stdout: "mds_kill_openc_at": "0", 2026-02-26T03:15:58.253 INFO:teuthology.orchestra.run.trial086.stdout: "mds_kill_rename_at": "0", 2026-02-26T03:15:58.253 INFO:teuthology.orchestra.run.trial086.stdout: "mds_kill_shutdown_at": "0", 2026-02-26T03:15:58.253 INFO:teuthology.orchestra.run.trial086.stdout: "mds_log_event_large_threshold": "524288", 2026-02-26T03:15:58.253 INFO:teuthology.orchestra.run.trial086.stdout: "mds_log_events_per_segment": "1024", 2026-02-26T03:15:58.253 INFO:teuthology.orchestra.run.trial086.stdout: "mds_log_max_events": "-1", 2026-02-26T03:15:58.253 INFO:teuthology.orchestra.run.trial086.stdout: "mds_log_max_segments": "128", 2026-02-26T03:15:58.253 INFO:teuthology.orchestra.run.trial086.stdout: "mds_log_minor_segments_per_major_segment": "16", 2026-02-26T03:15:58.254 INFO:teuthology.orchestra.run.trial086.stdout: "mds_log_pause": "false", 2026-02-26T03:15:58.254 INFO:teuthology.orchestra.run.trial086.stdout: "mds_log_segment_size": "0", 2026-02-26T03:15:58.254 INFO:teuthology.orchestra.run.trial086.stdout: "mds_log_skip_corrupt_events": "false", 2026-02-26T03:15:58.254 INFO:teuthology.orchestra.run.trial086.stdout: "mds_log_skip_unbounded_events": "false", 2026-02-26T03:15:58.254 INFO:teuthology.orchestra.run.trial086.stdout: "mds_log_trim_decay_rate": "1.000000", 2026-02-26T03:15:58.254 INFO:teuthology.orchestra.run.trial086.stdout: "mds_log_trim_threshold": "128", 2026-02-26T03:15:58.254 INFO:teuthology.orchestra.run.trial086.stdout: "mds_log_trim_upkeep_interval": "1000", 2026-02-26T03:15:58.254 INFO:teuthology.orchestra.run.trial086.stdout: "mds_log_warn_factor": "2.000000", 2026-02-26T03:15:58.254 INFO:teuthology.orchestra.run.trial086.stdout: "mds_max_caps_per_client": "1048576", 2026-02-26T03:15:58.254 INFO:teuthology.orchestra.run.trial086.stdout: "mds_max_completed_flushes": "100000", 2026-02-26T03:15:58.254 INFO:teuthology.orchestra.run.trial086.stdout: "mds_max_completed_requests": "100000", 2026-02-26T03:15:58.254 INFO:teuthology.orchestra.run.trial086.stdout: "mds_max_export_size": "20971520", 2026-02-26T03:15:58.254 INFO:teuthology.orchestra.run.trial086.stdout: "mds_max_file_recover": "32", 2026-02-26T03:15:58.254 INFO:teuthology.orchestra.run.trial086.stdout: "mds_max_purge_files": "64", 2026-02-26T03:15:58.254 INFO:teuthology.orchestra.run.trial086.stdout: "mds_max_purge_ops": "8192", 2026-02-26T03:15:58.254 INFO:teuthology.orchestra.run.trial086.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2026-02-26T03:15:58.254 INFO:teuthology.orchestra.run.trial086.stdout: "mds_max_scrub_ops_in_progress": "5", 2026-02-26T03:15:58.254 INFO:teuthology.orchestra.run.trial086.stdout: "mds_max_snaps_per_dir": "100", 2026-02-26T03:15:58.254 INFO:teuthology.orchestra.run.trial086.stdout: "mds_metrics_update_interval": "2", 2026-02-26T03:15:58.254 INFO:teuthology.orchestra.run.trial086.stdout: "mds_min_caps_per_client": "100", 2026-02-26T03:15:58.254 INFO:teuthology.orchestra.run.trial086.stdout: "mds_min_caps_working_set": "10000", 2026-02-26T03:15:58.255 INFO:teuthology.orchestra.run.trial086.stdout: "mds_mon_shutdown_timeout": "5.000000", 2026-02-26T03:15:58.255 INFO:teuthology.orchestra.run.trial086.stdout: "mds_numa_node": "-1", 2026-02-26T03:15:58.255 INFO:teuthology.orchestra.run.trial086.stdout: "mds_oft_prefetch_dirfrags": "false", 2026-02-26T03:15:58.255 INFO:teuthology.orchestra.run.trial086.stdout: "mds_op_complaint_time": "30.000000", 2026-02-26T03:15:58.255 INFO:teuthology.orchestra.run.trial086.stdout: "mds_op_history_duration": "600", 2026-02-26T03:15:58.255 INFO:teuthology.orchestra.run.trial086.stdout: "mds_op_history_size": "20", 2026-02-26T03:15:58.255 INFO:teuthology.orchestra.run.trial086.stdout: "mds_op_history_slow_op_size": "20", 2026-02-26T03:15:58.255 INFO:teuthology.orchestra.run.trial086.stdout: "mds_op_history_slow_op_threshold": "10", 2026-02-26T03:15:58.255 INFO:teuthology.orchestra.run.trial086.stdout: "mds_op_log_threshold": "5", 2026-02-26T03:15:58.255 INFO:teuthology.orchestra.run.trial086.stdout: "mds_ping_grace": "15", 2026-02-26T03:15:58.255 INFO:teuthology.orchestra.run.trial086.stdout: "mds_ping_interval": "5", 2026-02-26T03:15:58.255 INFO:teuthology.orchestra.run.trial086.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2026-02-26T03:15:58.255 INFO:teuthology.orchestra.run.trial086.stdout: "mds_recall_global_max_decay_threshold": "131072", 2026-02-26T03:15:58.255 INFO:teuthology.orchestra.run.trial086.stdout: "mds_recall_max_caps": "30000", 2026-02-26T03:15:58.255 INFO:teuthology.orchestra.run.trial086.stdout: "mds_recall_max_decay_rate": "1.500000", 2026-02-26T03:15:58.255 INFO:teuthology.orchestra.run.trial086.stdout: "mds_recall_max_decay_threshold": "131072", 2026-02-26T03:15:58.255 INFO:teuthology.orchestra.run.trial086.stdout: "mds_recall_warning_decay_rate": "60.000000", 2026-02-26T03:15:58.256 INFO:teuthology.orchestra.run.trial086.stdout: "mds_recall_warning_threshold": "262144", 2026-02-26T03:15:58.256 INFO:teuthology.orchestra.run.trial086.stdout: "mds_reconnect_timeout": "45.000000", 2026-02-26T03:15:58.256 INFO:teuthology.orchestra.run.trial086.stdout: "mds_replay_interval": "1.000000", 2026-02-26T03:15:58.256 INFO:teuthology.orchestra.run.trial086.stdout: "mds_replay_unsafe_with_closed_session": "false", 2026-02-26T03:15:58.256 INFO:teuthology.orchestra.run.trial086.stdout: "mds_request_load_average_decay_rate": "60.000000", 2026-02-26T03:15:58.256 INFO:teuthology.orchestra.run.trial086.stdout: "mds_root_ino_gid": "0", 2026-02-26T03:15:58.256 INFO:teuthology.orchestra.run.trial086.stdout: "mds_root_ino_uid": "0", 2026-02-26T03:15:58.256 INFO:teuthology.orchestra.run.trial086.stdout: "mds_scatter_nudge_interval": "5.000000", 2026-02-26T03:15:58.256 INFO:teuthology.orchestra.run.trial086.stdout: "mds_scrub_stats_review_period": "1", 2026-02-26T03:15:58.256 INFO:teuthology.orchestra.run.trial086.stdout: "mds_server_dispatch_client_request_delay": "0", 2026-02-26T03:15:58.256 INFO:teuthology.orchestra.run.trial086.stdout: "mds_server_dispatch_killpoint_random": "0.000000", 2026-02-26T03:15:58.256 INFO:teuthology.orchestra.run.trial086.stdout: "mds_session_blocklist_on_evict": "true", 2026-02-26T03:15:58.256 INFO:teuthology.orchestra.run.trial086.stdout: "mds_session_blocklist_on_timeout": "true", 2026-02-26T03:15:58.256 INFO:teuthology.orchestra.run.trial086.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2026-02-26T03:15:58.256 INFO:teuthology.orchestra.run.trial086.stdout: "mds_session_cache_liveness_magnitude": "10", 2026-02-26T03:15:58.256 INFO:teuthology.orchestra.run.trial086.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2026-02-26T03:15:58.256 INFO:teuthology.orchestra.run.trial086.stdout: "mds_session_cap_acquisition_throttle": "100000", 2026-02-26T03:15:58.256 INFO:teuthology.orchestra.run.trial086.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2026-02-26T03:15:58.256 INFO:teuthology.orchestra.run.trial086.stdout: "mds_session_metadata_threshold": "16777216", 2026-02-26T03:15:58.256 INFO:teuthology.orchestra.run.trial086.stdout: "mds_sessionmap_keys_per_op": "1024", 2026-02-26T03:15:58.256 INFO:teuthology.orchestra.run.trial086.stdout: "mds_shutdown_check": "0", 2026-02-26T03:15:58.257 INFO:teuthology.orchestra.run.trial086.stdout: "mds_skip_ino": "0", 2026-02-26T03:15:58.257 INFO:teuthology.orchestra.run.trial086.stdout: "mds_sleep_rank_change": "0.000000", 2026-02-26T03:15:58.257 INFO:teuthology.orchestra.run.trial086.stdout: "mds_snap_max_uid": "4294967294", 2026-02-26T03:15:58.257 INFO:teuthology.orchestra.run.trial086.stdout: "mds_snap_min_uid": "0", 2026-02-26T03:15:58.257 INFO:teuthology.orchestra.run.trial086.stdout: "mds_snap_rstat": "false", 2026-02-26T03:15:58.257 INFO:teuthology.orchestra.run.trial086.stdout: "mds_standby_replay_damaged": "false", 2026-02-26T03:15:58.257 INFO:teuthology.orchestra.run.trial086.stdout: "mds_symlink_recovery": "true", 2026-02-26T03:15:58.257 INFO:teuthology.orchestra.run.trial086.stdout: "mds_task_status_update_interval": "2.000000", 2026-02-26T03:15:58.257 INFO:teuthology.orchestra.run.trial086.stdout: "mds_thrash_exports": "0", 2026-02-26T03:15:58.257 INFO:teuthology.orchestra.run.trial086.stdout: "mds_thrash_fragments": "0", 2026-02-26T03:15:58.257 INFO:teuthology.orchestra.run.trial086.stdout: "mds_tick_interval": "5.000000", 2026-02-26T03:15:58.257 INFO:teuthology.orchestra.run.trial086.stdout: "mds_use_global_snaprealm_seq_for_subvol": "true", 2026-02-26T03:15:58.257 INFO:teuthology.orchestra.run.trial086.stdout: "mds_valgrind_exit": "false", 2026-02-26T03:15:58.257 INFO:teuthology.orchestra.run.trial086.stdout: "mds_verify_backtrace": "1", 2026-02-26T03:15:58.257 INFO:teuthology.orchestra.run.trial086.stdout: "mds_verify_scatter": "false", 2026-02-26T03:15:58.257 INFO:teuthology.orchestra.run.trial086.stdout: "mds_wipe_ino_prealloc": "false", 2026-02-26T03:15:58.257 INFO:teuthology.orchestra.run.trial086.stdout: "mds_wipe_sessions": "false", 2026-02-26T03:15:58.257 INFO:teuthology.orchestra.run.trial086.stdout: "mempool_debug": "false", 2026-02-26T03:15:58.257 INFO:teuthology.orchestra.run.trial086.stdout: "memstore_debug_omit_block_device_write": "false", 2026-02-26T03:15:58.257 INFO:teuthology.orchestra.run.trial086.stdout: "memstore_device_bytes": "1073741824", 2026-02-26T03:15:58.257 INFO:teuthology.orchestra.run.trial086.stdout: "memstore_page_set": "false", 2026-02-26T03:15:58.257 INFO:teuthology.orchestra.run.trial086.stdout: "memstore_page_size": "65536", 2026-02-26T03:15:58.258 INFO:teuthology.orchestra.run.trial086.stdout: "mgr_client_bytes": "134217728", 2026-02-26T03:15:58.258 INFO:teuthology.orchestra.run.trial086.stdout: "mgr_client_messages": "512", 2026-02-26T03:15:58.258 INFO:teuthology.orchestra.run.trial086.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2026-02-26T03:15:58.258 INFO:teuthology.orchestra.run.trial086.stdout: "mgr_connect_retry_interval": "1.000000", 2026-02-26T03:15:58.258 INFO:teuthology.orchestra.run.trial086.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-0", 2026-02-26T03:15:58.258 INFO:teuthology.orchestra.run.trial086.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2026-02-26T03:15:58.258 INFO:teuthology.orchestra.run.trial086.stdout: "mgr_disabled_modules": "", 2026-02-26T03:15:58.258 INFO:teuthology.orchestra.run.trial086.stdout: "mgr_enable_op_tracker": "true", 2026-02-26T03:15:58.258 INFO:teuthology.orchestra.run.trial086.stdout: "mgr_initial_modules": "iostat nfs", 2026-02-26T03:15:58.258 INFO:teuthology.orchestra.run.trial086.stdout: "mgr_max_pg_creating": "1024", 2026-02-26T03:15:58.258 INFO:teuthology.orchestra.run.trial086.stdout: "mgr_max_pg_num_change": "128", 2026-02-26T03:15:58.258 INFO:teuthology.orchestra.run.trial086.stdout: "mgr_mds_bytes": "134217728", 2026-02-26T03:15:58.258 INFO:teuthology.orchestra.run.trial086.stdout: "mgr_mds_messages": "128", 2026-02-26T03:15:58.258 INFO:teuthology.orchestra.run.trial086.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2026-02-26T03:15:58.258 INFO:teuthology.orchestra.run.trial086.stdout: "mgr_mon_bytes": "134217728", 2026-02-26T03:15:58.258 INFO:teuthology.orchestra.run.trial086.stdout: "mgr_mon_messages": "128", 2026-02-26T03:15:58.258 INFO:teuthology.orchestra.run.trial086.stdout: "mgr_num_op_tracker_shard": "32", 2026-02-26T03:15:58.258 INFO:teuthology.orchestra.run.trial086.stdout: "mgr_op_complaint_time": "30.000000", 2026-02-26T03:15:58.258 INFO:teuthology.orchestra.run.trial086.stdout: "mgr_op_history_duration": "600", 2026-02-26T03:15:58.258 INFO:teuthology.orchestra.run.trial086.stdout: "mgr_op_history_size": "20", 2026-02-26T03:15:58.258 INFO:teuthology.orchestra.run.trial086.stdout: "mgr_op_history_slow_op_size": "20", 2026-02-26T03:15:58.258 INFO:teuthology.orchestra.run.trial086.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2026-02-26T03:15:58.258 INFO:teuthology.orchestra.run.trial086.stdout: "mgr_op_log_threshold": "5", 2026-02-26T03:15:58.258 INFO:teuthology.orchestra.run.trial086.stdout: "mgr_osd_bytes": "536870912", 2026-02-26T03:15:58.259 INFO:teuthology.orchestra.run.trial086.stdout: "mgr_osd_messages": "8192", 2026-02-26T03:15:58.259 INFO:teuthology.orchestra.run.trial086.stdout: "mgr_pool": "true", 2026-02-26T03:15:58.259 INFO:teuthology.orchestra.run.trial086.stdout: "mgr_service_beacon_grace": "60.000000", 2026-02-26T03:15:58.259 INFO:teuthology.orchestra.run.trial086.stdout: "mgr_standby_modules": "true", 2026-02-26T03:15:58.259 INFO:teuthology.orchestra.run.trial086.stdout: "mgr_stats_period": "5", 2026-02-26T03:15:58.259 INFO:teuthology.orchestra.run.trial086.stdout: "mgr_stats_threshold": "5", 2026-02-26T03:15:58.259 INFO:teuthology.orchestra.run.trial086.stdout: "mgr_tick_period": "2", 2026-02-26T03:15:58.259 INFO:teuthology.orchestra.run.trial086.stdout: "mgr_ttl_cache_expire_seconds": "0", 2026-02-26T03:15:58.259 INFO:teuthology.orchestra.run.trial086.stdout: "mon_accept_timeout_factor": "2.000000", 2026-02-26T03:15:58.259 INFO:teuthology.orchestra.run.trial086.stdout: "mon_allow_pool_delete": "true", 2026-02-26T03:15:58.259 INFO:teuthology.orchestra.run.trial086.stdout: "mon_allow_pool_size_one": "true", 2026-02-26T03:15:58.259 INFO:teuthology.orchestra.run.trial086.stdout: "mon_auth_validate_all_caps": "true", 2026-02-26T03:15:58.259 INFO:teuthology.orchestra.run.trial086.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2026-02-26T03:15:58.259 INFO:teuthology.orchestra.run.trial086.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2026-02-26T03:15:58.259 INFO:teuthology.orchestra.run.trial086.stdout: "mon_client_bytes": "104857600", 2026-02-26T03:15:58.259 INFO:teuthology.orchestra.run.trial086.stdout: "mon_client_directed_command_retry": "2", 2026-02-26T03:15:58.259 INFO:teuthology.orchestra.run.trial086.stdout: "mon_client_hunt_interval": "3.000000", 2026-02-26T03:15:58.259 INFO:teuthology.orchestra.run.trial086.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2026-02-26T03:15:58.259 INFO:teuthology.orchestra.run.trial086.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2026-02-26T03:15:58.259 INFO:teuthology.orchestra.run.trial086.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2026-02-26T03:15:58.259 INFO:teuthology.orchestra.run.trial086.stdout: "mon_client_hunt_on_resend": "true", 2026-02-26T03:15:58.259 INFO:teuthology.orchestra.run.trial086.stdout: "mon_client_hunt_parallel": "3", 2026-02-26T03:15:58.259 INFO:teuthology.orchestra.run.trial086.stdout: "mon_client_log_interval": "1.000000", 2026-02-26T03:15:58.259 INFO:teuthology.orchestra.run.trial086.stdout: "mon_client_max_log_entries_per_message": "1000", 2026-02-26T03:15:58.260 INFO:teuthology.orchestra.run.trial086.stdout: "mon_client_ping_interval": "10.000000", 2026-02-26T03:15:58.260 INFO:teuthology.orchestra.run.trial086.stdout: "mon_client_ping_timeout": "30.000000", 2026-02-26T03:15:58.260 INFO:teuthology.orchestra.run.trial086.stdout: "mon_client_target_rank": "-1", 2026-02-26T03:15:58.260 INFO:teuthology.orchestra.run.trial086.stdout: "mon_clock_drift_allowed": "1.000000", 2026-02-26T03:15:58.260 INFO:teuthology.orchestra.run.trial086.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2026-02-26T03:15:58.260 INFO:teuthology.orchestra.run.trial086.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2026-02-26T03:15:58.260 INFO:teuthology.orchestra.run.trial086.stdout: "mon_cluster_log_level": "debug", 2026-02-26T03:15:58.260 INFO:teuthology.orchestra.run.trial086.stdout: "mon_cluster_log_to_file": "true", 2026-02-26T03:15:58.260 INFO:teuthology.orchestra.run.trial086.stdout: "mon_cluster_log_to_graylog": "false", 2026-02-26T03:15:58.260 INFO:teuthology.orchestra.run.trial086.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2026-02-26T03:15:58.260 INFO:teuthology.orchestra.run.trial086.stdout: "mon_cluster_log_to_graylog_port": "12201", 2026-02-26T03:15:58.260 INFO:teuthology.orchestra.run.trial086.stdout: "mon_cluster_log_to_journald": "false", 2026-02-26T03:15:58.260 INFO:teuthology.orchestra.run.trial086.stdout: "mon_cluster_log_to_stderr": "false", 2026-02-26T03:15:58.260 INFO:teuthology.orchestra.run.trial086.stdout: "mon_cluster_log_to_syslog": "default=false", 2026-02-26T03:15:58.260 INFO:teuthology.orchestra.run.trial086.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2026-02-26T03:15:58.260 INFO:teuthology.orchestra.run.trial086.stdout: "mon_compact_on_bootstrap": "false", 2026-02-26T03:15:58.260 INFO:teuthology.orchestra.run.trial086.stdout: "mon_compact_on_start": "false", 2026-02-26T03:15:58.260 INFO:teuthology.orchestra.run.trial086.stdout: "mon_compact_on_trim": "true", 2026-02-26T03:15:58.260 INFO:teuthology.orchestra.run.trial086.stdout: "mon_con_tracker_persist_interval": "10", 2026-02-26T03:15:58.260 INFO:teuthology.orchestra.run.trial086.stdout: "mon_con_tracker_score_halflife": "43200", 2026-02-26T03:15:58.260 INFO:teuthology.orchestra.run.trial086.stdout: "mon_config_key_max_entry_size": "65536", 2026-02-26T03:15:58.260 INFO:teuthology.orchestra.run.trial086.stdout: "mon_cpu_threads": "4", 2026-02-26T03:15:58.260 INFO:teuthology.orchestra.run.trial086.stdout: "mon_crush_min_required_version": "hammer", 2026-02-26T03:15:58.260 INFO:teuthology.orchestra.run.trial086.stdout: "mon_daemon_bytes": "419430400", 2026-02-26T03:15:58.260 INFO:teuthology.orchestra.run.trial086.stdout: "mon_data": "/var/lib/ceph/mon/ceph-0", 2026-02-26T03:15:58.260 INFO:teuthology.orchestra.run.trial086.stdout: "mon_data_avail_crit": "5", 2026-02-26T03:15:58.261 INFO:teuthology.orchestra.run.trial086.stdout: "mon_data_avail_warn": "30", 2026-02-26T03:15:58.261 INFO:teuthology.orchestra.run.trial086.stdout: "mon_data_size_warn": "16106127360", 2026-02-26T03:15:58.261 INFO:teuthology.orchestra.run.trial086.stdout: "mon_debug_block_osdmap_trim": "false", 2026-02-26T03:15:58.261 INFO:teuthology.orchestra.run.trial086.stdout: "mon_debug_deprecated_as_obsolete": "false", 2026-02-26T03:15:58.261 INFO:teuthology.orchestra.run.trial086.stdout: "mon_debug_dump_json": "false", 2026-02-26T03:15:58.261 INFO:teuthology.orchestra.run.trial086.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-osd.0.tdump", 2026-02-26T03:15:58.261 INFO:teuthology.orchestra.run.trial086.stdout: "mon_debug_dump_transactions": "false", 2026-02-26T03:15:58.261 INFO:teuthology.orchestra.run.trial086.stdout: "mon_debug_extra_checks": "false", 2026-02-26T03:15:58.261 INFO:teuthology.orchestra.run.trial086.stdout: "mon_debug_no_initial_persistent_features": "false", 2026-02-26T03:15:58.261 INFO:teuthology.orchestra.run.trial086.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2026-02-26T03:15:58.261 INFO:teuthology.orchestra.run.trial086.stdout: "mon_debug_no_require_squid": "false", 2026-02-26T03:15:58.261 INFO:teuthology.orchestra.run.trial086.stdout: "mon_debug_no_require_tentacle": "false", 2026-02-26T03:15:58.261 INFO:teuthology.orchestra.run.trial086.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2026-02-26T03:15:58.261 INFO:teuthology.orchestra.run.trial086.stdout: "mon_delta_reset_interval": "10.000000", 2026-02-26T03:15:58.261 INFO:teuthology.orchestra.run.trial086.stdout: "mon_dns_srv_name": "ceph-mon", 2026-02-26T03:15:58.261 INFO:teuthology.orchestra.run.trial086.stdout: "mon_down_added_grace": "180", 2026-02-26T03:15:58.261 INFO:teuthology.orchestra.run.trial086.stdout: "mon_down_mkfs_grace": "60", 2026-02-26T03:15:58.261 INFO:teuthology.orchestra.run.trial086.stdout: "mon_down_uptime_grace": "60", 2026-02-26T03:15:58.261 INFO:teuthology.orchestra.run.trial086.stdout: "mon_election_default_strategy": "1", 2026-02-26T03:15:58.261 INFO:teuthology.orchestra.run.trial086.stdout: "mon_election_timeout": "5.000000", 2026-02-26T03:15:58.261 INFO:teuthology.orchestra.run.trial086.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2026-02-26T03:15:58.261 INFO:teuthology.orchestra.run.trial086.stdout: "mon_elector_ping_divisor": "2", 2026-02-26T03:15:58.261 INFO:teuthology.orchestra.run.trial086.stdout: "mon_elector_ping_timeout": "2.000000", 2026-02-26T03:15:58.261 INFO:teuthology.orchestra.run.trial086.stdout: "mon_enable_op_tracker": "true", 2026-02-26T03:15:58.261 INFO:teuthology.orchestra.run.trial086.stdout: "mon_fake_pool_delete": "false", 2026-02-26T03:15:58.261 INFO:teuthology.orchestra.run.trial086.stdout: "mon_force_quorum_join": "false", 2026-02-26T03:15:58.261 INFO:teuthology.orchestra.run.trial086.stdout: "mon_fsmap_prune_threshold": "300", 2026-02-26T03:15:58.262 INFO:teuthology.orchestra.run.trial086.stdout: "mon_globalid_prealloc": "10000", 2026-02-26T03:15:58.262 INFO:teuthology.orchestra.run.trial086.stdout: "mon_health_detail_to_clog": "false", 2026-02-26T03:15:58.262 INFO:teuthology.orchestra.run.trial086.stdout: "mon_health_log_update_period": "5", 2026-02-26T03:15:58.262 INFO:teuthology.orchestra.run.trial086.stdout: "mon_health_max_detail": "50", 2026-02-26T03:15:58.262 INFO:teuthology.orchestra.run.trial086.stdout: "mon_health_to_clog": "true", 2026-02-26T03:15:58.262 INFO:teuthology.orchestra.run.trial086.stdout: "mon_health_to_clog_interval": "600", 2026-02-26T03:15:58.262 INFO:teuthology.orchestra.run.trial086.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2026-02-26T03:15:58.262 INFO:teuthology.orchestra.run.trial086.stdout: "mon_host": "10.20.193.86", 2026-02-26T03:15:58.262 INFO:teuthology.orchestra.run.trial086.stdout: "mon_host_override": "", 2026-02-26T03:15:58.262 INFO:teuthology.orchestra.run.trial086.stdout: "mon_initial_members": "", 2026-02-26T03:15:58.262 INFO:teuthology.orchestra.run.trial086.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2026-02-26T03:15:58.262 INFO:teuthology.orchestra.run.trial086.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2026-02-26T03:15:58.262 INFO:teuthology.orchestra.run.trial086.stdout: "mon_inject_transaction_delay_max": "10.000000", 2026-02-26T03:15:58.262 INFO:teuthology.orchestra.run.trial086.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2026-02-26T03:15:58.262 INFO:teuthology.orchestra.run.trial086.stdout: "mon_keyvaluedb": "rocksdb", 2026-02-26T03:15:58.262 INFO:teuthology.orchestra.run.trial086.stdout: "mon_lease": "5.000000", 2026-02-26T03:15:58.262 INFO:teuthology.orchestra.run.trial086.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2026-02-26T03:15:58.262 INFO:teuthology.orchestra.run.trial086.stdout: "mon_lease_renew_interval_factor": "0.600000", 2026-02-26T03:15:58.262 INFO:teuthology.orchestra.run.trial086.stdout: "mon_log_full_interval": "50", 2026-02-26T03:15:58.262 INFO:teuthology.orchestra.run.trial086.stdout: "mon_log_max": "10000", 2026-02-26T03:15:58.262 INFO:teuthology.orchestra.run.trial086.stdout: "mon_log_max_summary": "50", 2026-02-26T03:15:58.262 INFO:teuthology.orchestra.run.trial086.stdout: "mon_max_log_entries_per_event": "4096", 2026-02-26T03:15:58.262 INFO:teuthology.orchestra.run.trial086.stdout: "mon_max_log_epochs": "500", 2026-02-26T03:15:58.262 INFO:teuthology.orchestra.run.trial086.stdout: "mon_max_mdsmap_epochs": "500", 2026-02-26T03:15:58.262 INFO:teuthology.orchestra.run.trial086.stdout: "mon_max_mgrmap_epochs": "500", 2026-02-26T03:15:58.263 INFO:teuthology.orchestra.run.trial086.stdout: "mon_max_nvmeof_epochs": "500", 2026-02-26T03:15:58.263 INFO:teuthology.orchestra.run.trial086.stdout: "mon_max_osd": "10000", 2026-02-26T03:15:58.263 INFO:teuthology.orchestra.run.trial086.stdout: "mon_max_pg_per_osd": "10000", 2026-02-26T03:15:58.263 INFO:teuthology.orchestra.run.trial086.stdout: "mon_max_pool_pg_num": "65536", 2026-02-26T03:15:58.263 INFO:teuthology.orchestra.run.trial086.stdout: "mon_max_snap_prune_per_epoch": "100", 2026-02-26T03:15:58.263 INFO:teuthology.orchestra.run.trial086.stdout: "mon_mds_blocklist_interval": "86400.000000", 2026-02-26T03:15:58.263 INFO:teuthology.orchestra.run.trial086.stdout: "mon_mds_force_trim_to": "0", 2026-02-26T03:15:58.263 INFO:teuthology.orchestra.run.trial086.stdout: "mon_mds_skip_sanity": "false", 2026-02-26T03:15:58.263 INFO:teuthology.orchestra.run.trial086.stdout: "mon_memory_autotune": "true", 2026-02-26T03:15:58.263 INFO:teuthology.orchestra.run.trial086.stdout: "mon_memory_target": "2147483648", 2026-02-26T03:15:58.263 INFO:teuthology.orchestra.run.trial086.stdout: "mon_mgr_beacon_grace": "30", 2026-02-26T03:15:58.263 INFO:teuthology.orchestra.run.trial086.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2026-02-26T03:15:58.263 INFO:teuthology.orchestra.run.trial086.stdout: "mon_mgr_digest_period": "5", 2026-02-26T03:15:58.263 INFO:teuthology.orchestra.run.trial086.stdout: "mon_mgr_inactive_grace": "60", 2026-02-26T03:15:58.263 INFO:teuthology.orchestra.run.trial086.stdout: "mon_mgr_mkfs_grace": "120", 2026-02-26T03:15:58.263 INFO:teuthology.orchestra.run.trial086.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2026-02-26T03:15:58.263 INFO:teuthology.orchestra.run.trial086.stdout: "mon_min_osdmap_epochs": "500", 2026-02-26T03:15:58.263 INFO:teuthology.orchestra.run.trial086.stdout: "mon_netsplit_grace_period": "9", 2026-02-26T03:15:58.263 INFO:teuthology.orchestra.run.trial086.stdout: "mon_nvmeofgw_beacon_grace": "7", 2026-02-26T03:15:58.263 INFO:teuthology.orchestra.run.trial086.stdout: "mon_nvmeofgw_beacons_till_ack": "15", 2026-02-26T03:15:58.263 INFO:teuthology.orchestra.run.trial086.stdout: "mon_nvmeofgw_delete_grace": "900", 2026-02-26T03:15:58.263 INFO:teuthology.orchestra.run.trial086.stdout: "mon_nvmeofgw_set_group_id_retry": "1000", 2026-02-26T03:15:58.263 INFO:teuthology.orchestra.run.trial086.stdout: "mon_nvmeofgw_skip_failovers_interval": "16", 2026-02-26T03:15:58.263 INFO:teuthology.orchestra.run.trial086.stdout: "mon_nvmeofgw_wrong_map_ignore_sec": "15", 2026-02-26T03:15:58.263 INFO:teuthology.orchestra.run.trial086.stdout: "mon_op_complaint_time": "30", 2026-02-26T03:15:58.263 INFO:teuthology.orchestra.run.trial086.stdout: "mon_op_history_duration": "600", 2026-02-26T03:15:58.263 INFO:teuthology.orchestra.run.trial086.stdout: "mon_op_history_size": "20", 2026-02-26T03:15:58.264 INFO:teuthology.orchestra.run.trial086.stdout: "mon_op_history_slow_op_size": "20", 2026-02-26T03:15:58.264 INFO:teuthology.orchestra.run.trial086.stdout: "mon_op_history_slow_op_threshold": "10", 2026-02-26T03:15:58.264 INFO:teuthology.orchestra.run.trial086.stdout: "mon_op_log_threshold": "5", 2026-02-26T03:15:58.264 INFO:teuthology.orchestra.run.trial086.stdout: "mon_osd_adjust_down_out_interval": "true", 2026-02-26T03:15:58.264 INFO:teuthology.orchestra.run.trial086.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2026-02-26T03:15:58.264 INFO:teuthology.orchestra.run.trial086.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2026-02-26T03:15:58.264 INFO:teuthology.orchestra.run.trial086.stdout: "mon_osd_auto_mark_in": "false", 2026-02-26T03:15:58.264 INFO:teuthology.orchestra.run.trial086.stdout: "mon_osd_auto_mark_new_in": "true", 2026-02-26T03:15:58.264 INFO:teuthology.orchestra.run.trial086.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2026-02-26T03:15:58.264 INFO:teuthology.orchestra.run.trial086.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2026-02-26T03:15:58.264 INFO:teuthology.orchestra.run.trial086.stdout: "mon_osd_cache_size": "500", 2026-02-26T03:15:58.264 INFO:teuthology.orchestra.run.trial086.stdout: "mon_osd_cache_size_min": "134217728", 2026-02-26T03:15:58.264 INFO:teuthology.orchestra.run.trial086.stdout: "mon_osd_crush_smoke_test": "true", 2026-02-26T03:15:58.264 INFO:teuthology.orchestra.run.trial086.stdout: "mon_osd_destroyed_out_interval": "600", 2026-02-26T03:15:58.264 INFO:teuthology.orchestra.run.trial086.stdout: "mon_osd_down_out_interval": "600", 2026-02-26T03:15:58.264 INFO:teuthology.orchestra.run.trial086.stdout: "mon_osd_down_out_subtree_limit": "rack", 2026-02-26T03:15:58.264 INFO:teuthology.orchestra.run.trial086.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2026-02-26T03:15:58.264 INFO:teuthology.orchestra.run.trial086.stdout: "mon_osd_force_trim_to": "0", 2026-02-26T03:15:58.264 INFO:teuthology.orchestra.run.trial086.stdout: "mon_osd_full_ratio": "0.950000", 2026-02-26T03:15:58.264 INFO:teuthology.orchestra.run.trial086.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2026-02-26T03:15:58.264 INFO:teuthology.orchestra.run.trial086.stdout: "mon_osd_laggy_halflife": "3600", 2026-02-26T03:15:58.264 INFO:teuthology.orchestra.run.trial086.stdout: "mon_osd_laggy_max_interval": "300", 2026-02-26T03:15:58.264 INFO:teuthology.orchestra.run.trial086.stdout: "mon_osd_laggy_weight": "0.300000", 2026-02-26T03:15:58.264 INFO:teuthology.orchestra.run.trial086.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2026-02-26T03:15:58.264 INFO:teuthology.orchestra.run.trial086.stdout: "mon_osd_max_initial_pgs": "1024", 2026-02-26T03:15:58.264 INFO:teuthology.orchestra.run.trial086.stdout: "mon_osd_min_down_reporters": "2", 2026-02-26T03:15:58.264 INFO:teuthology.orchestra.run.trial086.stdout: "mon_osd_min_in_ratio": "0.750000", 2026-02-26T03:15:58.265 INFO:teuthology.orchestra.run.trial086.stdout: "mon_osd_min_up_ratio": "0.300000", 2026-02-26T03:15:58.265 INFO:teuthology.orchestra.run.trial086.stdout: "mon_osd_nearfull_ratio": "0.850000", 2026-02-26T03:15:58.265 INFO:teuthology.orchestra.run.trial086.stdout: "mon_osd_prime_pg_temp": "true", 2026-02-26T03:15:58.265 INFO:teuthology.orchestra.run.trial086.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2026-02-26T03:15:58.265 INFO:teuthology.orchestra.run.trial086.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2026-02-26T03:15:58.265 INFO:teuthology.orchestra.run.trial086.stdout: "mon_osd_report_timeout": "900", 2026-02-26T03:15:58.265 INFO:teuthology.orchestra.run.trial086.stdout: "mon_osd_reporter_subtree_level": "host", 2026-02-26T03:15:58.265 INFO:teuthology.orchestra.run.trial086.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2026-02-26T03:15:58.265 INFO:teuthology.orchestra.run.trial086.stdout: "mon_osd_warn_num_repaired": "10", 2026-02-26T03:15:58.265 INFO:teuthology.orchestra.run.trial086.stdout: "mon_osd_warn_op_age": "32.000000", 2026-02-26T03:15:58.265 INFO:teuthology.orchestra.run.trial086.stdout: "mon_osdmap_full_prune_enabled": "true", 2026-02-26T03:15:58.265 INFO:teuthology.orchestra.run.trial086.stdout: "mon_osdmap_full_prune_interval": "10", 2026-02-26T03:15:58.265 INFO:teuthology.orchestra.run.trial086.stdout: "mon_osdmap_full_prune_min": "10000", 2026-02-26T03:15:58.265 INFO:teuthology.orchestra.run.trial086.stdout: "mon_osdmap_full_prune_txsize": "100", 2026-02-26T03:15:58.265 INFO:teuthology.orchestra.run.trial086.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2026-02-26T03:15:58.265 INFO:teuthology.orchestra.run.trial086.stdout: "mon_pg_stuck_threshold": "60", 2026-02-26T03:15:58.265 INFO:teuthology.orchestra.run.trial086.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2026-02-26T03:15:58.265 INFO:teuthology.orchestra.run.trial086.stdout: "mon_pg_warn_min_objects": "10000", 2026-02-26T03:15:58.265 INFO:teuthology.orchestra.run.trial086.stdout: "mon_pg_warn_min_per_osd": "0", 2026-02-26T03:15:58.265 INFO:teuthology.orchestra.run.trial086.stdout: "mon_pg_warn_min_pool_objects": "1000", 2026-02-26T03:15:58.265 INFO:teuthology.orchestra.run.trial086.stdout: "mon_pool_quota_crit_threshold": "0", 2026-02-26T03:15:58.265 INFO:teuthology.orchestra.run.trial086.stdout: "mon_pool_quota_warn_threshold": "0", 2026-02-26T03:15:58.265 INFO:teuthology.orchestra.run.trial086.stdout: "mon_probe_timeout": "2.000000", 2026-02-26T03:15:58.266 INFO:teuthology.orchestra.run.trial086.stdout: "mon_reweight_max_change": "0.050000", 2026-02-26T03:15:58.266 INFO:teuthology.orchestra.run.trial086.stdout: "mon_reweight_max_osds": "4", 2026-02-26T03:15:58.266 INFO:teuthology.orchestra.run.trial086.stdout: "mon_reweight_min_bytes_per_osd": "104857600", 2026-02-26T03:15:58.266 INFO:teuthology.orchestra.run.trial086.stdout: "mon_reweight_min_pgs_per_osd": "10", 2026-02-26T03:15:58.266 INFO:teuthology.orchestra.run.trial086.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2026-02-26T03:15:58.266 INFO:teuthology.orchestra.run.trial086.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2026-02-26T03:15:58.266 INFO:teuthology.orchestra.run.trial086.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2026-02-26T03:15:58.266 INFO:teuthology.orchestra.run.trial086.stdout: "mon_scrub_interval": "86400", 2026-02-26T03:15:58.266 INFO:teuthology.orchestra.run.trial086.stdout: "mon_scrub_max_keys": "100", 2026-02-26T03:15:58.266 INFO:teuthology.orchestra.run.trial086.stdout: "mon_scrub_timeout": "300", 2026-02-26T03:15:58.266 INFO:teuthology.orchestra.run.trial086.stdout: "mon_session_timeout": "300", 2026-02-26T03:15:58.266 INFO:teuthology.orchestra.run.trial086.stdout: "mon_smart_report_timeout": "5", 2026-02-26T03:15:58.266 INFO:teuthology.orchestra.run.trial086.stdout: "mon_stat_smooth_intervals": "6", 2026-02-26T03:15:58.266 INFO:teuthology.orchestra.run.trial086.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2026-02-26T03:15:58.266 INFO:teuthology.orchestra.run.trial086.stdout: "mon_stretch_pool_min_size": "2", 2026-02-26T03:15:58.266 INFO:teuthology.orchestra.run.trial086.stdout: "mon_stretch_pool_size": "4", 2026-02-26T03:15:58.266 INFO:teuthology.orchestra.run.trial086.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2026-02-26T03:15:58.266 INFO:teuthology.orchestra.run.trial086.stdout: "mon_subscribe_interval": "86400.000000", 2026-02-26T03:15:58.266 INFO:teuthology.orchestra.run.trial086.stdout: "mon_sync_debug": "false", 2026-02-26T03:15:58.266 INFO:teuthology.orchestra.run.trial086.stdout: "mon_sync_max_payload_keys": "2000", 2026-02-26T03:15:58.266 INFO:teuthology.orchestra.run.trial086.stdout: "mon_sync_max_payload_size": "1048576", 2026-02-26T03:15:58.266 INFO:teuthology.orchestra.run.trial086.stdout: "mon_sync_provider_kill_at": "0", 2026-02-26T03:15:58.266 INFO:teuthology.orchestra.run.trial086.stdout: "mon_sync_requester_kill_at": "0", 2026-02-26T03:15:58.266 INFO:teuthology.orchestra.run.trial086.stdout: "mon_sync_timeout": "60.000000", 2026-02-26T03:15:58.266 INFO:teuthology.orchestra.run.trial086.stdout: "mon_target_pg_per_osd": "100", 2026-02-26T03:15:58.266 INFO:teuthology.orchestra.run.trial086.stdout: "mon_tick_interval": "5", 2026-02-26T03:15:58.266 INFO:teuthology.orchestra.run.trial086.stdout: "mon_timecheck_interval": "300.000000", 2026-02-26T03:15:58.266 INFO:teuthology.orchestra.run.trial086.stdout: "mon_timecheck_skew_interval": "30.000000", 2026-02-26T03:15:58.266 INFO:teuthology.orchestra.run.trial086.stdout: "mon_use_min_delay_socket": "false", 2026-02-26T03:15:58.267 INFO:teuthology.orchestra.run.trial086.stdout: "mon_warn_older_version_delay": "604800", 2026-02-26T03:15:58.267 INFO:teuthology.orchestra.run.trial086.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2026-02-26T03:15:58.267 INFO:teuthology.orchestra.run.trial086.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2026-02-26T03:15:58.267 INFO:teuthology.orchestra.run.trial086.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2026-02-26T03:15:58.267 INFO:teuthology.orchestra.run.trial086.stdout: "mon_warn_on_filestore_osds": "true", 2026-02-26T03:15:58.267 INFO:teuthology.orchestra.run.trial086.stdout: "mon_warn_on_insecure_global_id_reclaim": "true", 2026-02-26T03:15:58.267 INFO:teuthology.orchestra.run.trial086.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "true", 2026-02-26T03:15:58.267 INFO:teuthology.orchestra.run.trial086.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2026-02-26T03:15:58.267 INFO:teuthology.orchestra.run.trial086.stdout: "mon_warn_on_misplaced": "false", 2026-02-26T03:15:58.267 INFO:teuthology.orchestra.run.trial086.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2026-02-26T03:15:58.267 INFO:teuthology.orchestra.run.trial086.stdout: "mon_warn_on_older_version": "true", 2026-02-26T03:15:58.267 INFO:teuthology.orchestra.run.trial086.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2026-02-26T03:15:58.267 INFO:teuthology.orchestra.run.trial086.stdout: "mon_warn_on_pool_no_app": "true", 2026-02-26T03:15:58.267 INFO:teuthology.orchestra.run.trial086.stdout: "mon_warn_on_pool_no_app_grace": "300", 2026-02-26T03:15:58.267 INFO:teuthology.orchestra.run.trial086.stdout: "mon_warn_on_pool_no_redundancy": "false", 2026-02-26T03:15:58.267 INFO:teuthology.orchestra.run.trial086.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2026-02-26T03:15:58.267 INFO:teuthology.orchestra.run.trial086.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2026-02-26T03:15:58.267 INFO:teuthology.orchestra.run.trial086.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2026-02-26T03:15:58.267 INFO:teuthology.orchestra.run.trial086.stdout: "mon_warn_on_too_few_osds": "false", 2026-02-26T03:15:58.267 INFO:teuthology.orchestra.run.trial086.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2026-02-26T03:15:58.267 INFO:teuthology.orchestra.run.trial086.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2026-02-26T03:15:58.267 INFO:teuthology.orchestra.run.trial086.stdout: "monmap": "", 2026-02-26T03:15:58.267 INFO:teuthology.orchestra.run.trial086.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2026-02-26T03:15:58.267 INFO:teuthology.orchestra.run.trial086.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2026-02-26T03:15:58.267 INFO:teuthology.orchestra.run.trial086.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2026-02-26T03:15:58.267 INFO:teuthology.orchestra.run.trial086.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2026-02-26T03:15:58.267 INFO:teuthology.orchestra.run.trial086.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2026-02-26T03:15:58.267 INFO:teuthology.orchestra.run.trial086.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2026-02-26T03:15:58.268 INFO:teuthology.orchestra.run.trial086.stdout: "motr_tracing_enabled": "false", 2026-02-26T03:15:58.268 INFO:teuthology.orchestra.run.trial086.stdout: "ms_async_op_threads": "3", 2026-02-26T03:15:58.268 INFO:teuthology.orchestra.run.trial086.stdout: "ms_async_rdma_buffer_size": "131072", 2026-02-26T03:15:58.268 INFO:teuthology.orchestra.run.trial086.stdout: "ms_async_rdma_cm": "false", 2026-02-26T03:15:58.268 INFO:teuthology.orchestra.run.trial086.stdout: "ms_async_rdma_device_name": "", 2026-02-26T03:15:58.268 INFO:teuthology.orchestra.run.trial086.stdout: "ms_async_rdma_dscp": "96", 2026-02-26T03:15:58.268 INFO:teuthology.orchestra.run.trial086.stdout: "ms_async_rdma_enable_hugepage": "false", 2026-02-26T03:15:58.268 INFO:teuthology.orchestra.run.trial086.stdout: "ms_async_rdma_gid_idx": "0", 2026-02-26T03:15:58.268 INFO:teuthology.orchestra.run.trial086.stdout: "ms_async_rdma_local_gid": "", 2026-02-26T03:15:58.268 INFO:teuthology.orchestra.run.trial086.stdout: "ms_async_rdma_polling_us": "1000", 2026-02-26T03:15:58.268 INFO:teuthology.orchestra.run.trial086.stdout: "ms_async_rdma_port_num": "1", 2026-02-26T03:15:58.268 INFO:teuthology.orchestra.run.trial086.stdout: "ms_async_rdma_receive_buffers": "32768", 2026-02-26T03:15:58.268 INFO:teuthology.orchestra.run.trial086.stdout: "ms_async_rdma_receive_queue_len": "4096", 2026-02-26T03:15:58.268 INFO:teuthology.orchestra.run.trial086.stdout: "ms_async_rdma_roce_ver": "1", 2026-02-26T03:15:58.268 INFO:teuthology.orchestra.run.trial086.stdout: "ms_async_rdma_send_buffers": "1024", 2026-02-26T03:15:58.268 INFO:teuthology.orchestra.run.trial086.stdout: "ms_async_rdma_sl": "3", 2026-02-26T03:15:58.268 INFO:teuthology.orchestra.run.trial086.stdout: "ms_async_rdma_support_srq": "true", 2026-02-26T03:15:58.268 INFO:teuthology.orchestra.run.trial086.stdout: "ms_async_rdma_type": "ib", 2026-02-26T03:15:58.268 INFO:teuthology.orchestra.run.trial086.stdout: "ms_async_reap_threshold": "5", 2026-02-26T03:15:58.268 INFO:teuthology.orchestra.run.trial086.stdout: "ms_bind_before_connect": "false", 2026-02-26T03:15:58.268 INFO:teuthology.orchestra.run.trial086.stdout: "ms_bind_ipv4": "true", 2026-02-26T03:15:58.268 INFO:teuthology.orchestra.run.trial086.stdout: "ms_bind_ipv6": "false", 2026-02-26T03:15:58.268 INFO:teuthology.orchestra.run.trial086.stdout: "ms_bind_msgr1": "true", 2026-02-26T03:15:58.268 INFO:teuthology.orchestra.run.trial086.stdout: "ms_bind_msgr2": "true", 2026-02-26T03:15:58.268 INFO:teuthology.orchestra.run.trial086.stdout: "ms_bind_port_max": "7568", 2026-02-26T03:15:58.268 INFO:teuthology.orchestra.run.trial086.stdout: "ms_bind_port_min": "6800", 2026-02-26T03:15:58.268 INFO:teuthology.orchestra.run.trial086.stdout: "ms_bind_prefer_ipv4": "false", 2026-02-26T03:15:58.268 INFO:teuthology.orchestra.run.trial086.stdout: "ms_bind_retry_count": "3", 2026-02-26T03:15:58.268 INFO:teuthology.orchestra.run.trial086.stdout: "ms_bind_retry_delay": "5", 2026-02-26T03:15:58.268 INFO:teuthology.orchestra.run.trial086.stdout: "ms_blackhole_client": "false", 2026-02-26T03:15:58.269 INFO:teuthology.orchestra.run.trial086.stdout: "ms_blackhole_mds": "false", 2026-02-26T03:15:58.269 INFO:teuthology.orchestra.run.trial086.stdout: "ms_blackhole_mgr": "false", 2026-02-26T03:15:58.269 INFO:teuthology.orchestra.run.trial086.stdout: "ms_blackhole_mon": "false", 2026-02-26T03:15:58.269 INFO:teuthology.orchestra.run.trial086.stdout: "ms_blackhole_osd": "false", 2026-02-26T03:15:58.269 INFO:teuthology.orchestra.run.trial086.stdout: "ms_client_mode": "crc", 2026-02-26T03:15:58.269 INFO:teuthology.orchestra.run.trial086.stdout: "ms_client_throttle_retry_time_interval": "5000", 2026-02-26T03:15:58.269 INFO:teuthology.orchestra.run.trial086.stdout: "ms_cluster_mode": "crc", 2026-02-26T03:15:58.269 INFO:teuthology.orchestra.run.trial086.stdout: "ms_cluster_type": "", 2026-02-26T03:15:58.269 INFO:teuthology.orchestra.run.trial086.stdout: "ms_compress_secure": "false", 2026-02-26T03:15:58.269 INFO:teuthology.orchestra.run.trial086.stdout: "ms_connection_idle_timeout": "900", 2026-02-26T03:15:58.269 INFO:teuthology.orchestra.run.trial086.stdout: "ms_connection_ready_timeout": "10", 2026-02-26T03:15:58.269 INFO:teuthology.orchestra.run.trial086.stdout: "ms_crc_data": "true", 2026-02-26T03:15:58.269 INFO:teuthology.orchestra.run.trial086.stdout: "ms_crc_header": "true", 2026-02-26T03:15:58.269 INFO:teuthology.orchestra.run.trial086.stdout: "ms_die_on_bad_msg": "false", 2026-02-26T03:15:58.269 INFO:teuthology.orchestra.run.trial086.stdout: "ms_die_on_bug": "true", 2026-02-26T03:15:58.269 INFO:teuthology.orchestra.run.trial086.stdout: "ms_die_on_old_message": "true", 2026-02-26T03:15:58.269 INFO:teuthology.orchestra.run.trial086.stdout: "ms_die_on_skipped_message": "false", 2026-02-26T03:15:58.269 INFO:teuthology.orchestra.run.trial086.stdout: "ms_die_on_unhandled_msg": "false", 2026-02-26T03:15:58.269 INFO:teuthology.orchestra.run.trial086.stdout: "ms_dispatch_throttle_bytes": "104857600", 2026-02-26T03:15:58.269 INFO:teuthology.orchestra.run.trial086.stdout: "ms_dpdk_coremask": "0xF", 2026-02-26T03:15:58.269 INFO:teuthology.orchestra.run.trial086.stdout: "ms_dpdk_debug_allow_loopback": "false", 2026-02-26T03:15:58.269 INFO:teuthology.orchestra.run.trial086.stdout: "ms_dpdk_devs_allowlist": "", 2026-02-26T03:15:58.269 INFO:teuthology.orchestra.run.trial086.stdout: "ms_dpdk_enable_tso": "true", 2026-02-26T03:15:58.269 INFO:teuthology.orchestra.run.trial086.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2026-02-26T03:15:58.269 INFO:teuthology.orchestra.run.trial086.stdout: "ms_dpdk_host_ipv4_addr": "", 2026-02-26T03:15:58.269 INFO:teuthology.orchestra.run.trial086.stdout: "ms_dpdk_hugepages": "", 2026-02-26T03:15:58.269 INFO:teuthology.orchestra.run.trial086.stdout: "ms_dpdk_hw_flow_control": "true", 2026-02-26T03:15:58.269 INFO:teuthology.orchestra.run.trial086.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2026-02-26T03:15:58.269 INFO:teuthology.orchestra.run.trial086.stdout: "ms_dpdk_lro": "true", 2026-02-26T03:15:58.269 INFO:teuthology.orchestra.run.trial086.stdout: "ms_dpdk_memory_channel": "4", 2026-02-26T03:15:58.269 INFO:teuthology.orchestra.run.trial086.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2026-02-26T03:15:58.270 INFO:teuthology.orchestra.run.trial086.stdout: "ms_dpdk_pmd": "", 2026-02-26T03:15:58.270 INFO:teuthology.orchestra.run.trial086.stdout: "ms_dpdk_port_id": "0", 2026-02-26T03:15:58.270 INFO:teuthology.orchestra.run.trial086.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2026-02-26T03:15:58.270 INFO:teuthology.orchestra.run.trial086.stdout: "ms_dump_corrupt_message_level": "1", 2026-02-26T03:15:58.270 INFO:teuthology.orchestra.run.trial086.stdout: "ms_dump_on_send": "false", 2026-02-26T03:15:58.270 INFO:teuthology.orchestra.run.trial086.stdout: "ms_initial_backoff": "0.200000", 2026-02-26T03:15:58.270 INFO:teuthology.orchestra.run.trial086.stdout: "ms_inject_delay_max": "1.000000", 2026-02-26T03:15:58.270 INFO:teuthology.orchestra.run.trial086.stdout: "ms_inject_delay_probability": "0.000000", 2026-02-26T03:15:58.270 INFO:teuthology.orchestra.run.trial086.stdout: "ms_inject_delay_type": "", 2026-02-26T03:15:58.270 INFO:teuthology.orchestra.run.trial086.stdout: "ms_inject_internal_delays": "0.000000", 2026-02-26T03:15:58.270 INFO:teuthology.orchestra.run.trial086.stdout: "ms_inject_network_congestion": "0", 2026-02-26T03:15:58.270 INFO:teuthology.orchestra.run.trial086.stdout: "ms_inject_socket_failures": "0", 2026-02-26T03:15:58.270 INFO:teuthology.orchestra.run.trial086.stdout: "ms_learn_addr_from_peer": "true", 2026-02-26T03:15:58.270 INFO:teuthology.orchestra.run.trial086.stdout: "ms_max_accept_failures": "4", 2026-02-26T03:15:58.270 INFO:teuthology.orchestra.run.trial086.stdout: "ms_max_backoff": "15.000000", 2026-02-26T03:15:58.270 INFO:teuthology.orchestra.run.trial086.stdout: "ms_mon_client_mode": "crc", 2026-02-26T03:15:58.270 INFO:teuthology.orchestra.run.trial086.stdout: "ms_mon_cluster_mode": "crc", 2026-02-26T03:15:58.270 INFO:teuthology.orchestra.run.trial086.stdout: "ms_mon_service_mode": "crc", 2026-02-26T03:15:58.270 INFO:teuthology.orchestra.run.trial086.stdout: "ms_osd_compress_min_size": "1024", 2026-02-26T03:15:58.270 INFO:teuthology.orchestra.run.trial086.stdout: "ms_osd_compress_mode": "none", 2026-02-26T03:15:58.270 INFO:teuthology.orchestra.run.trial086.stdout: "ms_osd_compression_algorithm": "snappy", 2026-02-26T03:15:58.270 INFO:teuthology.orchestra.run.trial086.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2026-02-26T03:15:58.270 INFO:teuthology.orchestra.run.trial086.stdout: "ms_pq_min_cost": "65536", 2026-02-26T03:15:58.270 INFO:teuthology.orchestra.run.trial086.stdout: "ms_public_type": "", 2026-02-26T03:15:58.270 INFO:teuthology.orchestra.run.trial086.stdout: "ms_service_mode": "crc", 2026-02-26T03:15:58.270 INFO:teuthology.orchestra.run.trial086.stdout: "ms_tcp_listen_backlog": "512", 2026-02-26T03:15:58.270 INFO:teuthology.orchestra.run.trial086.stdout: "ms_tcp_nodelay": "true", 2026-02-26T03:15:58.270 INFO:teuthology.orchestra.run.trial086.stdout: "ms_tcp_prefetch_max_size": "65536", 2026-02-26T03:15:58.270 INFO:teuthology.orchestra.run.trial086.stdout: "ms_tcp_rcvbuf": "0", 2026-02-26T03:15:58.270 INFO:teuthology.orchestra.run.trial086.stdout: "ms_time_events_min_wait_interval": "1000", 2026-02-26T03:15:58.271 INFO:teuthology.orchestra.run.trial086.stdout: "ms_type": "async+posix", 2026-02-26T03:15:58.271 INFO:teuthology.orchestra.run.trial086.stdout: "no_config_file": "false", 2026-02-26T03:15:58.271 INFO:teuthology.orchestra.run.trial086.stdout: "nvmeof_mon_client_connect_panic": "30", 2026-02-26T03:15:58.271 INFO:teuthology.orchestra.run.trial086.stdout: "nvmeof_mon_client_disconnect_panic": "100", 2026-02-26T03:15:58.271 INFO:teuthology.orchestra.run.trial086.stdout: "nvmeof_mon_client_tick_period": "1", 2026-02-26T03:15:58.271 INFO:teuthology.orchestra.run.trial086.stdout: "objecter_completion_locks_per_session": "32", 2026-02-26T03:15:58.271 INFO:teuthology.orchestra.run.trial086.stdout: "objecter_debug_inject_relock_delay": "false", 2026-02-26T03:15:58.271 INFO:teuthology.orchestra.run.trial086.stdout: "objecter_inflight_op_bytes": "104857600", 2026-02-26T03:15:58.271 INFO:teuthology.orchestra.run.trial086.stdout: "objecter_inflight_ops": "1024", 2026-02-26T03:15:58.271 INFO:teuthology.orchestra.run.trial086.stdout: "objecter_inject_no_watch_ping": "false", 2026-02-26T03:15:58.271 INFO:teuthology.orchestra.run.trial086.stdout: "objecter_retry_writes_after_first_reply": "false", 2026-02-26T03:15:58.271 INFO:teuthology.orchestra.run.trial086.stdout: "objecter_tick_interval": "5.000000", 2026-02-26T03:15:58.271 INFO:teuthology.orchestra.run.trial086.stdout: "objecter_timeout": "10.000000", 2026-02-26T03:15:58.271 INFO:teuthology.orchestra.run.trial086.stdout: "objectstore_blackhole": "false", 2026-02-26T03:15:58.271 INFO:teuthology.orchestra.run.trial086.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2026-02-26T03:15:58.271 INFO:teuthology.orchestra.run.trial086.stdout: "openssl_conf": "", 2026-02-26T03:15:58.271 INFO:teuthology.orchestra.run.trial086.stdout: "osd_agent_delay_time": "5.000000", 2026-02-26T03:15:58.271 INFO:teuthology.orchestra.run.trial086.stdout: "osd_agent_hist_halflife": "1000", 2026-02-26T03:15:58.271 INFO:teuthology.orchestra.run.trial086.stdout: "osd_agent_max_low_ops": "2", 2026-02-26T03:15:58.271 INFO:teuthology.orchestra.run.trial086.stdout: "osd_agent_max_ops": "4", 2026-02-26T03:15:58.271 INFO:teuthology.orchestra.run.trial086.stdout: "osd_agent_min_evict_effort": "0.100000", 2026-02-26T03:15:58.271 INFO:teuthology.orchestra.run.trial086.stdout: "osd_agent_quantize_effort": "0.100000", 2026-02-26T03:15:58.271 INFO:teuthology.orchestra.run.trial086.stdout: "osd_agent_slop": "0.020000", 2026-02-26T03:15:58.271 INFO:teuthology.orchestra.run.trial086.stdout: "osd_aggregated_slow_ops_logging": "true", 2026-02-26T03:15:58.271 INFO:teuthology.orchestra.run.trial086.stdout: "osd_allow_recovery_below_min_size": "true", 2026-02-26T03:15:58.271 INFO:teuthology.orchestra.run.trial086.stdout: "osd_asio_thread_count": "2", 2026-02-26T03:15:58.271 INFO:teuthology.orchestra.run.trial086.stdout: "osd_async_recovery_min_cost": "100", 2026-02-26T03:15:58.271 INFO:teuthology.orchestra.run.trial086.stdout: "osd_auto_mark_unfound_lost": "false", 2026-02-26T03:15:58.271 INFO:teuthology.orchestra.run.trial086.stdout: "osd_backfill_retry_interval": "30.000000", 2026-02-26T03:15:58.271 INFO:teuthology.orchestra.run.trial086.stdout: "osd_backfill_scan_max": "512", 2026-02-26T03:15:58.271 INFO:teuthology.orchestra.run.trial086.stdout: "osd_backfill_scan_min": "64", 2026-02-26T03:15:58.272 INFO:teuthology.orchestra.run.trial086.stdout: "osd_backoff_on_degraded": "false", 2026-02-26T03:15:58.272 INFO:teuthology.orchestra.run.trial086.stdout: "osd_backoff_on_peering": "false", 2026-02-26T03:15:58.272 INFO:teuthology.orchestra.run.trial086.stdout: "osd_backoff_on_unfound": "true", 2026-02-26T03:15:58.272 INFO:teuthology.orchestra.run.trial086.stdout: "osd_beacon_report_interval": "300", 2026-02-26T03:15:58.272 INFO:teuthology.orchestra.run.trial086.stdout: "osd_bench_duration": "30", 2026-02-26T03:15:58.272 INFO:teuthology.orchestra.run.trial086.stdout: "osd_bench_large_size_max_throughput": "104857600", 2026-02-26T03:15:58.272 INFO:teuthology.orchestra.run.trial086.stdout: "osd_bench_max_block_size": "67108864", 2026-02-26T03:15:58.272 INFO:teuthology.orchestra.run.trial086.stdout: "osd_bench_small_size_max_iops": "100", 2026-02-26T03:15:58.272 INFO:teuthology.orchestra.run.trial086.stdout: "osd_blkin_trace_all": "false", 2026-02-26T03:15:58.272 INFO:teuthology.orchestra.run.trial086.stdout: "osd_blocked_scrub_grace_period": "120", 2026-02-26T03:15:58.272 INFO:teuthology.orchestra.run.trial086.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2026-02-26T03:15:58.272 INFO:teuthology.orchestra.run.trial086.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2026-02-26T03:15:58.272 INFO:teuthology.orchestra.run.trial086.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2026-02-26T03:15:58.272 INFO:teuthology.orchestra.run.trial086.stdout: "osd_check_for_log_corruption": "false", 2026-02-26T03:15:58.272 INFO:teuthology.orchestra.run.trial086.stdout: "osd_check_max_object_name_len_on_startup": "true", 2026-02-26T03:15:58.272 INFO:teuthology.orchestra.run.trial086.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo sem_set", 2026-02-26T03:15:58.272 INFO:teuthology.orchestra.run.trial086.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2026-02-26T03:15:58.272 INFO:teuthology.orchestra.run.trial086.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo sem_set", 2026-02-26T03:15:58.272 INFO:teuthology.orchestra.run.trial086.stdout: "osd_class_update_on_start": "true", 2026-02-26T03:15:58.272 INFO:teuthology.orchestra.run.trial086.stdout: "osd_client_message_cap": "256", 2026-02-26T03:15:58.272 INFO:teuthology.orchestra.run.trial086.stdout: "osd_client_message_size_cap": "524288000", 2026-02-26T03:15:58.272 INFO:teuthology.orchestra.run.trial086.stdout: "osd_client_op_priority": "63", 2026-02-26T03:15:58.272 INFO:teuthology.orchestra.run.trial086.stdout: "osd_client_watch_timeout": "30", 2026-02-26T03:15:58.272 INFO:teuthology.orchestra.run.trial086.stdout: "osd_command_max_records": "256", 2026-02-26T03:15:58.272 INFO:teuthology.orchestra.run.trial086.stdout: "osd_compact_on_start": "false", 2026-02-26T03:15:58.272 INFO:teuthology.orchestra.run.trial086.stdout: "osd_copyfrom_max_chunk": "8388608", 2026-02-26T03:15:58.272 INFO:teuthology.orchestra.run.trial086.stdout: "osd_crush_chooseleaf_type": "0", 2026-02-26T03:15:58.272 INFO:teuthology.orchestra.run.trial086.stdout: "osd_crush_initial_weight": "-1.000000", 2026-02-26T03:15:58.272 INFO:teuthology.orchestra.run.trial086.stdout: "osd_crush_update_on_start": "true", 2026-02-26T03:15:58.272 INFO:teuthology.orchestra.run.trial086.stdout: "osd_crush_update_weight_set": "true", 2026-02-26T03:15:58.272 INFO:teuthology.orchestra.run.trial086.stdout: "osd_data": "/var/lib/ceph/osd/ceph-0", 2026-02-26T03:15:58.272 INFO:teuthology.orchestra.run.trial086.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2026-02-26T03:15:58.273 INFO:teuthology.orchestra.run.trial086.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2026-02-26T03:15:58.273 INFO:teuthology.orchestra.run.trial086.stdout: "osd_debug_drop_ping_duration": "0", 2026-02-26T03:15:58.273 INFO:teuthology.orchestra.run.trial086.stdout: "osd_debug_drop_ping_probability": "0.000000", 2026-02-26T03:15:58.273 INFO:teuthology.orchestra.run.trial086.stdout: "osd_debug_feed_pullee": "-1", 2026-02-26T03:15:58.273 INFO:teuthology.orchestra.run.trial086.stdout: "osd_debug_inject_copyfrom_error": "false", 2026-02-26T03:15:58.273 INFO:teuthology.orchestra.run.trial086.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2026-02-26T03:15:58.273 INFO:teuthology.orchestra.run.trial086.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2026-02-26T03:15:58.273 INFO:teuthology.orchestra.run.trial086.stdout: "osd_debug_misdirected_ops": "true", 2026-02-26T03:15:58.273 INFO:teuthology.orchestra.run.trial086.stdout: "osd_debug_no_acting_change": "false", 2026-02-26T03:15:58.273 INFO:teuthology.orchestra.run.trial086.stdout: "osd_debug_no_purge_strays": "false", 2026-02-26T03:15:58.273 INFO:teuthology.orchestra.run.trial086.stdout: "osd_debug_op_order": "true", 2026-02-26T03:15:58.273 INFO:teuthology.orchestra.run.trial086.stdout: "osd_debug_pg_log_writeout": "true", 2026-02-26T03:15:58.273 INFO:teuthology.orchestra.run.trial086.stdout: "osd_debug_pretend_recovery_active": "false", 2026-02-26T03:15:58.273 INFO:teuthology.orchestra.run.trial086.stdout: "osd_debug_random_push_read_error": "0.000000", 2026-02-26T03:15:58.273 INFO:teuthology.orchestra.run.trial086.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2026-02-26T03:15:58.273 INFO:teuthology.orchestra.run.trial086.stdout: "osd_debug_shutdown": "true", 2026-02-26T03:15:58.273 INFO:teuthology.orchestra.run.trial086.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2026-02-26T03:15:58.273 INFO:teuthology.orchestra.run.trial086.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2026-02-26T03:15:58.273 INFO:teuthology.orchestra.run.trial086.stdout: "osd_debug_trim_objects": "true", 2026-02-26T03:15:58.273 INFO:teuthology.orchestra.run.trial086.stdout: "osd_debug_verify_cached_snaps": "false", 2026-02-26T03:15:58.273 INFO:teuthology.orchestra.run.trial086.stdout: "osd_debug_verify_missing_on_start": "false", 2026-02-26T03:15:58.273 INFO:teuthology.orchestra.run.trial086.stdout: "osd_debug_verify_snaps": "false", 2026-02-26T03:15:58.273 INFO:teuthology.orchestra.run.trial086.stdout: "osd_debug_verify_stray_on_activate": "true", 2026-02-26T03:15:58.273 INFO:teuthology.orchestra.run.trial086.stdout: "osd_deep_scrub_interval": "604800.000000", 2026-02-26T03:15:58.273 INFO:teuthology.orchestra.run.trial086.stdout: "osd_deep_scrub_interval_cv": "0.200000", 2026-02-26T03:15:58.273 INFO:teuthology.orchestra.run.trial086.stdout: "osd_deep_scrub_keys": "1024", 2026-02-26T03:15:58.273 INFO:teuthology.orchestra.run.trial086.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2026-02-26T03:15:58.273 INFO:teuthology.orchestra.run.trial086.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2026-02-26T03:15:58.273 INFO:teuthology.orchestra.run.trial086.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2026-02-26T03:15:58.273 INFO:teuthology.orchestra.run.trial086.stdout: "osd_deep_scrub_stride": "4194304", 2026-02-26T03:15:58.273 INFO:teuthology.orchestra.run.trial086.stdout: "osd_deep_scrub_update_digest_min_age": "30", 2026-02-26T03:15:58.273 INFO:teuthology.orchestra.run.trial086.stdout: "osd_default_data_pool_replay_window": "5", 2026-02-26T03:15:58.274 INFO:teuthology.orchestra.run.trial086.stdout: "osd_default_notify_timeout": "30", 2026-02-26T03:15:58.274 INFO:teuthology.orchestra.run.trial086.stdout: "osd_delete_sleep": "0.000000", 2026-02-26T03:15:58.274 INFO:teuthology.orchestra.run.trial086.stdout: "osd_delete_sleep_hdd": "5.000000", 2026-02-26T03:15:58.274 INFO:teuthology.orchestra.run.trial086.stdout: "osd_delete_sleep_hybrid": "1.000000", 2026-02-26T03:15:58.274 INFO:teuthology.orchestra.run.trial086.stdout: "osd_delete_sleep_ssd": "1.000000", 2026-02-26T03:15:58.274 INFO:teuthology.orchestra.run.trial086.stdout: "osd_discard_disconnected_ops": "true", 2026-02-26T03:15:58.274 INFO:teuthology.orchestra.run.trial086.stdout: "osd_ec_partial_reads": "true", 2026-02-26T03:15:58.274 INFO:teuthology.orchestra.run.trial086.stdout: "osd_enable_op_tracker": "true", 2026-02-26T03:15:58.274 INFO:teuthology.orchestra.run.trial086.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2026-02-26T03:15:58.274 INFO:teuthology.orchestra.run.trial086.stdout: "osd_extblkdev_plugins": "vdo", 2026-02-26T03:15:58.274 INFO:teuthology.orchestra.run.trial086.stdout: "osd_failsafe_full_ratio": "0.970000", 2026-02-26T03:15:58.274 INFO:teuthology.orchestra.run.trial086.stdout: "osd_fast_fail_on_connection_refused": "true", 2026-02-26T03:15:58.274 INFO:teuthology.orchestra.run.trial086.stdout: "osd_fast_info": "true", 2026-02-26T03:15:58.274 INFO:teuthology.orchestra.run.trial086.stdout: "osd_fast_shutdown": "true", 2026-02-26T03:15:58.274 INFO:teuthology.orchestra.run.trial086.stdout: "osd_fast_shutdown_notify_mon": "true", 2026-02-26T03:15:58.274 INFO:teuthology.orchestra.run.trial086.stdout: "osd_fast_shutdown_timeout": "15", 2026-02-26T03:15:58.274 INFO:teuthology.orchestra.run.trial086.stdout: "osd_find_best_info_ignore_history_les": "false", 2026-02-26T03:15:58.274 INFO:teuthology.orchestra.run.trial086.stdout: "osd_force_auth_primary_missing_objects": "100", 2026-02-26T03:15:58.274 INFO:teuthology.orchestra.run.trial086.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2026-02-26T03:15:58.274 INFO:teuthology.orchestra.run.trial086.stdout: "osd_function_tracing": "false", 2026-02-26T03:15:58.274 INFO:teuthology.orchestra.run.trial086.stdout: "osd_heartbeat_grace": "20", 2026-02-26T03:15:58.274 INFO:teuthology.orchestra.run.trial086.stdout: "osd_heartbeat_interval": "6", 2026-02-26T03:15:58.274 INFO:teuthology.orchestra.run.trial086.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2026-02-26T03:15:58.274 INFO:teuthology.orchestra.run.trial086.stdout: "osd_heartbeat_min_peers": "10", 2026-02-26T03:15:58.274 INFO:teuthology.orchestra.run.trial086.stdout: "osd_heartbeat_min_size": "2000", 2026-02-26T03:15:58.274 INFO:teuthology.orchestra.run.trial086.stdout: "osd_heartbeat_stale": "600", 2026-02-26T03:15:58.274 INFO:teuthology.orchestra.run.trial086.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2026-02-26T03:15:58.274 INFO:teuthology.orchestra.run.trial086.stdout: "osd_hit_set_max_size": "100000", 2026-02-26T03:15:58.274 INFO:teuthology.orchestra.run.trial086.stdout: "osd_hit_set_min_size": "1000", 2026-02-26T03:15:58.274 INFO:teuthology.orchestra.run.trial086.stdout: "osd_hit_set_namespace": ".ceph-internal", 2026-02-26T03:15:58.274 INFO:teuthology.orchestra.run.trial086.stdout: "osd_ignore_stale_divergent_priors": "false", 2026-02-26T03:15:58.274 INFO:teuthology.orchestra.run.trial086.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2026-02-26T03:15:58.274 INFO:teuthology.orchestra.run.trial086.stdout: "osd_inject_failure_on_pg_removal": "false", 2026-02-26T03:15:58.274 INFO:teuthology.orchestra.run.trial086.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-0/journal", 2026-02-26T03:15:58.275 INFO:teuthology.orchestra.run.trial086.stdout: "osd_journal_flush_on_shutdown": "true", 2026-02-26T03:15:58.275 INFO:teuthology.orchestra.run.trial086.stdout: "osd_journal_size": "100", 2026-02-26T03:15:58.275 INFO:teuthology.orchestra.run.trial086.stdout: "osd_kill_backfill_at": "0", 2026-02-26T03:15:58.275 INFO:teuthology.orchestra.run.trial086.stdout: "osd_loop_before_reset_tphandle": "64", 2026-02-26T03:15:58.275 INFO:teuthology.orchestra.run.trial086.stdout: "osd_map_cache_size": "50", 2026-02-26T03:15:58.275 INFO:teuthology.orchestra.run.trial086.stdout: "osd_map_dedup": "true", 2026-02-26T03:15:58.275 INFO:teuthology.orchestra.run.trial086.stdout: "osd_map_message_max": "40", 2026-02-26T03:15:58.275 INFO:teuthology.orchestra.run.trial086.stdout: "osd_map_message_max_bytes": "10485760", 2026-02-26T03:15:58.275 INFO:teuthology.orchestra.run.trial086.stdout: "osd_map_share_max_epochs": "40", 2026-02-26T03:15:58.275 INFO:teuthology.orchestra.run.trial086.stdout: "osd_max_attr_name_len": "100", 2026-02-26T03:15:58.275 INFO:teuthology.orchestra.run.trial086.stdout: "osd_max_attr_size": "0", 2026-02-26T03:15:58.275 INFO:teuthology.orchestra.run.trial086.stdout: "osd_max_backfills": "1", 2026-02-26T03:15:58.275 INFO:teuthology.orchestra.run.trial086.stdout: "osd_max_markdown_count": "5", 2026-02-26T03:15:58.275 INFO:teuthology.orchestra.run.trial086.stdout: "osd_max_markdown_period": "600", 2026-02-26T03:15:58.275 INFO:teuthology.orchestra.run.trial086.stdout: "osd_max_object_name_len": "2048", 2026-02-26T03:15:58.275 INFO:teuthology.orchestra.run.trial086.stdout: "osd_max_object_namespace_len": "256", 2026-02-26T03:15:58.275 INFO:teuthology.orchestra.run.trial086.stdout: "osd_max_object_size": "134217728", 2026-02-26T03:15:58.275 INFO:teuthology.orchestra.run.trial086.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2026-02-26T03:15:58.275 INFO:teuthology.orchestra.run.trial086.stdout: "osd_max_omap_entries_per_request": "1024", 2026-02-26T03:15:58.275 INFO:teuthology.orchestra.run.trial086.stdout: "osd_max_pg_blocked_by": "16", 2026-02-26T03:15:58.275 INFO:teuthology.orchestra.run.trial086.stdout: "osd_max_pg_log_entries": "10000", 2026-02-26T03:15:58.275 INFO:teuthology.orchestra.run.trial086.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2026-02-26T03:15:58.275 INFO:teuthology.orchestra.run.trial086.stdout: "osd_max_pgls": "1024", 2026-02-26T03:15:58.275 INFO:teuthology.orchestra.run.trial086.stdout: "osd_max_push_cost": "8388608", 2026-02-26T03:15:58.275 INFO:teuthology.orchestra.run.trial086.stdout: "osd_max_push_objects": "10", 2026-02-26T03:15:58.275 INFO:teuthology.orchestra.run.trial086.stdout: "osd_max_scrubs": "3", 2026-02-26T03:15:58.275 INFO:teuthology.orchestra.run.trial086.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2026-02-26T03:15:58.275 INFO:teuthology.orchestra.run.trial086.stdout: "osd_max_trimming_pgs": "2", 2026-02-26T03:15:58.275 INFO:teuthology.orchestra.run.trial086.stdout: "osd_max_write_op_reply_len": "64", 2026-02-26T03:15:58.276 INFO:teuthology.orchestra.run.trial086.stdout: "osd_max_write_size": "90", 2026-02-26T03:15:58.276 INFO:teuthology.orchestra.run.trial086.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2026-02-26T03:15:58.276 INFO:teuthology.orchestra.run.trial086.stdout: "osd_mclock_iops_capacity_low_threshold_hdd": "50.000000", 2026-02-26T03:15:58.276 INFO:teuthology.orchestra.run.trial086.stdout: "osd_mclock_iops_capacity_low_threshold_ssd": "1000.000000", 2026-02-26T03:15:58.276 INFO:teuthology.orchestra.run.trial086.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2026-02-26T03:15:58.276 INFO:teuthology.orchestra.run.trial086.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2026-02-26T03:15:58.276 INFO:teuthology.orchestra.run.trial086.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2026-02-26T03:15:58.276 INFO:teuthology.orchestra.run.trial086.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2026-02-26T03:15:58.276 INFO:teuthology.orchestra.run.trial086.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2026-02-26T03:15:58.276 INFO:teuthology.orchestra.run.trial086.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2026-02-26T03:15:58.276 INFO:teuthology.orchestra.run.trial086.stdout: "osd_mclock_override_recovery_settings": "false", 2026-02-26T03:15:58.276 INFO:teuthology.orchestra.run.trial086.stdout: "osd_mclock_profile": "high_recovery_ops", 2026-02-26T03:15:58.276 INFO:teuthology.orchestra.run.trial086.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2026-02-26T03:15:58.276 INFO:teuthology.orchestra.run.trial086.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2026-02-26T03:15:58.276 INFO:teuthology.orchestra.run.trial086.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2026-02-26T03:15:58.276 INFO:teuthology.orchestra.run.trial086.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2026-02-26T03:15:58.276 INFO:teuthology.orchestra.run.trial086.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2026-02-26T03:15:58.276 INFO:teuthology.orchestra.run.trial086.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2026-02-26T03:15:58.276 INFO:teuthology.orchestra.run.trial086.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2026-02-26T03:15:58.276 INFO:teuthology.orchestra.run.trial086.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2026-02-26T03:15:58.276 INFO:teuthology.orchestra.run.trial086.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2026-02-26T03:15:58.276 INFO:teuthology.orchestra.run.trial086.stdout: "osd_mclock_scheduler_client_wgt": "1", 2026-02-26T03:15:58.276 INFO:teuthology.orchestra.run.trial086.stdout: "osd_mclock_skip_benchmark": "true", 2026-02-26T03:15:58.276 INFO:teuthology.orchestra.run.trial086.stdout: "osd_memory_base": "805306368", 2026-02-26T03:15:58.276 INFO:teuthology.orchestra.run.trial086.stdout: "osd_memory_cache_min": "134217728", 2026-02-26T03:15:58.276 INFO:teuthology.orchestra.run.trial086.stdout: "osd_memory_cache_resize_interval": "1.000000", 2026-02-26T03:15:58.276 INFO:teuthology.orchestra.run.trial086.stdout: "osd_memory_expected_fragmentation": "0.150000", 2026-02-26T03:15:58.276 INFO:teuthology.orchestra.run.trial086.stdout: "osd_memory_target": "4294967296", 2026-02-26T03:15:58.276 INFO:teuthology.orchestra.run.trial086.stdout: "osd_memory_target_autotune": "false", 2026-02-26T03:15:58.276 INFO:teuthology.orchestra.run.trial086.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2026-02-26T03:15:58.276 INFO:teuthology.orchestra.run.trial086.stdout: "osd_min_pg_log_entries": "250", 2026-02-26T03:15:58.276 INFO:teuthology.orchestra.run.trial086.stdout: "osd_min_recovery_priority": "0", 2026-02-26T03:15:58.276 INFO:teuthology.orchestra.run.trial086.stdout: "osd_mon_heartbeat_interval": "30", 2026-02-26T03:15:58.276 INFO:teuthology.orchestra.run.trial086.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2026-02-26T03:15:58.277 INFO:teuthology.orchestra.run.trial086.stdout: "osd_mon_report_interval": "5", 2026-02-26T03:15:58.277 INFO:teuthology.orchestra.run.trial086.stdout: "osd_mon_report_max_in_flight": "2", 2026-02-26T03:15:58.277 INFO:teuthology.orchestra.run.trial086.stdout: "osd_mon_shutdown_timeout": "5.000000", 2026-02-26T03:15:58.277 INFO:teuthology.orchestra.run.trial086.stdout: "osd_num_cache_shards": "32", 2026-02-26T03:15:58.277 INFO:teuthology.orchestra.run.trial086.stdout: "osd_num_op_tracker_shard": "32", 2026-02-26T03:15:58.277 INFO:teuthology.orchestra.run.trial086.stdout: "osd_numa_auto_affinity": "true", 2026-02-26T03:15:58.277 INFO:teuthology.orchestra.run.trial086.stdout: "osd_numa_node": "-1", 2026-02-26T03:15:58.277 INFO:teuthology.orchestra.run.trial086.stdout: "osd_numa_prefer_iface": "true", 2026-02-26T03:15:58.277 INFO:teuthology.orchestra.run.trial086.stdout: "osd_object_clean_region_max_num_intervals": "10", 2026-02-26T03:15:58.277 INFO:teuthology.orchestra.run.trial086.stdout: "osd_objecter_finishers": "1", 2026-02-26T03:15:58.277 INFO:teuthology.orchestra.run.trial086.stdout: "osd_objectstore": "seastore", 2026-02-26T03:15:58.277 INFO:teuthology.orchestra.run.trial086.stdout: "osd_objectstore_fuse": "false", 2026-02-26T03:15:58.277 INFO:teuthology.orchestra.run.trial086.stdout: "osd_objectstore_ideal_list_max": "64", 2026-02-26T03:15:58.277 INFO:teuthology.orchestra.run.trial086.stdout: "osd_objectstore_tracing": "false", 2026-02-26T03:15:58.277 INFO:teuthology.orchestra.run.trial086.stdout: "osd_op_complaint_time": "30.000000", 2026-02-26T03:15:58.277 INFO:teuthology.orchestra.run.trial086.stdout: "osd_op_history_duration": "600", 2026-02-26T03:15:58.277 INFO:teuthology.orchestra.run.trial086.stdout: "osd_op_history_size": "20", 2026-02-26T03:15:58.277 INFO:teuthology.orchestra.run.trial086.stdout: "osd_op_history_slow_op_size": "20", 2026-02-26T03:15:58.277 INFO:teuthology.orchestra.run.trial086.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2026-02-26T03:15:58.277 INFO:teuthology.orchestra.run.trial086.stdout: "osd_op_log_threshold": "5", 2026-02-26T03:15:58.277 INFO:teuthology.orchestra.run.trial086.stdout: "osd_op_num_shards": "0", 2026-02-26T03:15:58.277 INFO:teuthology.orchestra.run.trial086.stdout: "osd_op_num_shards_hdd": "1", 2026-02-26T03:15:58.277 INFO:teuthology.orchestra.run.trial086.stdout: "osd_op_num_shards_ssd": "8", 2026-02-26T03:15:58.277 INFO:teuthology.orchestra.run.trial086.stdout: "osd_op_num_threads_per_shard": "0", 2026-02-26T03:15:58.277 INFO:teuthology.orchestra.run.trial086.stdout: "osd_op_num_threads_per_shard_hdd": "5", 2026-02-26T03:15:58.277 INFO:teuthology.orchestra.run.trial086.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2026-02-26T03:15:58.277 INFO:teuthology.orchestra.run.trial086.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2026-02-26T03:15:58.277 INFO:teuthology.orchestra.run.trial086.stdout: "osd_op_pq_min_cost": "65536", 2026-02-26T03:15:58.277 INFO:teuthology.orchestra.run.trial086.stdout: "osd_op_queue": "mclock_scheduler", 2026-02-26T03:15:58.277 INFO:teuthology.orchestra.run.trial086.stdout: "osd_op_queue_cut_off": "high", 2026-02-26T03:15:58.277 INFO:teuthology.orchestra.run.trial086.stdout: "osd_op_thread_suicide_timeout": "150", 2026-02-26T03:15:58.277 INFO:teuthology.orchestra.run.trial086.stdout: "osd_op_thread_timeout": "15", 2026-02-26T03:15:58.277 INFO:teuthology.orchestra.run.trial086.stdout: "osd_open_classes_on_start": "true", 2026-02-26T03:15:58.277 INFO:teuthology.orchestra.run.trial086.stdout: "osd_os_flags": "0", 2026-02-26T03:15:58.277 INFO:teuthology.orchestra.run.trial086.stdout: "osd_peering_op_priority": "255", 2026-02-26T03:15:58.277 INFO:teuthology.orchestra.run.trial086.stdout: "osd_pg_delete_cost": "1048576", 2026-02-26T03:15:58.278 INFO:teuthology.orchestra.run.trial086.stdout: "osd_pg_delete_priority": "5", 2026-02-26T03:15:58.278 INFO:teuthology.orchestra.run.trial086.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2026-02-26T03:15:58.278 INFO:teuthology.orchestra.run.trial086.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2026-02-26T03:15:58.278 INFO:teuthology.orchestra.run.trial086.stdout: "osd_pg_log_dups_tracked": "3000", 2026-02-26T03:15:58.278 INFO:teuthology.orchestra.run.trial086.stdout: "osd_pg_log_trim_max": "10000", 2026-02-26T03:15:58.278 INFO:teuthology.orchestra.run.trial086.stdout: "osd_pg_log_trim_min": "100", 2026-02-26T03:15:58.278 INFO:teuthology.orchestra.run.trial086.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2026-02-26T03:15:58.278 INFO:teuthology.orchestra.run.trial086.stdout: "osd_pg_object_context_cache_count": "64", 2026-02-26T03:15:58.278 INFO:teuthology.orchestra.run.trial086.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2026-02-26T03:15:58.278 INFO:teuthology.orchestra.run.trial086.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2026-02-26T03:15:58.278 INFO:teuthology.orchestra.run.trial086.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2026-02-26T03:15:58.278 INFO:teuthology.orchestra.run.trial086.stdout: "osd_pool_default_cache_min_evict_age": "0", 2026-02-26T03:15:58.278 INFO:teuthology.orchestra.run.trial086.stdout: "osd_pool_default_cache_min_flush_age": "0", 2026-02-26T03:15:58.278 INFO:teuthology.orchestra.run.trial086.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2026-02-26T03:15:58.278 INFO:teuthology.orchestra.run.trial086.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2026-02-26T03:15:58.278 INFO:teuthology.orchestra.run.trial086.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2026-02-26T03:15:58.278 INFO:teuthology.orchestra.run.trial086.stdout: "osd_pool_default_crimson": "false", 2026-02-26T03:15:58.278 INFO:teuthology.orchestra.run.trial086.stdout: "osd_pool_default_crush_rule": "-1", 2026-02-26T03:15:58.278 INFO:teuthology.orchestra.run.trial086.stdout: "osd_pool_default_ec_fast_read": "false", 2026-02-26T03:15:58.278 INFO:teuthology.orchestra.run.trial086.stdout: "osd_pool_default_erasure_code_profile": "plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2026-02-26T03:15:58.278 INFO:teuthology.orchestra.run.trial086.stdout: "osd_pool_default_flag_bulk": "false", 2026-02-26T03:15:58.278 INFO:teuthology.orchestra.run.trial086.stdout: "osd_pool_default_flag_ec_optimizations": "false", 2026-02-26T03:15:58.278 INFO:teuthology.orchestra.run.trial086.stdout: "osd_pool_default_flag_hashpspool": "true", 2026-02-26T03:15:58.278 INFO:teuthology.orchestra.run.trial086.stdout: "osd_pool_default_flag_nodelete": "false", 2026-02-26T03:15:58.278 INFO:teuthology.orchestra.run.trial086.stdout: "osd_pool_default_flag_nopgchange": "false", 2026-02-26T03:15:58.278 INFO:teuthology.orchestra.run.trial086.stdout: "osd_pool_default_flag_nosizechange": "false", 2026-02-26T03:15:58.278 INFO:teuthology.orchestra.run.trial086.stdout: "osd_pool_default_flags": "0", 2026-02-26T03:15:58.278 INFO:teuthology.orchestra.run.trial086.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2026-02-26T03:15:58.278 INFO:teuthology.orchestra.run.trial086.stdout: "osd_pool_default_min_size": "0", 2026-02-26T03:15:58.278 INFO:teuthology.orchestra.run.trial086.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2026-02-26T03:15:58.278 INFO:teuthology.orchestra.run.trial086.stdout: "osd_pool_default_pg_num": "32", 2026-02-26T03:15:58.278 INFO:teuthology.orchestra.run.trial086.stdout: "osd_pool_default_pgp_num": "0", 2026-02-26T03:15:58.278 INFO:teuthology.orchestra.run.trial086.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2026-02-26T03:15:58.278 INFO:teuthology.orchestra.run.trial086.stdout: "osd_pool_default_read_ratio": "70", 2026-02-26T03:15:58.278 INFO:teuthology.orchestra.run.trial086.stdout: "osd_pool_default_size": "2", 2026-02-26T03:15:58.278 INFO:teuthology.orchestra.run.trial086.stdout: "osd_pool_default_type": "replicated", 2026-02-26T03:15:58.278 INFO:teuthology.orchestra.run.trial086.stdout: "osd_pool_erasure_code_stripe_unit": "0", 2026-02-26T03:15:58.279 INFO:teuthology.orchestra.run.trial086.stdout: "osd_pool_use_gmt_hitset": "true", 2026-02-26T03:15:58.279 INFO:teuthology.orchestra.run.trial086.stdout: "osd_push_per_object_cost": "1000", 2026-02-26T03:15:58.279 INFO:teuthology.orchestra.run.trial086.stdout: "osd_read_ec_check_for_errors": "false", 2026-02-26T03:15:58.279 INFO:teuthology.orchestra.run.trial086.stdout: "osd_recover_clone_overlap": "true", 2026-02-26T03:15:58.279 INFO:teuthology.orchestra.run.trial086.stdout: "osd_recover_clone_overlap_limit": "10", 2026-02-26T03:15:58.279 INFO:teuthology.orchestra.run.trial086.stdout: "osd_recovery_cost": "20971520", 2026-02-26T03:15:58.279 INFO:teuthology.orchestra.run.trial086.stdout: "osd_recovery_delay_start": "0.000000", 2026-02-26T03:15:58.279 INFO:teuthology.orchestra.run.trial086.stdout: "osd_recovery_max_active": "0", 2026-02-26T03:15:58.279 INFO:teuthology.orchestra.run.trial086.stdout: "osd_recovery_max_active_hdd": "3", 2026-02-26T03:15:58.279 INFO:teuthology.orchestra.run.trial086.stdout: "osd_recovery_max_active_ssd": "10", 2026-02-26T03:15:58.279 INFO:teuthology.orchestra.run.trial086.stdout: "osd_recovery_max_chunk": "1048576", 2026-02-26T03:15:58.279 INFO:teuthology.orchestra.run.trial086.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2026-02-26T03:15:58.279 INFO:teuthology.orchestra.run.trial086.stdout: "osd_recovery_max_single_start": "1", 2026-02-26T03:15:58.279 INFO:teuthology.orchestra.run.trial086.stdout: "osd_recovery_op_priority": "3", 2026-02-26T03:15:58.279 INFO:teuthology.orchestra.run.trial086.stdout: "osd_recovery_op_warn_multiple": "16", 2026-02-26T03:15:58.279 INFO:teuthology.orchestra.run.trial086.stdout: "osd_recovery_priority": "5", 2026-02-26T03:15:58.279 INFO:teuthology.orchestra.run.trial086.stdout: "osd_recovery_retry_interval": "30.000000", 2026-02-26T03:15:58.279 INFO:teuthology.orchestra.run.trial086.stdout: "osd_recovery_sleep": "0.000000", 2026-02-26T03:15:58.279 INFO:teuthology.orchestra.run.trial086.stdout: "osd_recovery_sleep_degraded": "0.000000", 2026-02-26T03:15:58.279 INFO:teuthology.orchestra.run.trial086.stdout: "osd_recovery_sleep_degraded_hdd": "0.100000", 2026-02-26T03:15:58.279 INFO:teuthology.orchestra.run.trial086.stdout: "osd_recovery_sleep_degraded_hybrid": "0.025000", 2026-02-26T03:15:58.279 INFO:teuthology.orchestra.run.trial086.stdout: "osd_recovery_sleep_degraded_ssd": "0.000000", 2026-02-26T03:15:58.279 INFO:teuthology.orchestra.run.trial086.stdout: "osd_recovery_sleep_hdd": "0.100000", 2026-02-26T03:15:58.279 INFO:teuthology.orchestra.run.trial086.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2026-02-26T03:15:58.279 INFO:teuthology.orchestra.run.trial086.stdout: "osd_recovery_sleep_ssd": "0.000000", 2026-02-26T03:15:58.279 INFO:teuthology.orchestra.run.trial086.stdout: "osd_requested_scrub_priority": "5", 2026-02-26T03:15:58.279 INFO:teuthology.orchestra.run.trial086.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2026-02-26T03:15:58.279 INFO:teuthology.orchestra.run.trial086.stdout: "osd_rollback_to_cluster_snap": "", 2026-02-26T03:15:58.279 INFO:teuthology.orchestra.run.trial086.stdout: "osd_scrub_auto_repair": "false", 2026-02-26T03:15:58.279 INFO:teuthology.orchestra.run.trial086.stdout: "osd_scrub_auto_repair_num_errors": "5", 2026-02-26T03:15:58.279 INFO:teuthology.orchestra.run.trial086.stdout: "osd_scrub_backoff_ratio": "0.660000", 2026-02-26T03:15:58.279 INFO:teuthology.orchestra.run.trial086.stdout: "osd_scrub_begin_hour": "0", 2026-02-26T03:15:58.279 INFO:teuthology.orchestra.run.trial086.stdout: "osd_scrub_begin_week_day": "0", 2026-02-26T03:15:58.279 INFO:teuthology.orchestra.run.trial086.stdout: "osd_scrub_chunk_max": "15", 2026-02-26T03:15:58.279 INFO:teuthology.orchestra.run.trial086.stdout: "osd_scrub_chunk_min": "5", 2026-02-26T03:15:58.279 INFO:teuthology.orchestra.run.trial086.stdout: "osd_scrub_cost": "52428800", 2026-02-26T03:15:58.279 INFO:teuthology.orchestra.run.trial086.stdout: "osd_scrub_disable_reservation_queuing": "false", 2026-02-26T03:15:58.279 INFO:teuthology.orchestra.run.trial086.stdout: "osd_scrub_during_recovery": "false", 2026-02-26T03:15:58.280 INFO:teuthology.orchestra.run.trial086.stdout: "osd_scrub_end_hour": "0", 2026-02-26T03:15:58.280 INFO:teuthology.orchestra.run.trial086.stdout: "osd_scrub_end_week_day": "0", 2026-02-26T03:15:58.280 INFO:teuthology.orchestra.run.trial086.stdout: "osd_scrub_event_cost": "4096", 2026-02-26T03:15:58.280 INFO:teuthology.orchestra.run.trial086.stdout: "osd_scrub_extended_sleep": "0.000000", 2026-02-26T03:15:58.280 INFO:teuthology.orchestra.run.trial086.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2026-02-26T03:15:58.280 INFO:teuthology.orchestra.run.trial086.stdout: "osd_scrub_invalid_stats": "true", 2026-02-26T03:15:58.280 INFO:teuthology.orchestra.run.trial086.stdout: "osd_scrub_load_threshold": "5.000000", 2026-02-26T03:15:58.280 INFO:teuthology.orchestra.run.trial086.stdout: "osd_scrub_max_interval": "600.000000", 2026-02-26T03:15:58.280 INFO:teuthology.orchestra.run.trial086.stdout: "osd_scrub_max_preemptions": "5", 2026-02-26T03:15:58.280 INFO:teuthology.orchestra.run.trial086.stdout: "osd_scrub_min_interval": "86400.000000", 2026-02-26T03:15:58.280 INFO:teuthology.orchestra.run.trial086.stdout: "osd_scrub_priority": "5", 2026-02-26T03:15:58.280 INFO:teuthology.orchestra.run.trial086.stdout: "osd_scrub_retry_after_noscrub": "60", 2026-02-26T03:15:58.280 INFO:teuthology.orchestra.run.trial086.stdout: "osd_scrub_retry_delay": "30", 2026-02-26T03:15:58.280 INFO:teuthology.orchestra.run.trial086.stdout: "osd_scrub_retry_new_interval": "10", 2026-02-26T03:15:58.280 INFO:teuthology.orchestra.run.trial086.stdout: "osd_scrub_retry_pg_state": "60", 2026-02-26T03:15:58.280 INFO:teuthology.orchestra.run.trial086.stdout: "osd_scrub_retry_trimming": "10", 2026-02-26T03:15:58.280 INFO:teuthology.orchestra.run.trial086.stdout: "osd_scrub_sleep": "0.000000", 2026-02-26T03:15:58.280 INFO:teuthology.orchestra.run.trial086.stdout: "osd_shallow_scrub_chunk_max": "100", 2026-02-26T03:15:58.280 INFO:teuthology.orchestra.run.trial086.stdout: "osd_shallow_scrub_chunk_min": "50", 2026-02-26T03:15:58.280 INFO:teuthology.orchestra.run.trial086.stdout: "osd_shutdown_pgref_assert": "false", 2026-02-26T03:15:58.280 INFO:teuthology.orchestra.run.trial086.stdout: "osd_skip_check_past_interval_bounds": "false", 2026-02-26T03:15:58.280 INFO:teuthology.orchestra.run.trial086.stdout: "osd_skip_data_digest": "false", 2026-02-26T03:15:58.280 INFO:teuthology.orchestra.run.trial086.stdout: "osd_smart_report_timeout": "5", 2026-02-26T03:15:58.280 INFO:teuthology.orchestra.run.trial086.stdout: "osd_snap_trim_cost": "1048576", 2026-02-26T03:15:58.280 INFO:teuthology.orchestra.run.trial086.stdout: "osd_snap_trim_priority": "5", 2026-02-26T03:15:58.280 INFO:teuthology.orchestra.run.trial086.stdout: "osd_snap_trim_sleep": "0.000000", 2026-02-26T03:15:58.280 INFO:teuthology.orchestra.run.trial086.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2026-02-26T03:15:58.280 INFO:teuthology.orchestra.run.trial086.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2026-02-26T03:15:58.280 INFO:teuthology.orchestra.run.trial086.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2026-02-26T03:15:58.280 INFO:teuthology.orchestra.run.trial086.stdout: "osd_stats_update_period_not_scrubbing": "120", 2026-02-26T03:15:58.280 INFO:teuthology.orchestra.run.trial086.stdout: "osd_stats_update_period_scrubbing": "15", 2026-02-26T03:15:58.280 INFO:teuthology.orchestra.run.trial086.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2026-02-26T03:15:58.280 INFO:teuthology.orchestra.run.trial086.stdout: "osd_target_transaction_size": "30", 2026-02-26T03:15:58.280 INFO:teuthology.orchestra.run.trial086.stdout: "osd_tier_default_cache_hit_set_count": "4", 2026-02-26T03:15:58.280 INFO:teuthology.orchestra.run.trial086.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2026-02-26T03:15:58.280 INFO:teuthology.orchestra.run.trial086.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2026-02-26T03:15:58.280 INFO:teuthology.orchestra.run.trial086.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2026-02-26T03:15:58.280 INFO:teuthology.orchestra.run.trial086.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2026-02-26T03:15:58.280 INFO:teuthology.orchestra.run.trial086.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2026-02-26T03:15:58.281 INFO:teuthology.orchestra.run.trial086.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2026-02-26T03:15:58.281 INFO:teuthology.orchestra.run.trial086.stdout: "osd_tier_default_cache_mode": "writeback", 2026-02-26T03:15:58.281 INFO:teuthology.orchestra.run.trial086.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2026-02-26T03:15:58.281 INFO:teuthology.orchestra.run.trial086.stdout: "osd_tier_promote_max_objects_sec": "25", 2026-02-26T03:15:58.281 INFO:teuthology.orchestra.run.trial086.stdout: "osd_tracing": "false", 2026-02-26T03:15:58.281 INFO:teuthology.orchestra.run.trial086.stdout: "osd_use_stale_snap": "false", 2026-02-26T03:15:58.281 INFO:teuthology.orchestra.run.trial086.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2026-02-26T03:15:58.281 INFO:teuthology.orchestra.run.trial086.stdout: "osdc_blkin_trace_all": "false", 2026-02-26T03:15:58.281 INFO:teuthology.orchestra.run.trial086.stdout: "paxos_kill_at": "0", 2026-02-26T03:15:58.281 INFO:teuthology.orchestra.run.trial086.stdout: "paxos_max_join_drift": "10", 2026-02-26T03:15:58.281 INFO:teuthology.orchestra.run.trial086.stdout: "paxos_min": "500", 2026-02-26T03:15:58.281 INFO:teuthology.orchestra.run.trial086.stdout: "paxos_min_wait": "0.050000", 2026-02-26T03:15:58.281 INFO:teuthology.orchestra.run.trial086.stdout: "paxos_propose_interval": "1.000000", 2026-02-26T03:15:58.281 INFO:teuthology.orchestra.run.trial086.stdout: "paxos_service_trim_max": "500", 2026-02-26T03:15:58.281 INFO:teuthology.orchestra.run.trial086.stdout: "paxos_service_trim_max_multiplier": "20", 2026-02-26T03:15:58.281 INFO:teuthology.orchestra.run.trial086.stdout: "paxos_service_trim_min": "250", 2026-02-26T03:15:58.281 INFO:teuthology.orchestra.run.trial086.stdout: "paxos_stash_full_interval": "25", 2026-02-26T03:15:58.281 INFO:teuthology.orchestra.run.trial086.stdout: "paxos_trim_max": "500", 2026-02-26T03:15:58.281 INFO:teuthology.orchestra.run.trial086.stdout: "paxos_trim_min": "250", 2026-02-26T03:15:58.281 INFO:teuthology.orchestra.run.trial086.stdout: "perf": "true", 2026-02-26T03:15:58.281 INFO:teuthology.orchestra.run.trial086.stdout: "pid_file": "/var/run/ceph/ceph-osd.0.pid", 2026-02-26T03:15:58.281 INFO:teuthology.orchestra.run.trial086.stdout: "plugin_crypto_accelerator": "crypto_isal", 2026-02-26T03:15:58.281 INFO:teuthology.orchestra.run.trial086.stdout: "plugin_dir": "/usr/lib64/ceph", 2026-02-26T03:15:58.281 INFO:teuthology.orchestra.run.trial086.stdout: "pool_availability_update_interval": "1.000000", 2026-02-26T03:15:58.281 INFO:teuthology.orchestra.run.trial086.stdout: "public_addr": "-", 2026-02-26T03:15:58.281 INFO:teuthology.orchestra.run.trial086.stdout: "public_addrv": "", 2026-02-26T03:15:58.281 INFO:teuthology.orchestra.run.trial086.stdout: "public_bind_addr": "-", 2026-02-26T03:15:58.281 INFO:teuthology.orchestra.run.trial086.stdout: "public_network": "", 2026-02-26T03:15:58.281 INFO:teuthology.orchestra.run.trial086.stdout: "public_network_interface": "", 2026-02-26T03:15:58.281 INFO:teuthology.orchestra.run.trial086.stdout: "qat_compressor_busy_polling": "false", 2026-02-26T03:15:58.281 INFO:teuthology.orchestra.run.trial086.stdout: "qat_compressor_enabled": "false", 2026-02-26T03:15:58.281 INFO:teuthology.orchestra.run.trial086.stdout: "qat_compressor_session_max_number": "256", 2026-02-26T03:15:58.281 INFO:teuthology.orchestra.run.trial086.stdout: "rados_mon_op_timeout": "0", 2026-02-26T03:15:58.281 INFO:teuthology.orchestra.run.trial086.stdout: "rados_osd_op_timeout": "0", 2026-02-26T03:15:58.281 INFO:teuthology.orchestra.run.trial086.stdout: "rados_replica_read_policy": "default", 2026-02-26T03:15:58.281 INFO:teuthology.orchestra.run.trial086.stdout: "rados_replica_read_policy_on_objclass": "false", 2026-02-26T03:15:58.281 INFO:teuthology.orchestra.run.trial086.stdout: "rados_tracing": "false", 2026-02-26T03:15:58.281 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_atime_update_interval": "60", 2026-02-26T03:15:58.282 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2026-02-26T03:15:58.282 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_balance_parent_reads": "false", 2026-02-26T03:15:58.282 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_balance_snap_reads": "false", 2026-02-26T03:15:58.282 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_blkin_trace_all": "false", 2026-02-26T03:15:58.282 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_blocklist_expire_seconds": "0", 2026-02-26T03:15:58.282 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_blocklist_on_break_lock": "true", 2026-02-26T03:15:58.282 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_cache": "true", 2026-02-26T03:15:58.282 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_cache_block_writes_upfront": "false", 2026-02-26T03:15:58.282 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_cache_max_dirty": "25165824", 2026-02-26T03:15:58.282 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_cache_max_dirty_age": "1.000000", 2026-02-26T03:15:58.282 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_cache_max_dirty_object": "0", 2026-02-26T03:15:58.282 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_cache_policy": "writearound", 2026-02-26T03:15:58.282 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_cache_size": "33554432", 2026-02-26T03:15:58.282 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_cache_target_dirty": "16777216", 2026-02-26T03:15:58.282 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_cache_writethrough_until_flush": "true", 2026-02-26T03:15:58.282 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_clone_copy_on_read": "false", 2026-02-26T03:15:58.282 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_compression_hint": "none", 2026-02-26T03:15:58.282 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_concurrent_management_ops": "10", 2026-02-26T03:15:58.282 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_config_pool_override_update_timestamp": "0", 2026-02-26T03:15:58.282 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_default_clone_format": "auto", 2026-02-26T03:15:58.282 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_default_data_pool": "", 2026-02-26T03:15:58.282 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_default_features": "61", 2026-02-26T03:15:58.282 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_default_format": "2", 2026-02-26T03:15:58.282 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_default_map_options": "", 2026-02-26T03:15:58.282 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_default_order": "22", 2026-02-26T03:15:58.282 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_default_pool": "rbd", 2026-02-26T03:15:58.282 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2026-02-26T03:15:58.282 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_default_stripe_count": "0", 2026-02-26T03:15:58.282 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_default_stripe_unit": "0", 2026-02-26T03:15:58.282 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_disable_zero_copy_writes": "true", 2026-02-26T03:15:58.282 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_discard_granularity_bytes": "65536", 2026-02-26T03:15:58.282 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_discard_on_zeroed_write_same": "true", 2026-02-26T03:15:58.282 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_enable_alloc_hint": "true", 2026-02-26T03:15:58.282 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2026-02-26T03:15:58.282 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_io_scheduler": "simple", 2026-02-26T03:15:58.282 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2026-02-26T03:15:58.282 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_journal_commit_age": "5.000000", 2026-02-26T03:15:58.282 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2026-02-26T03:15:58.283 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_journal_max_payload_bytes": "16384", 2026-02-26T03:15:58.283 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_journal_object_flush_age": "0.000000", 2026-02-26T03:15:58.283 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_journal_object_flush_bytes": "1048576", 2026-02-26T03:15:58.283 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_journal_object_flush_interval": "0", 2026-02-26T03:15:58.283 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2026-02-26T03:15:58.283 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2026-02-26T03:15:58.283 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_journal_order": "24", 2026-02-26T03:15:58.283 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_journal_pool": "", 2026-02-26T03:15:58.283 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_journal_splay_width": "4", 2026-02-26T03:15:58.283 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_localize_parent_reads": "false", 2026-02-26T03:15:58.283 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_localize_snap_reads": "false", 2026-02-26T03:15:58.283 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2026-02-26T03:15:58.283 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2026-02-26T03:15:58.283 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2026-02-26T03:15:58.283 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2026-02-26T03:15:58.283 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2026-02-26T03:15:58.283 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2026-02-26T03:15:58.283 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_mirror_image_policy_type": "simple", 2026-02-26T03:15:58.283 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2026-02-26T03:15:58.283 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_mirror_image_state_check_interval": "30", 2026-02-26T03:15:58.283 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2026-02-26T03:15:58.283 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2026-02-26T03:15:58.283 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2026-02-26T03:15:58.283 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2026-02-26T03:15:58.283 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2026-02-26T03:15:58.283 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_mirror_memory_autotune": "true", 2026-02-26T03:15:58.283 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_mirror_memory_base": "805306368", 2026-02-26T03:15:58.283 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2026-02-26T03:15:58.283 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_mirror_memory_cache_min": "134217728", 2026-02-26T03:15:58.283 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2026-02-26T03:15:58.283 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2026-02-26T03:15:58.283 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_mirror_memory_target": "4294967296", 2026-02-26T03:15:58.283 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_mirror_perf_stats_prio": "5", 2026-02-26T03:15:58.283 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2026-02-26T03:15:58.283 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2026-02-26T03:15:58.283 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_mirroring_delete_delay": "0", 2026-02-26T03:15:58.283 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2026-02-26T03:15:58.283 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_mirroring_replay_delay": "0", 2026-02-26T03:15:58.283 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2026-02-26T03:15:58.283 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2026-02-26T03:15:58.283 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_move_to_trash_on_remove": "false", 2026-02-26T03:15:58.284 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2026-02-26T03:15:58.284 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_mtime_update_interval": "60", 2026-02-26T03:15:58.284 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_non_blocking_aio": "true", 2026-02-26T03:15:58.284 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_op_thread_timeout": "60", 2026-02-26T03:15:58.284 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_op_threads": "1", 2026-02-26T03:15:58.284 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_parent_cache_enabled": "false", 2026-02-26T03:15:58.284 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_persistent_cache_mode": "disabled", 2026-02-26T03:15:58.284 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_persistent_cache_path": "/tmp", 2026-02-26T03:15:58.284 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_persistent_cache_size": "1073741824", 2026-02-26T03:15:58.284 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_plugins": "", 2026-02-26T03:15:58.284 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_qos_bps_burst": "0", 2026-02-26T03:15:58.284 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_qos_bps_burst_seconds": "1", 2026-02-26T03:15:58.284 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_qos_bps_limit": "0", 2026-02-26T03:15:58.284 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_qos_exclude_ops": "0", 2026-02-26T03:15:58.284 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_qos_iops_burst": "0", 2026-02-26T03:15:58.284 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_qos_iops_burst_seconds": "1", 2026-02-26T03:15:58.284 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_qos_iops_limit": "0", 2026-02-26T03:15:58.284 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_qos_read_bps_burst": "0", 2026-02-26T03:15:58.284 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2026-02-26T03:15:58.284 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_qos_read_bps_limit": "0", 2026-02-26T03:15:58.284 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_qos_read_iops_burst": "0", 2026-02-26T03:15:58.284 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2026-02-26T03:15:58.284 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_qos_read_iops_limit": "0", 2026-02-26T03:15:58.284 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_qos_schedule_tick_min": "50", 2026-02-26T03:15:58.284 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_qos_write_bps_burst": "0", 2026-02-26T03:15:58.284 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2026-02-26T03:15:58.284 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_qos_write_bps_limit": "0", 2026-02-26T03:15:58.284 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_qos_write_iops_burst": "0", 2026-02-26T03:15:58.284 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2026-02-26T03:15:58.284 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_qos_write_iops_limit": "0", 2026-02-26T03:15:58.284 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_quiesce_notification_attempts": "10", 2026-02-26T03:15:58.284 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_read_from_replica_policy": "default", 2026-02-26T03:15:58.284 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2026-02-26T03:15:58.284 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_readahead_max_bytes": "524288", 2026-02-26T03:15:58.284 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_readahead_trigger_requests": "10", 2026-02-26T03:15:58.284 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_request_timed_out_seconds": "30", 2026-02-26T03:15:58.284 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_skip_partial_discard": "true", 2026-02-26T03:15:58.284 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2026-02-26T03:15:58.284 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_tracing": "false", 2026-02-26T03:15:58.284 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_validate_names": "true", 2026-02-26T03:15:58.285 INFO:teuthology.orchestra.run.trial086.stdout: "rbd_validate_pool": "true", 2026-02-26T03:15:58.285 INFO:teuthology.orchestra.run.trial086.stdout: "restapi_base_url": "", 2026-02-26T03:15:58.285 INFO:teuthology.orchestra.run.trial086.stdout: "restapi_log_level": "", 2026-02-26T03:15:58.285 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_account_default_quota_max_objects": "-1", 2026-02-26T03:15:58.285 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_account_default_quota_max_size": "-1", 2026-02-26T03:15:58.285 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_acl_grants_max_num": "100", 2026-02-26T03:15:58.285 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_admin_entry": "admin", 2026-02-26T03:15:58.285 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2026-02-26T03:15:58.285 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_asio_assert_yielding": "false", 2026-02-26T03:15:58.285 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_backend_store": "rados", 2026-02-26T03:15:58.285 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_barbican_url": "", 2026-02-26T03:15:58.285 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_beast_enable_async": "true", 2026-02-26T03:15:58.285 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_bucket_counters_cache": "false", 2026-02-26T03:15:58.285 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_bucket_counters_cache_size": "10000", 2026-02-26T03:15:58.285 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2026-02-26T03:15:58.285 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_bucket_default_quota_max_size": "-1", 2026-02-26T03:15:58.285 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_bucket_eexist_override": "false", 2026-02-26T03:15:58.285 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_bucket_index_max_aio": "128", 2026-02-26T03:15:58.285 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2026-02-26T03:15:58.285 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_bucket_logging_obj_roll_time": "300", 2026-02-26T03:15:58.285 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_bucket_persistent_notif_num_shards": "11", 2026-02-26T03:15:58.285 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_bucket_quota_cache_size": "10000", 2026-02-26T03:15:58.285 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_bucket_quota_ttl": "600", 2026-02-26T03:15:58.285 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_bucket_sync_spawn_window": "20", 2026-02-26T03:15:58.285 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_cache_enabled": "true", 2026-02-26T03:15:58.285 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_cache_expiry_interval": "900", 2026-02-26T03:15:58.285 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_cache_lru_size": "25000", 2026-02-26T03:15:58.285 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_config_store": "rados", 2026-02-26T03:15:58.285 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_content_length_compat": "false", 2026-02-26T03:15:58.285 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_copy_obj_progress": "true", 2026-02-26T03:15:58.285 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2026-02-26T03:15:58.285 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_cors_rules_max_num": "100", 2026-02-26T03:15:58.285 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_cross_domain_policy": "", 2026-02-26T03:15:58.285 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_crypt_default_encryption_key": "", 2026-02-26T03:15:58.285 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_crypt_kmip_addr": "", 2026-02-26T03:15:58.285 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_crypt_kmip_ca_path": "", 2026-02-26T03:15:58.285 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_crypt_kmip_client_cert": "", 2026-02-26T03:15:58.286 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_crypt_kmip_client_key": "", 2026-02-26T03:15:58.286 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_crypt_kmip_kms_key_template": "", 2026-02-26T03:15:58.286 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_crypt_kmip_password": "", 2026-02-26T03:15:58.286 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2026-02-26T03:15:58.286 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_crypt_kmip_username": "", 2026-02-26T03:15:58.286 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_crypt_require_ssl": "true", 2026-02-26T03:15:58.286 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2026-02-26T03:15:58.286 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2026-02-26T03:15:58.286 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_crypt_sse_s3_backend": "vault", 2026-02-26T03:15:58.286 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2026-02-26T03:15:58.286 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2026-02-26T03:15:58.286 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2026-02-26T03:15:58.286 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2026-02-26T03:15:58.286 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2026-02-26T03:15:58.286 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2026-02-26T03:15:58.286 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2026-02-26T03:15:58.286 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2026-02-26T03:15:58.286 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2026-02-26T03:15:58.286 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2026-02-26T03:15:58.286 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2026-02-26T03:15:58.286 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_crypt_suppress_logs": "true", 2026-02-26T03:15:58.286 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_crypt_vault_addr": "", 2026-02-26T03:15:58.286 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_crypt_vault_auth": "token", 2026-02-26T03:15:58.286 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_crypt_vault_namespace": "", 2026-02-26T03:15:58.286 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_crypt_vault_prefix": "", 2026-02-26T03:15:58.287 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_crypt_vault_secret_engine": "transit", 2026-02-26T03:15:58.287 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_crypt_vault_ssl_cacert": "", 2026-02-26T03:15:58.287 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2026-02-26T03:15:58.287 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2026-02-26T03:15:58.287 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_crypt_vault_token_file": "", 2026-02-26T03:15:58.287 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_crypt_vault_verify_ssl": "true", 2026-02-26T03:15:58.287 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_curl_buffersize": "524288", 2026-02-26T03:15:58.287 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_curl_low_speed_limit": "1024", 2026-02-26T03:15:58.287 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_curl_low_speed_time": "300", 2026-02-26T03:15:58.287 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_curl_tcp_keepalive": "0", 2026-02-26T03:15:58.287 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_curl_wait_timeout_ms": "1000", 2026-02-26T03:15:58.287 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2026-02-26T03:15:58.287 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2026-02-26T03:15:58.287 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2026-02-26T03:15:58.287 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2026-02-26T03:15:58.287 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_d3n_l1_fadvise": "4", 2026-02-26T03:15:58.287 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2026-02-26T03:15:58.287 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_d3n_libaio_aio_num": "64", 2026-02-26T03:15:58.287 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_d3n_libaio_aio_threads": "20", 2026-02-26T03:15:58.287 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_d4n_address": "127.0.0.1:6379", 2026-02-26T03:15:58.287 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_d4n_backend_address": "127.0.0.1:6379", 2026-02-26T03:15:58.287 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_d4n_cache_cleaning_interval": "1000", 2026-02-26T03:15:58.287 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_d4n_l1_datacache_address": "127.0.0.1:6379", 2026-02-26T03:15:58.287 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_d4n_l1_datacache_disk_reserve": "1073741824", 2026-02-26T03:15:58.287 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2026-02-26T03:15:58.287 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2026-02-26T03:15:58.287 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_d4n_l1_fadvise": "4", 2026-02-26T03:15:58.287 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_d4n_l1_write_open_flags": "4096", 2026-02-26T03:15:58.287 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_d4n_libaio_aio_num": "64", 2026-02-26T03:15:58.287 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_d4n_libaio_aio_threads": "20", 2026-02-26T03:15:58.287 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_d4n_local_rgw_address": "127.0.0.1:8000", 2026-02-26T03:15:58.287 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-0", 2026-02-26T03:15:58.287 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_data_log_changes_size": "1000", 2026-02-26T03:15:58.287 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_data_log_num_shards": "128", 2026-02-26T03:15:58.287 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_data_log_window": "30", 2026-02-26T03:15:58.287 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_data_notify_interval_msec": "0", 2026-02-26T03:15:58.287 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_data_sync_poll_interval": "20", 2026-02-26T03:15:58.288 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_data_sync_spawn_window": "20", 2026-02-26T03:15:58.288 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2026-02-26T03:15:58.288 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2026-02-26T03:15:58.288 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_debug_inject_set_olh_err": "0", 2026-02-26T03:15:58.288 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_default_data_log_backing": "fifo", 2026-02-26T03:15:58.288 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_default_realm_info_oid": "default.realm", 2026-02-26T03:15:58.288 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_default_region_info_oid": "default.region", 2026-02-26T03:15:58.288 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_default_zone_info_oid": "default.zone", 2026-02-26T03:15:58.288 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2026-02-26T03:15:58.288 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_defer_to_bucket_acls": "", 2026-02-26T03:15:58.288 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_delete_multi_obj_max_num": "1000", 2026-02-26T03:15:58.288 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_disable_s3select": "false", 2026-02-26T03:15:58.288 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_dmclock_admin_lim": "0.000000", 2026-02-26T03:15:58.288 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_dmclock_admin_res": "100.000000", 2026-02-26T03:15:58.288 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2026-02-26T03:15:58.288 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_dmclock_auth_lim": "0.000000", 2026-02-26T03:15:58.288 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_dmclock_auth_res": "200.000000", 2026-02-26T03:15:58.288 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2026-02-26T03:15:58.288 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_dmclock_data_lim": "0.000000", 2026-02-26T03:15:58.288 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_dmclock_data_res": "500.000000", 2026-02-26T03:15:58.288 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_dmclock_data_wgt": "500.000000", 2026-02-26T03:15:58.288 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2026-02-26T03:15:58.288 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_dmclock_metadata_res": "500.000000", 2026-02-26T03:15:58.288 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2026-02-26T03:15:58.288 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_dns_name": "", 2026-02-26T03:15:58.288 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_dns_s3website_name": "", 2026-02-26T03:15:58.288 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_dynamic_resharding": "true", 2026-02-26T03:15:58.288 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_dynamic_resharding_may_reduce": "true", 2026-02-26T03:15:58.288 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_dynamic_resharding_reduction_wait": "120", 2026-02-26T03:15:58.288 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2026-02-26T03:15:58.288 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_enable_gc_threads": "true", 2026-02-26T03:15:58.288 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_enable_jwks_url_verification": "false", 2026-02-26T03:15:58.288 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_enable_lc_threads": "true", 2026-02-26T03:15:58.288 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_enable_mdsearch": "true", 2026-02-26T03:15:58.288 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_enable_ops_log": "false", 2026-02-26T03:15:58.288 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_enable_quota_threads": "true", 2026-02-26T03:15:58.288 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_enable_restore_threads": "true", 2026-02-26T03:15:58.288 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_enable_static_website": "false", 2026-02-26T03:15:58.288 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_enable_usage_log": "false", 2026-02-26T03:15:58.288 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_enforce_swift_acls": "true", 2026-02-26T03:15:58.288 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_exit_timeout_secs": "120", 2026-02-26T03:15:58.288 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_expose_bucket": "false", 2026-02-26T03:15:58.288 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_extended_http_attrs": "", 2026-02-26T03:15:58.289 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_filter": "none", 2026-02-26T03:15:58.289 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2026-02-26T03:15:58.289 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_frontends": "beast port=7480", 2026-02-26T03:15:58.289 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_gc_max_concurrent_io": "10", 2026-02-26T03:15:58.289 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_gc_max_deferred": "50", 2026-02-26T03:15:58.289 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2026-02-26T03:15:58.289 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_gc_max_objs": "32", 2026-02-26T03:15:58.289 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_gc_max_queue_size": "134213632", 2026-02-26T03:15:58.289 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_gc_max_trim_chunk": "16", 2026-02-26T03:15:58.289 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_gc_obj_min_wait": "7200", 2026-02-26T03:15:58.289 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_gc_processor_max_time": "3600", 2026-02-26T03:15:58.289 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_gc_processor_period": "3600", 2026-02-26T03:15:58.289 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_get_obj_max_req_size": "4194304", 2026-02-26T03:15:58.289 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_get_obj_window_size": "16777216", 2026-02-26T03:15:58.289 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_graceful_stop": "false", 2026-02-26T03:15:58.289 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_healthcheck_disabling_path": "", 2026-02-26T03:15:58.289 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_http_notif_connection_timeout": "5", 2026-02-26T03:15:58.289 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_http_notif_max_inflight": "8192", 2026-02-26T03:15:58.289 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_http_notif_message_timeout": "10", 2026-02-26T03:15:58.289 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_ignore_get_invalid_range": "false", 2026-02-26T03:15:58.289 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_init_timeout": "300", 2026-02-26T03:15:58.289 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2026-02-26T03:15:58.289 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2026-02-26T03:15:58.289 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_kafka_connection_idle": "300", 2026-02-26T03:15:58.289 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_kafka_message_timeout": "5000", 2026-02-26T03:15:58.289 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_kafka_sleep_timeout": "10", 2026-02-26T03:15:58.289 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_keystone_accepted_admin_roles": "", 2026-02-26T03:15:58.289 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_keystone_accepted_reader_roles": "", 2026-02-26T03:15:58.289 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2026-02-26T03:15:58.289 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_keystone_admin_domain": "", 2026-02-26T03:15:58.289 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_keystone_admin_password": "", 2026-02-26T03:15:58.289 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_keystone_admin_password_path": "", 2026-02-26T03:15:58.289 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_keystone_admin_project": "", 2026-02-26T03:15:58.289 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_keystone_admin_tenant": "", 2026-02-26T03:15:58.289 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_keystone_admin_user": "", 2026-02-26T03:15:58.289 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_keystone_barbican_domain": "", 2026-02-26T03:15:58.289 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_keystone_barbican_password": "", 2026-02-26T03:15:58.289 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_keystone_barbican_project": "", 2026-02-26T03:15:58.289 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_keystone_barbican_tenant": "", 2026-02-26T03:15:58.289 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_keystone_barbican_user": "", 2026-02-26T03:15:58.289 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2026-02-26T03:15:58.289 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_keystone_implicit_tenants": "false", 2026-02-26T03:15:58.289 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2026-02-26T03:15:58.290 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_keystone_service_token_enabled": "false", 2026-02-26T03:15:58.290 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_keystone_token_cache_size": "10000", 2026-02-26T03:15:58.290 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_keystone_token_cache_ttl": "300", 2026-02-26T03:15:58.290 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_keystone_url": "", 2026-02-26T03:15:58.290 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_keystone_verify_ssl": "true", 2026-02-26T03:15:58.290 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_lc_debug_interval": "-1", 2026-02-26T03:15:58.290 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_lc_list_cnt": "1000", 2026-02-26T03:15:58.290 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_lc_lock_max_time": "90", 2026-02-26T03:15:58.290 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_lc_max_objs": "32", 2026-02-26T03:15:58.290 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_lc_max_rules": "1000", 2026-02-26T03:15:58.290 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_lc_max_worker": "3", 2026-02-26T03:15:58.290 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_lc_max_wp_worker": "128", 2026-02-26T03:15:58.290 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_lc_ordered_list_threshold": "500", 2026-02-26T03:15:58.290 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_lc_thread_delay": "0", 2026-02-26T03:15:58.290 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2026-02-26T03:15:58.290 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_ldap_dnattr": "uid", 2026-02-26T03:15:58.290 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2026-02-26T03:15:58.290 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_ldap_searchfilter": "", 2026-02-26T03:15:58.290 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2026-02-26T03:15:58.290 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_ldap_uri": "", 2026-02-26T03:15:58.290 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_lfuda_sync_frequency": "60", 2026-02-26T03:15:58.290 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2026-02-26T03:15:58.290 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_list_bucket_min_readahead": "1000", 2026-02-26T03:15:58.290 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_list_buckets_max_chunk": "1000", 2026-02-26T03:15:58.290 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_log_http_headers": "", 2026-02-26T03:15:58.290 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_log_nonexistent_bucket": "false", 2026-02-26T03:15:58.290 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2026-02-26T03:15:58.290 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_log_object_name_utc": "false", 2026-02-26T03:15:58.290 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_lua_enable": "true", 2026-02-26T03:15:58.290 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_lua_max_memory_per_state": "128000", 2026-02-26T03:15:58.290 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_lua_max_runtime_per_state": "1000", 2026-02-26T03:15:58.290 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/osd.0", 2026-02-26T03:15:58.290 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_max_attr_name_len": "0", 2026-02-26T03:15:58.290 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_max_attr_size": "0", 2026-02-26T03:15:58.290 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_max_attrs_num_in_req": "0", 2026-02-26T03:15:58.290 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_max_chunk_size": "4194304", 2026-02-26T03:15:58.290 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_max_concurrent_requests": "1024", 2026-02-26T03:15:58.290 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_max_control_aio": "8", 2026-02-26T03:15:58.290 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2026-02-26T03:15:58.290 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_max_dynamic_shards": "1999", 2026-02-26T03:15:58.290 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_max_listing_results": "5000", 2026-02-26T03:15:58.290 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_max_notify_retries": "10", 2026-02-26T03:15:58.290 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_max_objs_per_shard": "100000", 2026-02-26T03:15:58.290 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_max_put_param_size": "1048576", 2026-02-26T03:15:58.291 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_max_put_size": "5368709120", 2026-02-26T03:15:58.291 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_max_slo_entries": "1000", 2026-02-26T03:15:58.291 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_md_log_max_shards": "64", 2026-02-26T03:15:58.291 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_md_notify_interval_msec": "200", 2026-02-26T03:15:58.291 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_meta_sync_poll_interval": "20", 2026-02-26T03:15:58.291 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_meta_sync_spawn_window": "20", 2026-02-26T03:15:58.291 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_mime_types_file": "/etc/mime.types", 2026-02-26T03:15:58.291 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_mp_lock_max_time": "600", 2026-02-26T03:15:58.291 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_multi_obj_del_max_aio": "16", 2026-02-26T03:15:58.291 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_multipart_min_part_size": "5242880", 2026-02-26T03:15:58.291 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_multipart_part_upload_limit": "10000", 2026-02-26T03:15:58.291 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_nfs_fhcache_partitions": "3", 2026-02-26T03:15:58.291 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_nfs_fhcache_size": "2017", 2026-02-26T03:15:58.291 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_nfs_frontends": "rgw-nfs", 2026-02-26T03:15:58.291 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2026-02-26T03:15:58.291 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_nfs_lru_lanes": "5", 2026-02-26T03:15:58.291 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_nfs_max_gc": "300", 2026-02-26T03:15:58.291 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_nfs_namespace_expire_secs": "300", 2026-02-26T03:15:58.291 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_nfs_run_gc_threads": "false", 2026-02-26T03:15:58.291 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_nfs_run_lc_threads": "false", 2026-02-26T03:15:58.291 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_nfs_run_quota_threads": "false", 2026-02-26T03:15:58.291 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_nfs_run_restore_threads": "false", 2026-02-26T03:15:58.291 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_nfs_run_sync_thread": "false", 2026-02-26T03:15:58.291 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_nfs_s3_fast_attrs": "false", 2026-02-26T03:15:58.291 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_nfs_write_completion_interval_s": "10", 2026-02-26T03:15:58.291 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_num_async_rados_threads": "32", 2026-02-26T03:15:58.291 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_num_control_oids": "8", 2026-02-26T03:15:58.291 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_numa_node": "-1", 2026-02-26T03:15:58.291 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_obj_stripe_size": "4194304", 2026-02-26T03:15:58.291 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_obj_tombstone_cache_size": "1000", 2026-02-26T03:15:58.291 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_objexp_chunk_size": "100", 2026-02-26T03:15:58.291 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_objexp_gc_interval": "600", 2026-02-26T03:15:58.291 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_objexp_hints_num_shards": "127", 2026-02-26T03:15:58.291 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_olh_pending_timeout_sec": "3600", 2026-02-26T03:15:58.291 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_op_thread_suicide_timeout": "0", 2026-02-26T03:15:58.291 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_op_thread_timeout": "600", 2026-02-26T03:15:58.291 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_op_tracing": "false", 2026-02-26T03:15:58.291 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_opa_token": "", 2026-02-26T03:15:58.291 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_opa_url": "", 2026-02-26T03:15:58.291 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_opa_verify_ssl": "true", 2026-02-26T03:15:58.291 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_ops_log_data_backlog": "5242880", 2026-02-26T03:15:58.291 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-osd.0.log", 2026-02-26T03:15:58.291 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_ops_log_rados": "false", 2026-02-26T03:15:58.291 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_ops_log_socket_path": "", 2026-02-26T03:15:58.291 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_override_bucket_index_max_shards": "0", 2026-02-26T03:15:58.291 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_parquet_buffer_size": "16777216", 2026-02-26T03:15:58.292 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2026-02-26T03:15:58.292 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2026-02-26T03:15:58.292 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_period_push_interval": "2.000000", 2026-02-26T03:15:58.292 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_period_push_interval_max": "30.000000", 2026-02-26T03:15:58.292 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_period_root_pool": ".rgw.root", 2026-02-26T03:15:58.292 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_policy_reject_invalid_principals": "true", 2026-02-26T03:15:58.292 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2026-02-26T03:15:58.292 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_posix_cache_lanes": "3", 2026-02-26T03:15:58.292 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_posix_cache_lmdb_count": "3", 2026-02-26T03:15:58.292 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_posix_cache_max_buckets": "100", 2026-02-26T03:15:58.292 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_posix_cache_partitions": "3", 2026-02-26T03:15:58.292 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2026-02-26T03:15:58.292 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_posix_userdb_dir": "/var/lib/ceph/radosgw", 2026-02-26T03:15:58.292 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_print_continue": "true", 2026-02-26T03:15:58.292 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_print_prohibited_content_length": "false", 2026-02-26T03:15:58.292 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_put_obj_max_window_size": "67108864", 2026-02-26T03:15:58.292 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_put_obj_min_window_size": "16777216", 2026-02-26T03:15:58.292 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2026-02-26T03:15:58.292 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_rados_pool_recovery_priority": "5", 2026-02-26T03:15:58.292 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_rados_tracing": "false", 2026-02-26T03:15:58.292 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_ratelimit_interval": "60", 2026-02-26T03:15:58.292 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_realm": "", 2026-02-26T03:15:58.292 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_realm_id": "", 2026-02-26T03:15:58.292 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_realm_root_pool": ".rgw.root", 2026-02-26T03:15:58.292 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_redis_connection_pool_size": "512", 2026-02-26T03:15:58.292 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_region": "", 2026-02-26T03:15:58.292 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_region_root_pool": ".rgw.root", 2026-02-26T03:15:58.292 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_relaxed_region_enforcement": "false", 2026-02-26T03:15:58.292 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_relaxed_s3_bucket_names": "false", 2026-02-26T03:15:58.292 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2026-02-26T03:15:58.292 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_request_uri": "", 2026-02-26T03:15:58.292 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_reshard_batch_size": "64", 2026-02-26T03:15:58.292 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_reshard_bucket_lock_duration": "360", 2026-02-26T03:15:58.292 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_reshard_debug_interval": "-1", 2026-02-26T03:15:58.292 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_reshard_max_aio": "128", 2026-02-26T03:15:58.292 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_reshard_num_logs": "16", 2026-02-26T03:15:58.292 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_reshard_progress_judge_interval": "120", 2026-02-26T03:15:58.292 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_reshard_progress_judge_ratio": "0.500000", 2026-02-26T03:15:58.292 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_reshard_thread_interval": "600", 2026-02-26T03:15:58.292 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_reshardlog_threshold": "30000", 2026-02-26T03:15:58.292 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_resolve_cname": "false", 2026-02-26T03:15:58.292 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_rest_getusage_op_compat": "false", 2026-02-26T03:15:58.292 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_restore_debug_interval": "-1", 2026-02-26T03:15:58.292 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_restore_lock_max_time": "90", 2026-02-26T03:15:58.292 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_restore_max_objs": "32", 2026-02-26T03:15:58.292 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_restore_processor_period": "900", 2026-02-26T03:15:58.292 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_run_sync_thread": "true", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_s3_auth_disable_signature_url": "false", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_s3_auth_order": "sts, external, local", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_s3_auth_use_keystone": "false", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_s3_auth_use_ldap": "false", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_s3_auth_use_rados": "true", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_s3_auth_use_sts": "false", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_s3_client_max_sig_ver": "-1", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_s3_success_create_obj_status": "0", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_safe_max_objects_per_shard": "102400", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_scheduler_type": "throttler", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_script_uri": "", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_service_provider_name": "", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_shard_warning_threshold": "90.000000", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_sts_client_id": "", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_sts_client_secret": "", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_sts_entry": "sts", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_sts_key": "", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_sts_max_session_duration": "43200", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_sts_min_session_duration": "900", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_sts_token_introspection_url": "", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_swift_account_in_url": "false", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_swift_auth_entry": "auth", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_swift_auth_url": "", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_swift_custom_header": "", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_swift_enforce_content_length": "false", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_swift_need_stats": "true", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_swift_tenant_name": "", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_swift_token_expiration": "86400", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_swift_url": "", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_swift_url_prefix": "swift", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_swift_versioning_enabled": "false", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_sync_lease_period": "120", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_sync_log_trim_interval": "1200", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_sync_log_trim_max_buckets": "16", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_sync_obj_etag_verify": "false", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_sync_trace_history_size": "4096", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_sync_trace_per_node_log_size": "32", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_thread_pool_size": "512", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_topic_persistency_max_retries": "0", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_topic_persistency_sleep_duration": "0", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_topic_persistency_time_to_live": "0", 2026-02-26T03:15:58.293 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_topic_require_publish_policy": "false", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_torrent_comment": "", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_torrent_createby": "", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_torrent_encoding": "", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_torrent_flag": "false", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_torrent_max_size": "5368709120", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_torrent_origin": "", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_torrent_sha_unit": "524288", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_torrent_tracker": "", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_trust_forwarded_https": "false", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_usage_log_flush_threshold": "1024", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_usage_log_key_transition": "true", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_usage_log_tick_interval": "30", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_usage_max_shards": "32", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_usage_max_user_shards": "1", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_use_opa_authz": "false", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_user_counters_cache": "false", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_user_counters_cache_size": "10000", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_user_default_quota_max_objects": "-1", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_user_default_quota_max_size": "-1", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_user_max_buckets": "1000", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_user_policies_max_num": "100", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_user_quota_sync_idle_users": "false", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_user_quota_sync_interval": "86400", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_user_quota_sync_wait_time": "86400", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_user_unique_email": "true", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_verify_ssl": "true", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_website_routing_rules_max_num": "50", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_zone": "", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_zone_id": "", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_zone_root_pool": ".rgw.root", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_zonegroup": "", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_zonegroup_id": "", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rgwlc_auto_session_clear": "true", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rgwlc_skip_bucket_step": "false", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rocksdb_block_size": "4096", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rocksdb_bloom_bits_per_key": "20", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rocksdb_cache_row_ratio": "0.000000", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rocksdb_cache_shard_bits": "4", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rocksdb_cache_size": "536870912", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rocksdb_cache_type": "binned_lru", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rocksdb_cf_compact_on_deletion": "true", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2026-02-26T03:15:58.294 INFO:teuthology.orchestra.run.trial086.stdout: "rocksdb_collect_compaction_stats": "false", 2026-02-26T03:15:58.295 INFO:teuthology.orchestra.run.trial086.stdout: "rocksdb_collect_extended_stats": "false", 2026-02-26T03:15:58.295 INFO:teuthology.orchestra.run.trial086.stdout: "rocksdb_collect_memory_stats": "false", 2026-02-26T03:15:58.295 INFO:teuthology.orchestra.run.trial086.stdout: "rocksdb_delete_range_threshold": "1048576", 2026-02-26T03:15:58.295 INFO:teuthology.orchestra.run.trial086.stdout: "rocksdb_index_type": "binary_search", 2026-02-26T03:15:58.295 INFO:teuthology.orchestra.run.trial086.stdout: "rocksdb_log_to_ceph_log": "true", 2026-02-26T03:15:58.295 INFO:teuthology.orchestra.run.trial086.stdout: "rocksdb_metadata_block_size": "4096", 2026-02-26T03:15:58.295 INFO:teuthology.orchestra.run.trial086.stdout: "rocksdb_partition_filters": "false", 2026-02-26T03:15:58.295 INFO:teuthology.orchestra.run.trial086.stdout: "rocksdb_perf": "false", 2026-02-26T03:15:58.295 INFO:teuthology.orchestra.run.trial086.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2026-02-26T03:15:58.295 INFO:teuthology.orchestra.run.trial086.stdout: "rotating_keys_bootstrap_timeout": "30", 2026-02-26T03:15:58.295 INFO:teuthology.orchestra.run.trial086.stdout: "rotating_keys_renewal_timeout": "10", 2026-02-26T03:15:58.295 INFO:teuthology.orchestra.run.trial086.stdout: "run_dir": "/var/run/ceph", 2026-02-26T03:15:58.295 INFO:teuthology.orchestra.run.trial086.stdout: "seastore_block_create": "true", 2026-02-26T03:15:58.295 INFO:teuthology.orchestra.run.trial086.stdout: "seastore_cachepin_2q_in_ratio": "0.500000", 2026-02-26T03:15:58.295 INFO:teuthology.orchestra.run.trial086.stdout: "seastore_cachepin_2q_out_ratio": "0.500000", 2026-02-26T03:15:58.295 INFO:teuthology.orchestra.run.trial086.stdout: "seastore_cachepin_size_pershard": "67108864", 2026-02-26T03:15:58.295 INFO:teuthology.orchestra.run.trial086.stdout: "seastore_cachepin_type": "LRU", 2026-02-26T03:15:58.295 INFO:teuthology.orchestra.run.trial086.stdout: "seastore_cbjournal_size": "5368709120", 2026-02-26T03:15:58.295 INFO:teuthology.orchestra.run.trial086.stdout: "seastore_cold_tier_generations": "3", 2026-02-26T03:15:58.295 INFO:teuthology.orchestra.run.trial086.stdout: "seastore_data_delta_based_overwrite": "0", 2026-02-26T03:15:58.295 INFO:teuthology.orchestra.run.trial086.stdout: "seastore_default_max_object_size": "16777216", 2026-02-26T03:15:58.295 INFO:teuthology.orchestra.run.trial086.stdout: "seastore_default_object_metadata_reservation": "16777216", 2026-02-26T03:15:58.295 INFO:teuthology.orchestra.run.trial086.stdout: "seastore_device_size": "53687091200", 2026-02-26T03:15:58.295 INFO:teuthology.orchestra.run.trial086.stdout: "seastore_disable_end_to_end_data_protection": "true", 2026-02-26T03:15:58.295 INFO:teuthology.orchestra.run.trial086.stdout: "seastore_full_integrity_check": "false", 2026-02-26T03:15:58.295 INFO:teuthology.orchestra.run.trial086.stdout: "seastore_hot_tier_generations": "5", 2026-02-26T03:15:58.295 INFO:teuthology.orchestra.run.trial086.stdout: "seastore_journal_batch_capacity": "16", 2026-02-26T03:15:58.295 INFO:teuthology.orchestra.run.trial086.stdout: "seastore_journal_batch_flush_size": "16777216", 2026-02-26T03:15:58.295 INFO:teuthology.orchestra.run.trial086.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2026-02-26T03:15:58.295 INFO:teuthology.orchestra.run.trial086.stdout: "seastore_journal_iodepth_limit": "5", 2026-02-26T03:15:58.295 INFO:teuthology.orchestra.run.trial086.stdout: "seastore_main_device_type": "SSD", 2026-02-26T03:15:58.295 INFO:teuthology.orchestra.run.trial086.stdout: "seastore_max_concurrent_transactions": "8", 2026-02-26T03:15:58.295 INFO:teuthology.orchestra.run.trial086.stdout: "seastore_max_data_allocation_size": "0", 2026-02-26T03:15:58.295 INFO:teuthology.orchestra.run.trial086.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2026-02-26T03:15:58.295 INFO:teuthology.orchestra.run.trial086.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2026-02-26T03:15:58.295 INFO:teuthology.orchestra.run.trial086.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2026-02-26T03:15:58.295 INFO:teuthology.orchestra.run.trial086.stdout: "seastore_segment_cleaner_gc_formula": "cost_benefit", 2026-02-26T03:15:58.295 INFO:teuthology.orchestra.run.trial086.stdout: "seastore_segment_size": "67108864", 2026-02-26T03:15:58.295 INFO:teuthology.orchestra.run.trial086.stdout: "service_unique_id": "", 2026-02-26T03:15:58.295 INFO:teuthology.orchestra.run.trial086.stdout: "set_keepcaps": "false", 2026-02-26T03:15:58.295 INFO:teuthology.orchestra.run.trial086.stdout: "setgroup": "", 2026-02-26T03:15:58.295 INFO:teuthology.orchestra.run.trial086.stdout: "setuser": "", 2026-02-26T03:15:58.295 INFO:teuthology.orchestra.run.trial086.stdout: "setuser_match_path": "", 2026-02-26T03:15:58.296 INFO:teuthology.orchestra.run.trial086.stdout: "subv_metrics_window_interval": "30", 2026-02-26T03:15:58.296 INFO:teuthology.orchestra.run.trial086.stdout: "target_max_misplaced_ratio": "0.050000", 2026-02-26T03:15:58.296 INFO:teuthology.orchestra.run.trial086.stdout: "thp": "false", 2026-02-26T03:15:58.296 INFO:teuthology.orchestra.run.trial086.stdout: "threadpool_default_timeout": "60", 2026-02-26T03:15:58.296 INFO:teuthology.orchestra.run.trial086.stdout: "threadpool_empty_queue_max_wait": "2", 2026-02-26T03:15:58.296 INFO:teuthology.orchestra.run.trial086.stdout: "throttler_perf_counter": "true", 2026-02-26T03:15:58.296 INFO:teuthology.orchestra.run.trial086.stdout: "tmp_dir": "/tmp", 2026-02-26T03:15:58.296 INFO:teuthology.orchestra.run.trial086.stdout: "tmp_file_template": "/tmp/ceph-osd.0.XXXXXX", 2026-02-26T03:15:58.296 INFO:teuthology.orchestra.run.trial086.stdout: "uadk_compressor_enabled": "false", 2026-02-26T03:15:58.296 INFO:teuthology.orchestra.run.trial086.stdout: "uadk_wd_sync_ctx_num": "2" 2026-02-26T03:15:58.296 INFO:teuthology.orchestra.run.trial086.stdout:} 2026-02-26T03:15:58.297 INFO:tasks.ceph_objectstore_tool:seastore_main_device_type is SSD... 2026-02-26T03:15:58.297 INFO:tasks.ceph_objectstore_tool:pgnum: 8 2026-02-26T03:15:58.297 DEBUG:teuthology.orchestra.run.trial086:> sudo ceph osd pool create rep_pool 8 8 --cluster ceph 2026-02-26T03:15:58.370 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:58.362+0000 7fea3f0cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:58.373 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:58.370+0000 7fea3f0cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:59.107 INFO:teuthology.orchestra.run.trial086.stderr:pool 'rep_pool' created 2026-02-26T03:15:59.121 INFO:tasks.ceph_objectstore_tool:objects: 5 2026-02-26T03:15:59.122 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-26T03:15:59.199 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:59.193+0000 7fe8cd65a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:59.202 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:59.198+0000 7fe8cd65a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:59.314 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:15:59.314 INFO:teuthology.orchestra.run.trial086.stdout:{"epoch":20,"fsid":"a3320112-ec0c-4bb6-bf8e-5331f894afbc","created":"2026-02-26T03:15:31.523265+0000","modified":"2026-02-26T03:15:59.102428+0000","last_up_change":"2026-02-26T03:15:45.062898+0000","last_in_change":"2026-02-26T03:15:33.471683+0000","flags":"nodown,noout,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5800128,"flags_set":["nodown","noout","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-26T03:15:45.957480+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-26T03:15:47.799106+0000","flags":270337,"flags_names":"hashpspool,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"rep_pool","create_time":"2026-02-26T03:15:58.484444+0000","flags":294913,"flags_names":"hashpspool,creating,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b692f9c9-579d-4a92-b02c-beefe594ff12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6809","nonce":1229323153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6810","nonce":1229323153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6816","nonce":1229323153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6817","nonce":1229323153}]},"public_addr":"10.20.193.86:6809/1229323153","cluster_addr":"10.20.193.86:6810/1229323153","heartbeat_back_addr":"10.20.193.86:6816/1229323153","heartbeat_front_addr":"10.20.193.86:6817/1229323153","state":["exists","up"]},{"osd":1,"uuid":"1935ef84-dee5-4745-8c38-6435b71c819c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6803","nonce":2744027137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6802","nonce":2744027137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6808","nonce":2744027137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6811","nonce":2744027137}]},"public_addr":"10.20.193.86:6803/2744027137","cluster_addr":"10.20.193.86:6802/2744027137","heartbeat_back_addr":"10.20.193.86:6808/2744027137","heartbeat_front_addr":"10.20.193.86:6811/2744027137","state":["exists","up"]},{"osd":2,"uuid":"bf958cf8-549c-42c6-9510-269812a65fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6805","nonce":3653919688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6804","nonce":3653919688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6813","nonce":3653919688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6812","nonce":3653919688}]},"public_addr":"10.20.193.86:6805/3653919688","cluster_addr":"10.20.193.86:6804/3653919688","heartbeat_back_addr":"10.20.193.86:6813/3653919688","heartbeat_front_addr":"10.20.193.86:6812/3653919688","state":["exists","up"]},{"osd":3,"uuid":"cf449d79-9ec0-4e20-a163-3ce8ac17c2cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6806","nonce":2128187350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6807","nonce":2128187350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6815","nonce":2128187350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6814","nonce":2128187350}]},"public_addr":"10.20.193.86:6806/2128187350","cluster_addr":"10.20.193.86:6807/2128187350","heartbeat_back_addr":"10.20.193.86:6815/2128187350","heartbeat_front_addr":"10.20.193.86:6814/2128187350","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-26T03:15:59.324 DEBUG:tasks.ceph_objectstore_tool:repid=3 2026-02-26T03:15:59.337 DEBUG:teuthology.orchestra.run.trial086:> rm -f /home/ubuntu/cephtest/ceph.data/REPobject1 2026-02-26T03:15:59.355 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-26T03:15:59.356 DEBUG:teuthology.orchestra.run.trial086:> dd of=/home/ubuntu/cephtest/ceph.data/REPobject1 2026-02-26T03:15:59.410 DEBUG:teuthology.orchestra.run.trial086:> rm -f /home/ubuntu/cephtest/ceph.data/REPobject2 2026-02-26T03:15:59.466 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-26T03:15:59.466 DEBUG:teuthology.orchestra.run.trial086:> dd of=/home/ubuntu/cephtest/ceph.data/REPobject2 2026-02-26T03:15:59.525 DEBUG:teuthology.orchestra.run.trial086:> rm -f /home/ubuntu/cephtest/ceph.data/REPobject3 2026-02-26T03:15:59.582 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-26T03:15:59.582 DEBUG:teuthology.orchestra.run.trial086:> dd of=/home/ubuntu/cephtest/ceph.data/REPobject3 2026-02-26T03:15:59.637 DEBUG:teuthology.orchestra.run.trial086:> rm -f /home/ubuntu/cephtest/ceph.data/REPobject4 2026-02-26T03:15:59.694 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-26T03:15:59.694 DEBUG:teuthology.orchestra.run.trial086:> dd of=/home/ubuntu/cephtest/ceph.data/REPobject4 2026-02-26T03:15:59.753 DEBUG:teuthology.orchestra.run.trial086:> rm -f /home/ubuntu/cephtest/ceph.data/REPobject5 2026-02-26T03:15:59.809 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-26T03:15:59.809 DEBUG:teuthology.orchestra.run.trial086:> dd of=/home/ubuntu/cephtest/ceph.data/REPobject5 2026-02-26T03:15:59.865 INFO:tasks.ceph_objectstore_tool:Creating 5 objects in pool 2026-02-26T03:15:59.866 INFO:tasks.util.rados:rados -p rep_pool put REPobject1 /home/ubuntu/cephtest/ceph.data/REPobject1 2026-02-26T03:15:59.866 DEBUG:teuthology.orchestra.run.trial086:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p rep_pool put REPobject1 /home/ubuntu/cephtest/ceph.data/REPobject1 2026-02-26T03:15:59.943 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:59.940+0000 7f2152a95ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:59.946 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:59.943+0000 7f2152a95ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:15:59.946 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:15:59.943+0000 7f2152a95ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:00.180 INFO:tasks.util.rados:rados -p rep_pool put REPobject2 /home/ubuntu/cephtest/ceph.data/REPobject2 2026-02-26T03:16:00.181 DEBUG:teuthology.orchestra.run.trial086:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p rep_pool put REPobject2 /home/ubuntu/cephtest/ceph.data/REPobject2 2026-02-26T03:16:00.259 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:00.256+0000 7f0fdd28fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:00.262 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:00.259+0000 7f0fdd28fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:00.262 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:00.259+0000 7f0fdd28fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:00.286 DEBUG:teuthology.orchestra.run.trial086:> rados -p rep_pool setxattr REPobject2 key2-1 val2-1 2026-02-26T03:16:00.362 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:00.359+0000 7f42dacc2ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:00.365 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:00.362+0000 7f42dacc2ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:00.366 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:00.362+0000 7f42dacc2ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:00.385 DEBUG:teuthology.orchestra.run.trial086:> rados -p rep_pool setomapheader REPobject2 hdr2 2026-02-26T03:16:00.461 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:00.458+0000 7f24cfa35ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:00.464 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:00.461+0000 7f24cfa35ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:00.464 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:00.461+0000 7f24cfa35ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:00.482 DEBUG:teuthology.orchestra.run.trial086:> rados -p rep_pool setomapval REPobject2 okey2-1 oval2-1 2026-02-26T03:16:00.557 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:00.554+0000 7f6c7f2d0ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:00.561 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:00.557+0000 7f6c7f2d0ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:00.561 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:00.557+0000 7f6c7f2d0ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:00.579 INFO:tasks.util.rados:rados -p rep_pool put REPobject3 /home/ubuntu/cephtest/ceph.data/REPobject3 2026-02-26T03:16:00.580 DEBUG:teuthology.orchestra.run.trial086:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p rep_pool put REPobject3 /home/ubuntu/cephtest/ceph.data/REPobject3 2026-02-26T03:16:00.658 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:00.654+0000 7f996e687ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:00.661 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:00.657+0000 7f996e687ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:00.661 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:00.657+0000 7f996e687ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:00.682 DEBUG:teuthology.orchestra.run.trial086:> rados -p rep_pool setxattr REPobject3 key3-1 val3-1 2026-02-26T03:16:00.758 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:00.754+0000 7f7088e80ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:00.761 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:00.758+0000 7f7088e80ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:00.762 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:00.758+0000 7f7088e80ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:00.778 DEBUG:teuthology.orchestra.run.trial086:> rados -p rep_pool setxattr REPobject3 key3-2 val3-2 2026-02-26T03:16:00.854 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:00.851+0000 7f0b99ecaec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:00.858 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:00.854+0000 7f0b99ecaec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:00.858 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:00.854+0000 7f0b99ecaec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:00.875 DEBUG:teuthology.orchestra.run.trial086:> rados -p rep_pool setomapheader REPobject3 hdr3 2026-02-26T03:16:00.950 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:00.947+0000 7f85d2490ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:00.954 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:00.950+0000 7f85d2490ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:00.954 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:00.950+0000 7f85d2490ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:00.972 DEBUG:teuthology.orchestra.run.trial086:> rados -p rep_pool setomapval REPobject3 okey3-1 oval3-1 2026-02-26T03:16:01.048 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:01.045+0000 7f4541ce9ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:01.051 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:01.048+0000 7f4541ce9ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:01.051 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:01.048+0000 7f4541ce9ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:01.070 DEBUG:teuthology.orchestra.run.trial086:> rados -p rep_pool setomapval REPobject3 okey3-2 oval3-2 2026-02-26T03:16:01.147 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:01.144+0000 7f5de8c35ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:01.150 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:01.147+0000 7f5de8c35ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:01.150 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:01.147+0000 7f5de8c35ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:01.168 INFO:tasks.util.rados:rados -p rep_pool put REPobject4 /home/ubuntu/cephtest/ceph.data/REPobject4 2026-02-26T03:16:01.168 DEBUG:teuthology.orchestra.run.trial086:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p rep_pool put REPobject4 /home/ubuntu/cephtest/ceph.data/REPobject4 2026-02-26T03:16:01.247 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:01.244+0000 7fb54b443ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:01.250 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:01.247+0000 7fb54b443ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:01.251 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:01.247+0000 7fb54b443ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:01.273 DEBUG:teuthology.orchestra.run.trial086:> rados -p rep_pool setxattr REPobject4 key4-1 val4-1 2026-02-26T03:16:01.348 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:01.345+0000 7f767548dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:01.352 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:01.348+0000 7f767548dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:01.352 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:01.349+0000 7f767548dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:01.369 DEBUG:teuthology.orchestra.run.trial086:> rados -p rep_pool setxattr REPobject4 key4-2 val4-2 2026-02-26T03:16:01.445 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:01.442+0000 7ff088038ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:01.449 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:01.445+0000 7ff088038ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:01.449 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:01.445+0000 7ff088038ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:01.467 DEBUG:teuthology.orchestra.run.trial086:> rados -p rep_pool setxattr REPobject4 key4-3 val4-3 2026-02-26T03:16:01.542 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:01.538+0000 7f594b684ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:01.545 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:01.542+0000 7f594b684ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:01.545 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:01.542+0000 7f594b684ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:01.564 DEBUG:teuthology.orchestra.run.trial086:> rados -p rep_pool setomapheader REPobject4 hdr4 2026-02-26T03:16:01.639 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:01.635+0000 7f54b4832ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:01.642 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:01.639+0000 7f54b4832ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:01.642 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:01.639+0000 7f54b4832ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:01.661 DEBUG:teuthology.orchestra.run.trial086:> rados -p rep_pool setomapval REPobject4 okey4-1 oval4-1 2026-02-26T03:16:01.737 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:01.733+0000 7fb4c9dc6ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:01.740 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:01.736+0000 7fb4c9dc6ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:01.740 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:01.737+0000 7fb4c9dc6ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:01.758 DEBUG:teuthology.orchestra.run.trial086:> rados -p rep_pool setomapval REPobject4 okey4-2 oval4-2 2026-02-26T03:16:01.834 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:01.830+0000 7f6d8fc32ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:01.837 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:01.834+0000 7f6d8fc32ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:01.837 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:01.834+0000 7f6d8fc32ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:01.855 DEBUG:teuthology.orchestra.run.trial086:> rados -p rep_pool setomapval REPobject4 okey4-3 oval4-3 2026-02-26T03:16:01.934 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:01.930+0000 7fa4dd234ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:01.937 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:01.933+0000 7fa4dd234ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:01.937 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:01.934+0000 7fa4dd234ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:01.956 INFO:tasks.util.rados:rados -p rep_pool put REPobject5 /home/ubuntu/cephtest/ceph.data/REPobject5 2026-02-26T03:16:01.956 DEBUG:teuthology.orchestra.run.trial086:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p rep_pool put REPobject5 /home/ubuntu/cephtest/ceph.data/REPobject5 2026-02-26T03:16:02.033 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:02.029+0000 7fa076ac0ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:02.036 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:02.033+0000 7fa076ac0ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:02.036 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:02.033+0000 7fa076ac0ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:02.059 DEBUG:teuthology.orchestra.run.trial086:> rados -p rep_pool setxattr REPobject5 key5-1 val5-1 2026-02-26T03:16:02.135 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:02.132+0000 7f7defae6ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:02.138 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:02.135+0000 7f7defae6ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:02.139 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:02.135+0000 7f7defae6ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:02.157 DEBUG:teuthology.orchestra.run.trial086:> rados -p rep_pool setxattr REPobject5 key5-2 val5-2 2026-02-26T03:16:02.233 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:02.229+0000 7f82012e0ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:02.236 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:02.233+0000 7f82012e0ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:02.237 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:02.233+0000 7f82012e0ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:02.254 DEBUG:teuthology.orchestra.run.trial086:> rados -p rep_pool setxattr REPobject5 key5-3 val5-3 2026-02-26T03:16:02.332 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:02.329+0000 7ff8616b0ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:02.335 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:02.332+0000 7ff8616b0ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:02.335 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:02.332+0000 7ff8616b0ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:02.353 DEBUG:teuthology.orchestra.run.trial086:> rados -p rep_pool setxattr REPobject5 key5-4 val5-4 2026-02-26T03:16:02.430 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:02.426+0000 7f969a08eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:02.433 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:02.430+0000 7f969a08eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:02.433 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:02.430+0000 7f969a08eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:02.451 DEBUG:teuthology.orchestra.run.trial086:> rados -p rep_pool setomapheader REPobject5 hdr5 2026-02-26T03:16:02.527 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:02.524+0000 7f79330caec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:02.531 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:02.527+0000 7f79330caec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:02.531 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:02.527+0000 7f79330caec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:02.549 DEBUG:teuthology.orchestra.run.trial086:> rados -p rep_pool setomapval REPobject5 okey5-1 oval5-1 2026-02-26T03:16:02.624 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:02.621+0000 7f334bc8fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:02.627 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:02.624+0000 7f334bc8fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:02.628 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:02.624+0000 7f334bc8fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:02.647 DEBUG:teuthology.orchestra.run.trial086:> rados -p rep_pool setomapval REPobject5 okey5-2 oval5-2 2026-02-26T03:16:02.723 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:02.720+0000 7f774a832ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:02.726 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:02.723+0000 7f774a832ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:02.726 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:02.723+0000 7f774a832ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:02.743 DEBUG:teuthology.orchestra.run.trial086:> rados -p rep_pool setomapval REPobject5 okey5-3 oval5-3 2026-02-26T03:16:02.819 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:02.816+0000 7f42f7286ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:02.822 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:02.819+0000 7f42f7286ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:02.823 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:02.819+0000 7f42f7286ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:02.839 DEBUG:teuthology.orchestra.run.trial086:> rados -p rep_pool setomapval REPobject5 okey5-4 oval5-4 2026-02-26T03:16:02.917 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:02.913+0000 7f0db78a2ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:02.920 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:02.916+0000 7f0db78a2ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:02.920 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:02.916+0000 7f0db78a2ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:02.938 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-26T03:16:03.054 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:03.048+0000 7fb5e6bdc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:03.056 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:03.053+0000 7fb5e6bdc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:03.167 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:16:03.168 INFO:teuthology.orchestra.run.trial086.stderr:dumped all 2026-02-26T03:16:03.177 INFO:teuthology.orchestra.run.trial086.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2026-02-26T03:16:01.944669+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":28,"acting":28,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2872,"kb_used_data":2872,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209188040,"statfs":{"total":214211493888,"available":214208552960,"internally_reserved":0,"allocated":2940928,"data_stored":2940928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000650"},"pg_stats":[{"pgid":"1.0","version":"13'52","reported_seq":93,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-26T03:15:58.111286+0000","last_change":"2026-02-26T03:15:47.110154+0000","last_active":"2026-02-26T03:15:58.111286+0000","last_peered":"2026-02-26T03:15:58.111286+0000","last_clean":"2026-02-26T03:15:58.111286+0000","last_became_active":"2026-02-26T03:15:47.100608+0000","last_became_peered":"2026-02-26T03:15:47.100608+0000","last_unstale":"2026-02-26T03:15:58.111286+0000","last_undegraded":"2026-02-26T03:15:58.111286+0000","last_fullsized":"2026-02-26T03:15:58.111286+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:46.067961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:46.067961+0000","last_clean_scrub_stamp":"2026-02-26T03:15:46.067961+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-26T03:15:59.115921+0000","last_change":"2026-02-26T03:15:51.098328+0000","last_active":"2026-02-26T03:15:59.115921+0000","last_peered":"2026-02-26T03:15:59.115921+0000","last_clean":"2026-02-26T03:15:59.115921+0000","last_became_active":"2026-02-26T03:15:49.113988+0000","last_became_peered":"2026-02-26T03:15:49.113988+0000","last_unstale":"2026-02-26T03:15:59.115921+0000","last_undegraded":"2026-02-26T03:15:59.115921+0000","last_fullsized":"2026-02-26T03:15:59.115921+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2026-02-26T03:15:59.121223+0000","last_change":"2026-02-26T03:15:59.121223+0000","last_active":"2026-02-26T03:15:59.102428+0000","last_peered":"2026-02-26T03:15:59.102428+0000","last_clean":"2026-02-26T03:15:59.102428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-26T03:15:59.121223+0000","last_undegraded":"2026-02-26T03:15:59.121223+0000","last_fullsized":"2026-02-26T03:15:59.121223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-26T03:15:59.115566+0000","last_change":"2026-02-26T03:15:51.098257+0000","last_active":"2026-02-26T03:15:59.115566+0000","last_peered":"2026-02-26T03:15:59.115566+0000","last_clean":"2026-02-26T03:15:59.115566+0000","last_became_active":"2026-02-26T03:15:49.118473+0000","last_became_peered":"2026-02-26T03:15:49.118473+0000","last_unstale":"2026-02-26T03:15:59.115566+0000","last_undegraded":"2026-02-26T03:15:59.115566+0000","last_fullsized":"2026-02-26T03:15:59.115566+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2026-02-26T03:15:59.120350+0000","last_change":"2026-02-26T03:15:59.120350+0000","last_active":"2026-02-26T03:15:59.102428+0000","last_peered":"2026-02-26T03:15:59.102428+0000","last_clean":"2026-02-26T03:15:59.102428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-26T03:15:59.120350+0000","last_undegraded":"2026-02-26T03:15:59.120350+0000","last_fullsized":"2026-02-26T03:15:59.120350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-26T03:15:58.111069+0000","last_change":"2026-02-26T03:15:51.097070+0000","last_active":"2026-02-26T03:15:58.111069+0000","last_peered":"2026-02-26T03:15:58.111069+0000","last_clean":"2026-02-26T03:15:58.111069+0000","last_became_active":"2026-02-26T03:15:49.129694+0000","last_became_peered":"2026-02-26T03:15:49.129694+0000","last_unstale":"2026-02-26T03:15:58.111069+0000","last_undegraded":"2026-02-26T03:15:58.111069+0000","last_fullsized":"2026-02-26T03:15:58.111069+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-26T03:15:59.102428+0000","last_change":"2026-02-26T03:15:59.102428+0000","last_active":"2026-02-26T03:15:59.102428+0000","last_peered":"2026-02-26T03:15:59.102428+0000","last_clean":"2026-02-26T03:15:59.102428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-26T03:15:59.102428+0000","last_undegraded":"2026-02-26T03:15:59.102428+0000","last_fullsized":"2026-02-26T03:15:59.102428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":26,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-26T03:15:59.117147+0000","last_change":"2026-02-26T03:15:51.101920+0000","last_active":"2026-02-26T03:15:59.117147+0000","last_peered":"2026-02-26T03:15:59.117147+0000","last_clean":"2026-02-26T03:15:59.117147+0000","last_became_active":"2026-02-26T03:15:49.135739+0000","last_became_peered":"2026-02-26T03:15:49.135739+0000","last_unstale":"2026-02-26T03:15:59.117147+0000","last_undegraded":"2026-02-26T03:15:59.117147+0000","last_fullsized":"2026-02-26T03:15:59.117147+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2026-02-26T03:15:59.130704+0000","last_change":"2026-02-26T03:15:59.130704+0000","last_active":"2026-02-26T03:15:59.102428+0000","last_peered":"2026-02-26T03:15:59.102428+0000","last_clean":"2026-02-26T03:15:59.102428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-26T03:15:59.130704+0000","last_undegraded":"2026-02-26T03:15:59.130704+0000","last_fullsized":"2026-02-26T03:15:59.130704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-26T03:15:59.102428+0000","last_change":"2026-02-26T03:15:59.102428+0000","last_active":"2026-02-26T03:15:59.102428+0000","last_peered":"2026-02-26T03:15:59.102428+0000","last_clean":"2026-02-26T03:15:59.102428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-26T03:15:59.102428+0000","last_undegraded":"2026-02-26T03:15:59.102428+0000","last_fullsized":"2026-02-26T03:15:59.102428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-26T03:15:58.112569+0000","last_change":"2026-02-26T03:15:51.097251+0000","last_active":"2026-02-26T03:15:58.112569+0000","last_peered":"2026-02-26T03:15:58.112569+0000","last_clean":"2026-02-26T03:15:58.112569+0000","last_became_active":"2026-02-26T03:15:49.115240+0000","last_became_peered":"2026-02-26T03:15:49.115240+0000","last_unstale":"2026-02-26T03:15:58.112569+0000","last_undegraded":"2026-02-26T03:15:58.112569+0000","last_fullsized":"2026-02-26T03:15:58.112569+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-26T03:15:59.102428+0000","last_change":"2026-02-26T03:15:59.102428+0000","last_active":"2026-02-26T03:15:59.102428+0000","last_peered":"2026-02-26T03:15:59.102428+0000","last_clean":"2026-02-26T03:15:59.102428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-26T03:15:59.102428+0000","last_undegraded":"2026-02-26T03:15:59.102428+0000","last_fullsized":"2026-02-26T03:15:59.102428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-26T03:15:59.117335+0000","last_change":"2026-02-26T03:15:51.102561+0000","last_active":"2026-02-26T03:15:59.117335+0000","last_peered":"2026-02-26T03:15:59.117335+0000","last_clean":"2026-02-26T03:15:59.117335+0000","last_became_active":"2026-02-26T03:15:49.133400+0000","last_became_peered":"2026-02-26T03:15:49.133400+0000","last_unstale":"2026-02-26T03:15:59.117335+0000","last_undegraded":"2026-02-26T03:15:59.117335+0000","last_fullsized":"2026-02-26T03:15:59.117335+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2026-02-26T03:15:59.132972+0000","last_change":"2026-02-26T03:15:59.132972+0000","last_active":"2026-02-26T03:15:59.102428+0000","last_peered":"2026-02-26T03:15:59.102428+0000","last_clean":"2026-02-26T03:15:59.102428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-26T03:15:59.132972+0000","last_undegraded":"2026-02-26T03:15:59.132972+0000","last_fullsized":"2026-02-26T03:15:59.132972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-26T03:15:58.112355+0000","last_change":"2026-02-26T03:15:51.097363+0000","last_active":"2026-02-26T03:15:58.112355+0000","last_peered":"2026-02-26T03:15:58.112355+0000","last_clean":"2026-02-26T03:15:58.112355+0000","last_became_active":"2026-02-26T03:15:49.113767+0000","last_became_peered":"2026-02-26T03:15:49.113767+0000","last_unstale":"2026-02-26T03:15:58.112355+0000","last_undegraded":"2026-02-26T03:15:58.112355+0000","last_fullsized":"2026-02-26T03:15:58.112355+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2026-02-26T03:15:59.143387+0000","last_change":"2026-02-26T03:15:59.143387+0000","last_active":"2026-02-26T03:15:59.102428+0000","last_peered":"2026-02-26T03:15:59.102428+0000","last_clean":"2026-02-26T03:15:59.102428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-26T03:15:59.143387+0000","last_undegraded":"2026-02-26T03:15:59.143387+0000","last_fullsized":"2026-02-26T03:15:59.143387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":24,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-26T03:15:59.116970+0000","last_change":"2026-02-26T03:15:51.098108+0000","last_active":"2026-02-26T03:15:59.116970+0000","last_peered":"2026-02-26T03:15:59.116970+0000","last_clean":"2026-02-26T03:15:59.116970+0000","last_became_active":"2026-02-26T03:15:49.138231+0000","last_became_peered":"2026-02-26T03:15:49.138231+0000","last_unstale":"2026-02-26T03:15:59.116970+0000","last_undegraded":"2026-02-26T03:15:59.116970+0000","last_fullsized":"2026-02-26T03:15:59.116970+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":107105746944,"available":107104174080,"internally_reserved":0,"allocated":1572864,"data_stored":1572864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":10,"acting":10,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160658620416,"available":160656809984,"internally_reserved":0,"allocated":1810432,"data_stored":1810432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551779840,"internally_reserved":0,"allocated":1093632,"data_stored":1093632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949672974,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":276,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297452,"statfs":{"total":53552873472,"available":53552590848,"internally_reserved":0,"allocated":282624,"data_stored":282624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672974,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1060,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296668,"statfs":{"total":53552873472,"available":53551788032,"internally_reserved":0,"allocated":1085440,"data_stored":1085440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640271,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":416,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297312,"statfs":{"total":53552873472,"available":53552447488,"internally_reserved":0,"allocated":425984,"data_stored":425984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640271,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1120,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296608,"statfs":{"total":53552873472,"available":53551726592,"internally_reserved":0,"allocated":1146880,"data_stored":1146880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53552873472,"available":53551779840,"internally_reserved":0,"allocated":1093632,"data_stored":1093632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53551779840,"internally_reserved":0,"allocated":1093632,"data_stored":1093632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53552582656,"internally_reserved":0,"allocated":290816,"data_stored":290816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53552447488,"internally_reserved":0,"allocated":425984,"data_stored":425984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53551726592,"internally_reserved":0,"allocated":1146880,"data_stored":1146880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":53552447488,"internally_reserved":0,"allocated":425984,"data_stored":425984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-26T03:16:03.179 INFO:tasks.ceph_objectstore_tool:Expected pgs: {3: ['3.2', '3.7'], 2: ['3.2', '3.1', '3.3'], 0: ['3.1', '3.3', '3.6'], 1: ['3.7', '3.6']} 2026-02-26T03:16:03.179 INFO:tasks.ceph_objectstore_tool:Expected : {'REPobject1': {'xattr': {}, 'omap': {}}, 'REPobject2': {'xattr': {'key2-1': 'val2-1'}, 'omapheader': 'hdr2', 'omap': {'okey2-1': 'oval2-1'}}, 'REPobject3': {'xattr': {'key3-1': 'val3-1', 'key3-2': 'val3-2'}, 'omapheader': 'hdr3', 'omap': {'okey3-1': 'oval3-1', 'okey3-2': 'oval3-2'}}, 'REPobject4': {'xattr': {'key4-1': 'val4-1', 'key4-2': 'val4-2', 'key4-3': 'val4-3'}, 'omapheader': 'hdr4', 'omap': {'okey4-1': 'oval4-1', 'okey4-2': 'oval4-2', 'okey4-3': 'oval4-3'}}, 'REPobject5': {'xattr': {'key5-1': 'val5-1', 'key5-2': 'val5-2', 'key5-3': 'val5-3', 'key5-4': 'val5-4'}, 'omapheader': 'hdr5', 'omap': {'okey5-1': 'oval5-1', 'okey5-2': 'oval5-2', 'okey5-3': 'oval5-3', 'okey5-4': 'oval5-4'}}} 2026-02-26T03:16:03.179 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2026-02-26T03:16:03.254 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:03.248+0000 7f128085a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:03.256 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:16:03.253+0000 7f128085a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:16:03.367 INFO:teuthology.orchestra.run.trial086.stdout:epoch 22 2026-02-26T03:16:03.368 INFO:teuthology.orchestra.run.trial086.stdout:fsid a3320112-ec0c-4bb6-bf8e-5331f894afbc 2026-02-26T03:16:03.368 INFO:teuthology.orchestra.run.trial086.stdout:created 2026-02-26T03:15:31.523265+0000 2026-02-26T03:16:03.368 INFO:teuthology.orchestra.run.trial086.stdout:modified 2026-02-26T03:16:01.107560+0000 2026-02-26T03:16:03.368 INFO:teuthology.orchestra.run.trial086.stdout:flags nodown,noout,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2026-02-26T03:16:03.368 INFO:teuthology.orchestra.run.trial086.stdout:crush_version 5 2026-02-26T03:16:03.368 INFO:teuthology.orchestra.run.trial086.stdout:full_ratio 0.95 2026-02-26T03:16:03.368 INFO:teuthology.orchestra.run.trial086.stdout:backfillfull_ratio 0.9 2026-02-26T03:16:03.368 INFO:teuthology.orchestra.run.trial086.stdout:nearfull_ratio 0.85 2026-02-26T03:16:03.368 INFO:teuthology.orchestra.run.trial086.stdout:require_min_compat_client luminous 2026-02-26T03:16:03.368 INFO:teuthology.orchestra.run.trial086.stdout:min_compat_client jewel 2026-02-26T03:16:03.368 INFO:teuthology.orchestra.run.trial086.stdout:require_osd_release tentacle 2026-02-26T03:16:03.368 INFO:teuthology.orchestra.run.trial086.stdout:stretch_mode_enabled false 2026-02-26T03:16:03.368 INFO:teuthology.orchestra.run.trial086.stdout:allow_crimson=true 2026-02-26T03:16:03.368 INFO:teuthology.orchestra.run.trial086.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 14 flags hashpspool,crimson stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 4.00 2026-02-26T03:16:03.368 INFO:teuthology.orchestra.run.trial086.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 17 flags hashpspool,selfmanaged_snaps,crimson stripe_width 0 application rbd read_balance_score 2.50 2026-02-26T03:16:03.368 INFO:teuthology.orchestra.run.trial086.stdout: removed_snaps_queue [2~1] 2026-02-26T03:16:03.368 INFO:teuthology.orchestra.run.trial086.stdout:pool 3 'rep_pool' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 22 flags hashpspool,crimson stripe_width 0 read_balance_score 1.50 2026-02-26T03:16:03.368 INFO:teuthology.orchestra.run.trial086.stdout:max_osd 4 2026-02-26T03:16:03.368 INFO:teuthology.orchestra.run.trial086.stdout:osd.0 up in weight 1 up_from 11 up_thru 20 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6809/1229323153 v2:10.20.193.86:6810/1229323153 exists,up b692f9c9-579d-4a92-b02c-beefe594ff12 2026-02-26T03:16:03.368 INFO:teuthology.orchestra.run.trial086.stdout:osd.1 up in weight 1 up_from 10 up_thru 20 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6803/2744027137 v2:10.20.193.86:6802/2744027137 exists,up 1935ef84-dee5-4745-8c38-6435b71c819c 2026-02-26T03:16:03.368 INFO:teuthology.orchestra.run.trial086.stdout:osd.2 up in weight 1 up_from 10 up_thru 20 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6805/3653919688 v2:10.20.193.86:6804/3653919688 exists,up bf958cf8-549c-42c6-9510-269812a65fb6 2026-02-26T03:16:03.368 INFO:teuthology.orchestra.run.trial086.stdout:osd.3 up in weight 1 up_from 11 up_thru 20 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6806/2128187350 v2:10.20.193.86:6807/2128187350 exists,up cf449d79-9ec0-4e20-a163-3ce8ac17c2cb 2026-02-26T03:16:03.376 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 11 up_thru 20 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6809/1229323153 v2:10.20.193.86:6810/1229323153 exists,up b692f9c9-579d-4a92-b02c-beefe594ff12', 'osd.1 up in weight 1 up_from 10 up_thru 20 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6803/2744027137 v2:10.20.193.86:6802/2744027137 exists,up 1935ef84-dee5-4745-8c38-6435b71c819c', 'osd.2 up in weight 1 up_from 10 up_thru 20 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6805/3653919688 v2:10.20.193.86:6804/3653919688 exists,up bf958cf8-549c-42c6-9510-269812a65fb6', 'osd.3 up in weight 1 up_from 11 up_thru 20 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6806/2128187350 v2:10.20.193.86:6807/2128187350 exists,up cf449d79-9ec0-4e20-a163-3ce8ac17c2cb'] 2026-02-26T03:16:03.377 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-26T03:16:03.377 INFO:teuthology.orchestra.run:waiting for 300 2026-02-26T03:16:03.436 INFO:tasks.ceph.osd.0:Stopped 2026-02-26T03:16:03.436 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-26T03:16:03.436 INFO:teuthology.orchestra.run:waiting for 300 2026-02-26T03:16:03.494 INFO:tasks.ceph.osd.1:Stopped 2026-02-26T03:16:03.494 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-26T03:16:03.494 INFO:teuthology.orchestra.run:waiting for 300 2026-02-26T03:16:03.548 INFO:tasks.ceph.osd.2:Stopped 2026-02-26T03:16:03.548 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-26T03:16:03.549 INFO:teuthology.orchestra.run:waiting for 300 2026-02-26T03:16:03.609 INFO:tasks.ceph.osd.3:Stopped 2026-02-26T03:16:08.610 INFO:tasks.ceph_objectstore_tool:Test --op list by generating json for all objects 2026-02-26T03:16:08.610 DEBUG:tasks.ceph_objectstore_tool:ubuntu@trial086.front.sepia.ceph.com 2026-02-26T03:16:08.610 DEBUG:tasks.ceph_objectstore_tool:['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2026-02-26T03:16:08.610 INFO:tasks.ceph_objectstore_tool:process osd.0 on ubuntu@trial086.front.sepia.ceph.com 2026-02-26T03:16:08.610 DEBUG:teuthology.orchestra.run.trial086:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-0 --device-type SSD --op list 2026-02-26T03:16:08.755 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:08,753 seastar - Reactor backend: linux-aio 2026-02-26T03:16:08.762 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:08,760 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:16:08.762 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:08,760 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:16:08.765 INFO:teuthology.orchestra.run.trial086.stderr:==44639==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:16:09.534 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osd_superblock","key":"","snapid":-2,"hash":3572033044,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:09.534 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.13","key":"","snapid":0,"hash":1679232780,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:09.535 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.20","key":"","snapid":0,"hash":1679229324,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:09.535 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.17","key":"","snapid":0,"hash":1679229644,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:09.535 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.19","key":"","snapid":0,"hash":1679229740,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:09.535 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.11","key":"","snapid":0,"hash":1679232684,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:09.535 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.15","key":"","snapid":0,"hash":1679232108,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:09.535 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.22","key":"","snapid":0,"hash":1679230700,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:09.535 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.10","key":"","snapid":0,"hash":1679231260,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:09.535 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.18","key":"","snapid":0,"hash":1679229852,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:09.535 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.21","key":"","snapid":0,"hash":1679229276,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:09.535 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.14","key":"","snapid":0,"hash":1679232220,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:09.535 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.16","key":"","snapid":0,"hash":1679232316,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:09.535 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.12","key":"","snapid":0,"hash":1679232636,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:09.535 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.1","key":"","snapid":0,"hash":3059696390,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:09.535 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.9","key":"","snapid":0,"hash":3059697030,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:09.535 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.5","key":"","snapid":0,"hash":3059697350,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:09.535 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.7","key":"","snapid":0,"hash":3059697446,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:09.535 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.3","key":"","snapid":0,"hash":3059695718,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:09.535 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.6","key":"","snapid":0,"hash":3059697558,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:09.535 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.2","key":"","snapid":0,"hash":3059695830,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:09.535 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.4","key":"","snapid":0,"hash":3059695926,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:09.535 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.8","key":"","snapid":0,"hash":3059696886,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:09.535 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.6","key":"","snapid":0,"hash":4251864065,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:09.535 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.2","key":"","snapid":0,"hash":4251863361,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:09.535 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.4","key":"","snapid":0,"hash":4251864993,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:09.535 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.8","key":"","snapid":0,"hash":4251864417,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:09.535 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.3","key":"","snapid":0,"hash":4251864593,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:09.535 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.7","key":"","snapid":0,"hash":4251864529,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:09.535 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.9","key":"","snapid":0,"hash":4251861553,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:09.536 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.1","key":"","snapid":0,"hash":4251863473,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:09.536 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.5","key":"","snapid":0,"hash":4251864945,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:09.536 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.10","key":"","snapid":0,"hash":4108959747,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:09.536 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.18","key":"","snapid":0,"hash":4108966531,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:09.536 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.21","key":"","snapid":0,"hash":4108965955,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:09.536 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.14","key":"","snapid":0,"hash":4108961731,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:09.536 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.16","key":"","snapid":0,"hash":4108960803,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:09.545 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.12","key":"","snapid":0,"hash":4108960099,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:09.545 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.22","key":"","snapid":0,"hash":4108966163,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:09.545 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.15","key":"","snapid":0,"hash":4108960915,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:09.545 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.19","key":"","snapid":0,"hash":4108966483,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:09.545 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.11","key":"","snapid":0,"hash":4108960211,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:09.545 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.13","key":"","snapid":0,"hash":4108961331,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:09.545 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.20","key":"","snapid":0,"hash":4108966067,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:09.545 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.17","key":"","snapid":0,"hash":4108961267,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:09.546 INFO:teuthology.orchestra.run.trial086.stdout:["1.0",{"oid":"","key":"","snapid":-2,"hash":0,"max":0,"pool":1,"namespace":"","max":0}] 2026-02-26T03:16:09.546 INFO:teuthology.orchestra.run.trial086.stdout:["1.0",{"oid":"snapmapper","key":"","snapid":-2,"hash":0,"max":0,"pool":1,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:09.546 INFO:teuthology.orchestra.run.trial086.stdout:["1.0",{"oid":"main.db-journal.0000000000000000","key":"","snapid":-2,"hash":1969844440,"max":0,"pool":1,"namespace":"devicehealth","max":0}] 2026-02-26T03:16:09.546 INFO:teuthology.orchestra.run.trial086.stdout:["1.0",{"oid":"main.db.0000000000000000","key":"","snapid":-2,"hash":1315310604,"max":0,"pool":1,"namespace":"devicehealth","max":0}] 2026-02-26T03:16:09.546 INFO:teuthology.orchestra.run.trial086.stdout:["2.5",{"oid":"","key":"","snapid":-2,"hash":5,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-26T03:16:09.546 INFO:teuthology.orchestra.run.trial086.stdout:["2.5",{"oid":"snapmapper","key":"","snapid":-2,"hash":5,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:09.546 INFO:teuthology.orchestra.run.trial086.stdout:["3.3",{"oid":"","key":"","snapid":-2,"hash":3,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:09.546 INFO:teuthology.orchestra.run.trial086.stdout:["3.3",{"oid":"snapmapper","key":"","snapid":-2,"hash":3,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:09.546 INFO:teuthology.orchestra.run.trial086.stdout:["2.4",{"oid":"","key":"","snapid":-2,"hash":4,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-26T03:16:09.546 INFO:teuthology.orchestra.run.trial086.stdout:["2.4",{"oid":"snapmapper","key":"","snapid":-2,"hash":4,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:09.546 INFO:teuthology.orchestra.run.trial086.stdout:["2.7",{"oid":"","key":"","snapid":-2,"hash":7,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-26T03:16:09.546 INFO:teuthology.orchestra.run.trial086.stdout:["2.7",{"oid":"snapmapper","key":"","snapid":-2,"hash":7,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:09.546 INFO:teuthology.orchestra.run.trial086.stdout:["3.6",{"oid":"","key":"","snapid":-2,"hash":6,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:09.546 INFO:teuthology.orchestra.run.trial086.stdout:["3.6",{"oid":"snapmapper","key":"","snapid":-2,"hash":6,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:09.546 INFO:teuthology.orchestra.run.trial086.stdout:["3.6",{"oid":"REPobject4","key":"","snapid":-2,"hash":833930126,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:09.546 INFO:teuthology.orchestra.run.trial086.stdout:["2.6",{"oid":"","key":"","snapid":-2,"hash":6,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-26T03:16:09.546 INFO:teuthology.orchestra.run.trial086.stdout:["2.6",{"oid":"snapmapper","key":"","snapid":-2,"hash":6,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:09.546 INFO:teuthology.orchestra.run.trial086.stdout:["3.1",{"oid":"","key":"","snapid":-2,"hash":1,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:09.546 INFO:teuthology.orchestra.run.trial086.stdout:["3.1",{"oid":"snapmapper","key":"","snapid":-2,"hash":1,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:11.067 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:16:11.067 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:16:11.067 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:16:11.067 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:16:11.067 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:16:11.067 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:16:11.105 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osd_superblock","key":"","snapid":-2,"hash":3572033044,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:11.105 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.13","key":"","snapid":0,"hash":1679232780,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:11.105 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.20","key":"","snapid":0,"hash":1679229324,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:11.105 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.17","key":"","snapid":0,"hash":1679229644,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:11.105 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.19","key":"","snapid":0,"hash":1679229740,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:11.105 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.11","key":"","snapid":0,"hash":1679232684,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:11.105 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.15","key":"","snapid":0,"hash":1679232108,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:11.105 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.22","key":"","snapid":0,"hash":1679230700,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:11.105 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.10","key":"","snapid":0,"hash":1679231260,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:11.105 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.18","key":"","snapid":0,"hash":1679229852,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:11.105 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.21","key":"","snapid":0,"hash":1679229276,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:11.105 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.14","key":"","snapid":0,"hash":1679232220,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:11.105 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.16","key":"","snapid":0,"hash":1679232316,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:11.105 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.12","key":"","snapid":0,"hash":1679232636,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:11.106 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.1","key":"","snapid":0,"hash":3059696390,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:11.106 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.9","key":"","snapid":0,"hash":3059697030,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:11.106 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.5","key":"","snapid":0,"hash":3059697350,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:11.106 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.7","key":"","snapid":0,"hash":3059697446,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:11.106 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.3","key":"","snapid":0,"hash":3059695718,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:11.106 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.6","key":"","snapid":0,"hash":3059697558,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:11.106 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.2","key":"","snapid":0,"hash":3059695830,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:11.106 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.4","key":"","snapid":0,"hash":3059695926,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:11.106 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.8","key":"","snapid":0,"hash":3059696886,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:11.106 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.6","key":"","snapid":0,"hash":4251864065,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:11.106 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.2","key":"","snapid":0,"hash":4251863361,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:11.106 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.4","key":"","snapid":0,"hash":4251864993,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:11.106 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.8","key":"","snapid":0,"hash":4251864417,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:11.106 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.3","key":"","snapid":0,"hash":4251864593,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:11.106 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.7","key":"","snapid":0,"hash":4251864529,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:11.106 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.9","key":"","snapid":0,"hash":4251861553,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:11.106 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.1","key":"","snapid":0,"hash":4251863473,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:11.106 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.5","key":"","snapid":0,"hash":4251864945,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:11.106 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.10","key":"","snapid":0,"hash":4108959747,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:11.106 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.18","key":"","snapid":0,"hash":4108966531,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:11.106 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.21","key":"","snapid":0,"hash":4108965955,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:11.106 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.14","key":"","snapid":0,"hash":4108961731,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:11.106 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.16","key":"","snapid":0,"hash":4108960803,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:11.106 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.12","key":"","snapid":0,"hash":4108960099,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:11.106 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.22","key":"","snapid":0,"hash":4108966163,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:11.106 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.15","key":"","snapid":0,"hash":4108960915,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:11.106 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.19","key":"","snapid":0,"hash":4108966483,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:11.107 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.11","key":"","snapid":0,"hash":4108960211,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:11.107 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.13","key":"","snapid":0,"hash":4108961331,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:11.107 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.20","key":"","snapid":0,"hash":4108966067,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:11.107 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.17","key":"","snapid":0,"hash":4108961267,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:11.107 INFO:tasks.ceph_objectstore_tool:parsing ["1.0",{"oid":"","key":"","snapid":-2,"hash":0,"max":0,"pool":1,"namespace":"","max":0}] 2026-02-26T03:16:11.107 INFO:tasks.ceph_objectstore_tool:parsing ["1.0",{"oid":"snapmapper","key":"","snapid":-2,"hash":0,"max":0,"pool":1,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:11.107 INFO:tasks.ceph_objectstore_tool:parsing ["1.0",{"oid":"main.db-journal.0000000000000000","key":"","snapid":-2,"hash":1969844440,"max":0,"pool":1,"namespace":"devicehealth","max":0}] 2026-02-26T03:16:11.107 INFO:tasks.ceph_objectstore_tool:parsing ["1.0",{"oid":"main.db.0000000000000000","key":"","snapid":-2,"hash":1315310604,"max":0,"pool":1,"namespace":"devicehealth","max":0}] 2026-02-26T03:16:11.107 INFO:tasks.ceph_objectstore_tool:parsing ["2.5",{"oid":"","key":"","snapid":-2,"hash":5,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-26T03:16:11.107 INFO:tasks.ceph_objectstore_tool:parsing ["2.5",{"oid":"snapmapper","key":"","snapid":-2,"hash":5,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:11.107 INFO:tasks.ceph_objectstore_tool:parsing ["3.3",{"oid":"","key":"","snapid":-2,"hash":3,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:11.107 INFO:tasks.ceph_objectstore_tool:parsing ["3.3",{"oid":"snapmapper","key":"","snapid":-2,"hash":3,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:11.107 INFO:tasks.ceph_objectstore_tool:parsing ["2.4",{"oid":"","key":"","snapid":-2,"hash":4,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-26T03:16:11.107 INFO:tasks.ceph_objectstore_tool:parsing ["2.4",{"oid":"snapmapper","key":"","snapid":-2,"hash":4,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:11.107 INFO:tasks.ceph_objectstore_tool:parsing ["2.7",{"oid":"","key":"","snapid":-2,"hash":7,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-26T03:16:11.107 INFO:tasks.ceph_objectstore_tool:parsing ["2.7",{"oid":"snapmapper","key":"","snapid":-2,"hash":7,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:11.107 INFO:tasks.ceph_objectstore_tool:parsing ["3.6",{"oid":"","key":"","snapid":-2,"hash":6,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:11.107 INFO:tasks.ceph_objectstore_tool:parsing ["3.6",{"oid":"snapmapper","key":"","snapid":-2,"hash":6,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:11.107 INFO:tasks.ceph_objectstore_tool:parsing ["3.6",{"oid":"REPobject4","key":"","snapid":-2,"hash":833930126,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:11.107 INFO:tasks.ceph_objectstore_tool:found REPobject4 2026-02-26T03:16:11.107 INFO:tasks.ceph_objectstore_tool:parsing ["2.6",{"oid":"","key":"","snapid":-2,"hash":6,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-26T03:16:11.107 INFO:tasks.ceph_objectstore_tool:parsing ["2.6",{"oid":"snapmapper","key":"","snapid":-2,"hash":6,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:11.107 INFO:tasks.ceph_objectstore_tool:parsing ["3.1",{"oid":"","key":"","snapid":-2,"hash":1,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:11.107 INFO:tasks.ceph_objectstore_tool:parsing ["3.1",{"oid":"snapmapper","key":"","snapid":-2,"hash":1,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:11.107 INFO:tasks.ceph_objectstore_tool:process osd.1 on ubuntu@trial086.front.sepia.ceph.com 2026-02-26T03:16:11.108 DEBUG:teuthology.orchestra.run.trial086:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-1 --device-type SSD --op list 2026-02-26T03:16:11.250 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:11,248 seastar - Reactor backend: linux-aio 2026-02-26T03:16:11.261 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:11,259 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:16:11.261 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:11,259 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:16:11.264 INFO:teuthology.orchestra.run.trial086.stderr:==44670==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:16:12.043 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osd_superblock","key":"","snapid":-2,"hash":3572033044,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:12.044 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.13","key":"","snapid":0,"hash":1679232780,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:12.044 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.20","key":"","snapid":0,"hash":1679229324,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:12.044 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.17","key":"","snapid":0,"hash":1679229644,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:12.044 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.19","key":"","snapid":0,"hash":1679229740,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:12.044 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.11","key":"","snapid":0,"hash":1679232684,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:12.044 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.15","key":"","snapid":0,"hash":1679232108,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:12.044 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.22","key":"","snapid":0,"hash":1679230700,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:12.044 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.10","key":"","snapid":0,"hash":1679231260,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:12.044 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.18","key":"","snapid":0,"hash":1679229852,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:12.044 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.21","key":"","snapid":0,"hash":1679229276,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:12.044 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.14","key":"","snapid":0,"hash":1679232220,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:12.044 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.16","key":"","snapid":0,"hash":1679232316,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:12.044 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.12","key":"","snapid":0,"hash":1679232636,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:12.044 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.1","key":"","snapid":0,"hash":3059696390,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:12.044 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.9","key":"","snapid":0,"hash":3059697030,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:12.044 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.5","key":"","snapid":0,"hash":3059697350,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:12.044 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.7","key":"","snapid":0,"hash":3059697446,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:12.044 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.3","key":"","snapid":0,"hash":3059695718,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:12.044 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.6","key":"","snapid":0,"hash":3059697558,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:12.044 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.2","key":"","snapid":0,"hash":3059695830,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:12.044 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.4","key":"","snapid":0,"hash":3059695926,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:12.044 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.8","key":"","snapid":0,"hash":3059696886,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:12.044 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.6","key":"","snapid":0,"hash":4251864065,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:12.044 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.2","key":"","snapid":0,"hash":4251863361,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:12.044 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.4","key":"","snapid":0,"hash":4251864993,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:12.044 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.8","key":"","snapid":0,"hash":4251864417,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:12.044 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.3","key":"","snapid":0,"hash":4251864593,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:12.045 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.7","key":"","snapid":0,"hash":4251864529,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:12.045 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.9","key":"","snapid":0,"hash":4251861553,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:12.045 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.1","key":"","snapid":0,"hash":4251863473,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:12.045 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.5","key":"","snapid":0,"hash":4251864945,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:12.045 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.10","key":"","snapid":0,"hash":4108959747,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:12.045 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.18","key":"","snapid":0,"hash":4108966531,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:12.045 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.21","key":"","snapid":0,"hash":4108965955,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:12.045 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.14","key":"","snapid":0,"hash":4108961731,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:12.045 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.16","key":"","snapid":0,"hash":4108960803,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:12.055 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.12","key":"","snapid":0,"hash":4108960099,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:12.055 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.22","key":"","snapid":0,"hash":4108966163,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:12.055 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.15","key":"","snapid":0,"hash":4108960915,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:12.055 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.19","key":"","snapid":0,"hash":4108966483,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:12.055 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.11","key":"","snapid":0,"hash":4108960211,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:12.055 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.13","key":"","snapid":0,"hash":4108961331,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:12.055 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.20","key":"","snapid":0,"hash":4108966067,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:12.055 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.17","key":"","snapid":0,"hash":4108961267,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:12.055 INFO:teuthology.orchestra.run.trial086.stdout:["1.0",{"oid":"","key":"","snapid":-2,"hash":0,"max":0,"pool":1,"namespace":"","max":0}] 2026-02-26T03:16:12.055 INFO:teuthology.orchestra.run.trial086.stdout:["1.0",{"oid":"snapmapper","key":"","snapid":-2,"hash":0,"max":0,"pool":1,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:12.055 INFO:teuthology.orchestra.run.trial086.stdout:["1.0",{"oid":"main.db-journal.0000000000000000","key":"","snapid":-2,"hash":1969844440,"max":0,"pool":1,"namespace":"devicehealth","max":0}] 2026-02-26T03:16:12.055 INFO:teuthology.orchestra.run.trial086.stdout:["1.0",{"oid":"main.db.0000000000000000","key":"","snapid":-2,"hash":1315310604,"max":0,"pool":1,"namespace":"devicehealth","max":0}] 2026-02-26T03:16:12.055 INFO:teuthology.orchestra.run.trial086.stdout:["2.0",{"oid":"","key":"","snapid":-2,"hash":0,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-26T03:16:12.055 INFO:teuthology.orchestra.run.trial086.stdout:["2.0",{"oid":"snapmapper","key":"","snapid":-2,"hash":0,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:12.055 INFO:teuthology.orchestra.run.trial086.stdout:["3.4",{"oid":"","key":"","snapid":-2,"hash":4,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:12.056 INFO:teuthology.orchestra.run.trial086.stdout:["3.4",{"oid":"snapmapper","key":"","snapid":-2,"hash":4,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:12.056 INFO:teuthology.orchestra.run.trial086.stdout:["3.4",{"oid":"REPobject1","key":"","snapid":-2,"hash":623868980,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:12.056 INFO:teuthology.orchestra.run.trial086.stdout:["3.4",{"oid":"REPobject2","key":"","snapid":-2,"hash":3521648588,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:12.056 INFO:teuthology.orchestra.run.trial086.stdout:["2.2",{"oid":"","key":"","snapid":-2,"hash":2,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-26T03:16:12.056 INFO:teuthology.orchestra.run.trial086.stdout:["2.2",{"oid":"snapmapper","key":"","snapid":-2,"hash":2,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:12.056 INFO:teuthology.orchestra.run.trial086.stdout:["2.2",{"oid":"rbd_info","key":"","snapid":-2,"hash":2886620986,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-26T03:16:12.056 INFO:teuthology.orchestra.run.trial086.stdout:["2.4",{"oid":"","key":"","snapid":-2,"hash":4,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-26T03:16:12.056 INFO:teuthology.orchestra.run.trial086.stdout:["2.4",{"oid":"snapmapper","key":"","snapid":-2,"hash":4,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:12.056 INFO:teuthology.orchestra.run.trial086.stdout:["3.7",{"oid":"","key":"","snapid":-2,"hash":7,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:12.056 INFO:teuthology.orchestra.run.trial086.stdout:["3.7",{"oid":"snapmapper","key":"","snapid":-2,"hash":7,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:12.056 INFO:teuthology.orchestra.run.trial086.stdout:["2.6",{"oid":"","key":"","snapid":-2,"hash":6,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-26T03:16:12.056 INFO:teuthology.orchestra.run.trial086.stdout:["2.6",{"oid":"snapmapper","key":"","snapid":-2,"hash":6,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:12.056 INFO:teuthology.orchestra.run.trial086.stdout:["3.0",{"oid":"","key":"","snapid":-2,"hash":0,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:12.056 INFO:teuthology.orchestra.run.trial086.stdout:["3.0",{"oid":"snapmapper","key":"","snapid":-2,"hash":0,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:12.056 INFO:teuthology.orchestra.run.trial086.stdout:["3.6",{"oid":"","key":"","snapid":-2,"hash":6,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:12.056 INFO:teuthology.orchestra.run.trial086.stdout:["3.6",{"oid":"snapmapper","key":"","snapid":-2,"hash":6,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:12.056 INFO:teuthology.orchestra.run.trial086.stdout:["3.6",{"oid":"REPobject4","key":"","snapid":-2,"hash":833930126,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:13.566 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:16:13.566 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:16:13.566 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:16:13.566 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:16:13.566 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:16:13.566 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:16:13.605 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osd_superblock","key":"","snapid":-2,"hash":3572033044,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:13.606 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.13","key":"","snapid":0,"hash":1679232780,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:13.606 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.20","key":"","snapid":0,"hash":1679229324,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:13.606 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.17","key":"","snapid":0,"hash":1679229644,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:13.606 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.19","key":"","snapid":0,"hash":1679229740,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:13.606 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.11","key":"","snapid":0,"hash":1679232684,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:13.606 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.15","key":"","snapid":0,"hash":1679232108,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:13.606 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.22","key":"","snapid":0,"hash":1679230700,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:13.606 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.10","key":"","snapid":0,"hash":1679231260,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:13.606 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.18","key":"","snapid":0,"hash":1679229852,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:13.606 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.21","key":"","snapid":0,"hash":1679229276,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:13.606 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.14","key":"","snapid":0,"hash":1679232220,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:13.606 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.16","key":"","snapid":0,"hash":1679232316,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:13.606 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.12","key":"","snapid":0,"hash":1679232636,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:13.606 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.1","key":"","snapid":0,"hash":3059696390,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:13.606 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.9","key":"","snapid":0,"hash":3059697030,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:13.606 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.5","key":"","snapid":0,"hash":3059697350,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:13.606 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.7","key":"","snapid":0,"hash":3059697446,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:13.606 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.3","key":"","snapid":0,"hash":3059695718,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:13.606 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.6","key":"","snapid":0,"hash":3059697558,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:13.606 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.2","key":"","snapid":0,"hash":3059695830,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:13.606 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.4","key":"","snapid":0,"hash":3059695926,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:13.606 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.8","key":"","snapid":0,"hash":3059696886,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:13.606 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.6","key":"","snapid":0,"hash":4251864065,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:13.607 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.2","key":"","snapid":0,"hash":4251863361,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:13.607 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.4","key":"","snapid":0,"hash":4251864993,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:13.607 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.8","key":"","snapid":0,"hash":4251864417,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:13.607 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.3","key":"","snapid":0,"hash":4251864593,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:13.607 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.7","key":"","snapid":0,"hash":4251864529,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:13.607 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.9","key":"","snapid":0,"hash":4251861553,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:13.607 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.1","key":"","snapid":0,"hash":4251863473,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:13.607 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.5","key":"","snapid":0,"hash":4251864945,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:13.607 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.10","key":"","snapid":0,"hash":4108959747,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:13.607 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.18","key":"","snapid":0,"hash":4108966531,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:13.607 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.21","key":"","snapid":0,"hash":4108965955,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:13.607 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.14","key":"","snapid":0,"hash":4108961731,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:13.607 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.16","key":"","snapid":0,"hash":4108960803,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:13.607 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.12","key":"","snapid":0,"hash":4108960099,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:13.607 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.22","key":"","snapid":0,"hash":4108966163,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:13.607 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.15","key":"","snapid":0,"hash":4108960915,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:13.607 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.19","key":"","snapid":0,"hash":4108966483,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:13.607 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.11","key":"","snapid":0,"hash":4108960211,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:13.607 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.13","key":"","snapid":0,"hash":4108961331,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:13.607 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.20","key":"","snapid":0,"hash":4108966067,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:13.607 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.17","key":"","snapid":0,"hash":4108961267,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:13.607 INFO:tasks.ceph_objectstore_tool:parsing ["1.0",{"oid":"","key":"","snapid":-2,"hash":0,"max":0,"pool":1,"namespace":"","max":0}] 2026-02-26T03:16:13.607 INFO:tasks.ceph_objectstore_tool:parsing ["1.0",{"oid":"snapmapper","key":"","snapid":-2,"hash":0,"max":0,"pool":1,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:13.607 INFO:tasks.ceph_objectstore_tool:parsing ["1.0",{"oid":"main.db-journal.0000000000000000","key":"","snapid":-2,"hash":1969844440,"max":0,"pool":1,"namespace":"devicehealth","max":0}] 2026-02-26T03:16:13.607 INFO:tasks.ceph_objectstore_tool:parsing ["1.0",{"oid":"main.db.0000000000000000","key":"","snapid":-2,"hash":1315310604,"max":0,"pool":1,"namespace":"devicehealth","max":0}] 2026-02-26T03:16:13.607 INFO:tasks.ceph_objectstore_tool:parsing ["2.0",{"oid":"","key":"","snapid":-2,"hash":0,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-26T03:16:13.607 INFO:tasks.ceph_objectstore_tool:parsing ["2.0",{"oid":"snapmapper","key":"","snapid":-2,"hash":0,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:13.608 INFO:tasks.ceph_objectstore_tool:parsing ["3.4",{"oid":"","key":"","snapid":-2,"hash":4,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:13.608 INFO:tasks.ceph_objectstore_tool:parsing ["3.4",{"oid":"snapmapper","key":"","snapid":-2,"hash":4,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:13.608 INFO:tasks.ceph_objectstore_tool:parsing ["3.4",{"oid":"REPobject1","key":"","snapid":-2,"hash":623868980,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:13.608 INFO:tasks.ceph_objectstore_tool:found REPobject1 2026-02-26T03:16:13.608 INFO:tasks.ceph_objectstore_tool:parsing ["3.4",{"oid":"REPobject2","key":"","snapid":-2,"hash":3521648588,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:13.608 INFO:tasks.ceph_objectstore_tool:found REPobject2 2026-02-26T03:16:13.608 INFO:tasks.ceph_objectstore_tool:parsing ["2.2",{"oid":"","key":"","snapid":-2,"hash":2,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-26T03:16:13.608 INFO:tasks.ceph_objectstore_tool:parsing ["2.2",{"oid":"snapmapper","key":"","snapid":-2,"hash":2,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:13.608 INFO:tasks.ceph_objectstore_tool:parsing ["2.2",{"oid":"rbd_info","key":"","snapid":-2,"hash":2886620986,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-26T03:16:13.608 INFO:tasks.ceph_objectstore_tool:parsing ["2.4",{"oid":"","key":"","snapid":-2,"hash":4,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-26T03:16:13.608 INFO:tasks.ceph_objectstore_tool:parsing ["2.4",{"oid":"snapmapper","key":"","snapid":-2,"hash":4,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:13.608 INFO:tasks.ceph_objectstore_tool:parsing ["3.7",{"oid":"","key":"","snapid":-2,"hash":7,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:13.608 INFO:tasks.ceph_objectstore_tool:parsing ["3.7",{"oid":"snapmapper","key":"","snapid":-2,"hash":7,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:13.608 INFO:tasks.ceph_objectstore_tool:parsing ["2.6",{"oid":"","key":"","snapid":-2,"hash":6,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-26T03:16:13.608 INFO:tasks.ceph_objectstore_tool:parsing ["2.6",{"oid":"snapmapper","key":"","snapid":-2,"hash":6,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:13.608 INFO:tasks.ceph_objectstore_tool:parsing ["3.0",{"oid":"","key":"","snapid":-2,"hash":0,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:13.608 INFO:tasks.ceph_objectstore_tool:parsing ["3.0",{"oid":"snapmapper","key":"","snapid":-2,"hash":0,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:13.608 INFO:tasks.ceph_objectstore_tool:parsing ["3.6",{"oid":"","key":"","snapid":-2,"hash":6,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:13.608 INFO:tasks.ceph_objectstore_tool:parsing ["3.6",{"oid":"snapmapper","key":"","snapid":-2,"hash":6,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:13.608 INFO:tasks.ceph_objectstore_tool:parsing ["3.6",{"oid":"REPobject4","key":"","snapid":-2,"hash":833930126,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:13.608 INFO:tasks.ceph_objectstore_tool:found REPobject4 2026-02-26T03:16:13.608 INFO:tasks.ceph_objectstore_tool:process osd.2 on ubuntu@trial086.front.sepia.ceph.com 2026-02-26T03:16:13.608 DEBUG:teuthology.orchestra.run.trial086:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-2 --device-type SSD --op list 2026-02-26T03:16:13.751 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:13,749 seastar - Reactor backend: linux-aio 2026-02-26T03:16:13.762 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:13,760 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:16:13.762 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:13,760 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:16:13.765 INFO:teuthology.orchestra.run.trial086.stderr:==44701==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:16:14.482 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osd_superblock","key":"","snapid":-2,"hash":3572033044,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:14.482 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.13","key":"","snapid":0,"hash":1679232780,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:14.482 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.20","key":"","snapid":0,"hash":1679229324,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:14.482 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.17","key":"","snapid":0,"hash":1679229644,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:14.483 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.19","key":"","snapid":0,"hash":1679229740,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:14.483 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.11","key":"","snapid":0,"hash":1679232684,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:14.483 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.15","key":"","snapid":0,"hash":1679232108,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:14.483 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.22","key":"","snapid":0,"hash":1679230700,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:14.483 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.10","key":"","snapid":0,"hash":1679231260,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:14.483 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.18","key":"","snapid":0,"hash":1679229852,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:14.483 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.21","key":"","snapid":0,"hash":1679229276,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:14.483 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.14","key":"","snapid":0,"hash":1679232220,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:14.483 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.16","key":"","snapid":0,"hash":1679232316,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:14.483 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.12","key":"","snapid":0,"hash":1679232636,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:14.483 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.1","key":"","snapid":0,"hash":3059696390,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:14.483 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.9","key":"","snapid":0,"hash":3059697030,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:14.484 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.5","key":"","snapid":0,"hash":3059697350,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:14.484 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.7","key":"","snapid":0,"hash":3059697446,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:14.484 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.3","key":"","snapid":0,"hash":3059695718,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:14.484 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.6","key":"","snapid":0,"hash":3059697558,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:14.484 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.2","key":"","snapid":0,"hash":3059695830,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:14.484 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.4","key":"","snapid":0,"hash":3059695926,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:14.484 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.8","key":"","snapid":0,"hash":3059696886,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:14.484 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.6","key":"","snapid":0,"hash":4251864065,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:14.484 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.2","key":"","snapid":0,"hash":4251863361,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:14.484 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.4","key":"","snapid":0,"hash":4251864993,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:14.484 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.8","key":"","snapid":0,"hash":4251864417,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:14.484 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.3","key":"","snapid":0,"hash":4251864593,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:14.484 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.7","key":"","snapid":0,"hash":4251864529,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:14.485 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.9","key":"","snapid":0,"hash":4251861553,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:14.485 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.1","key":"","snapid":0,"hash":4251863473,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:14.485 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.5","key":"","snapid":0,"hash":4251864945,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:14.485 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.10","key":"","snapid":0,"hash":4108959747,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:14.485 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.18","key":"","snapid":0,"hash":4108966531,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:14.485 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.21","key":"","snapid":0,"hash":4108965955,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:14.485 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.14","key":"","snapid":0,"hash":4108961731,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:14.485 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.16","key":"","snapid":0,"hash":4108960803,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:14.496 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.12","key":"","snapid":0,"hash":4108960099,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:14.496 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.22","key":"","snapid":0,"hash":4108966163,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:14.496 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.15","key":"","snapid":0,"hash":4108960915,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:14.496 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.19","key":"","snapid":0,"hash":4108966483,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:14.496 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.11","key":"","snapid":0,"hash":4108960211,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:14.496 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.13","key":"","snapid":0,"hash":4108961331,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:14.496 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.20","key":"","snapid":0,"hash":4108966067,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:14.497 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.17","key":"","snapid":0,"hash":4108961267,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:14.497 INFO:teuthology.orchestra.run.trial086.stdout:["2.1",{"oid":"","key":"","snapid":-2,"hash":1,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-26T03:16:14.497 INFO:teuthology.orchestra.run.trial086.stdout:["2.1",{"oid":"snapmapper","key":"","snapid":-2,"hash":1,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:14.497 INFO:teuthology.orchestra.run.trial086.stdout:["3.1",{"oid":"","key":"","snapid":-2,"hash":1,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:14.497 INFO:teuthology.orchestra.run.trial086.stdout:["3.1",{"oid":"snapmapper","key":"","snapid":-2,"hash":1,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:14.497 INFO:teuthology.orchestra.run.trial086.stdout:["3.2",{"oid":"","key":"","snapid":-2,"hash":2,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:14.497 INFO:teuthology.orchestra.run.trial086.stdout:["3.2",{"oid":"snapmapper","key":"","snapid":-2,"hash":2,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:14.497 INFO:teuthology.orchestra.run.trial086.stdout:["3.2",{"oid":"REPobject3","key":"","snapid":-2,"hash":1871562002,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:14.497 INFO:teuthology.orchestra.run.trial086.stdout:["2.3",{"oid":"","key":"","snapid":-2,"hash":3,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-26T03:16:14.497 INFO:teuthology.orchestra.run.trial086.stdout:["2.3",{"oid":"snapmapper","key":"","snapid":-2,"hash":3,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:14.497 INFO:teuthology.orchestra.run.trial086.stdout:["2.3",{"oid":"rbd_trash","key":"","snapid":-2,"hash":1517589283,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-26T03:16:14.497 INFO:teuthology.orchestra.run.trial086.stdout:["3.0",{"oid":"","key":"","snapid":-2,"hash":0,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:14.497 INFO:teuthology.orchestra.run.trial086.stdout:["3.0",{"oid":"snapmapper","key":"","snapid":-2,"hash":0,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:14.498 INFO:teuthology.orchestra.run.trial086.stdout:["3.3",{"oid":"","key":"","snapid":-2,"hash":3,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:14.498 INFO:teuthology.orchestra.run.trial086.stdout:["3.3",{"oid":"snapmapper","key":"","snapid":-2,"hash":3,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:14.498 INFO:teuthology.orchestra.run.trial086.stdout:["3.4",{"oid":"","key":"","snapid":-2,"hash":4,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:14.498 INFO:teuthology.orchestra.run.trial086.stdout:["3.4",{"oid":"snapmapper","key":"","snapid":-2,"hash":4,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:14.498 INFO:teuthology.orchestra.run.trial086.stdout:["3.4",{"oid":"REPobject1","key":"","snapid":-2,"hash":623868980,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:14.498 INFO:teuthology.orchestra.run.trial086.stdout:["3.4",{"oid":"REPobject2","key":"","snapid":-2,"hash":3521648588,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:14.498 INFO:teuthology.orchestra.run.trial086.stdout:["3.5",{"oid":"","key":"","snapid":-2,"hash":5,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:14.498 INFO:teuthology.orchestra.run.trial086.stdout:["3.5",{"oid":"snapmapper","key":"","snapid":-2,"hash":5,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:14.498 INFO:teuthology.orchestra.run.trial086.stdout:["3.5",{"oid":"REPobject5","key":"","snapid":-2,"hash":2508448421,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:15.982 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:16:15.982 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:16:15.982 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:16:15.982 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:16:15.982 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:16:15.982 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:16:16.015 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osd_superblock","key":"","snapid":-2,"hash":3572033044,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.015 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.13","key":"","snapid":0,"hash":1679232780,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.015 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.20","key":"","snapid":0,"hash":1679229324,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.015 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.17","key":"","snapid":0,"hash":1679229644,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.015 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.19","key":"","snapid":0,"hash":1679229740,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.015 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.11","key":"","snapid":0,"hash":1679232684,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.015 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.15","key":"","snapid":0,"hash":1679232108,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.015 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.22","key":"","snapid":0,"hash":1679230700,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.015 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.10","key":"","snapid":0,"hash":1679231260,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.015 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.18","key":"","snapid":0,"hash":1679229852,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.015 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.21","key":"","snapid":0,"hash":1679229276,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.015 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.14","key":"","snapid":0,"hash":1679232220,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.015 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.16","key":"","snapid":0,"hash":1679232316,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.015 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.12","key":"","snapid":0,"hash":1679232636,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.015 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.1","key":"","snapid":0,"hash":3059696390,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.016 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.9","key":"","snapid":0,"hash":3059697030,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.016 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.5","key":"","snapid":0,"hash":3059697350,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.016 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.7","key":"","snapid":0,"hash":3059697446,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.016 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.3","key":"","snapid":0,"hash":3059695718,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.016 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.6","key":"","snapid":0,"hash":3059697558,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.016 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.2","key":"","snapid":0,"hash":3059695830,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.016 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.4","key":"","snapid":0,"hash":3059695926,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.016 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.8","key":"","snapid":0,"hash":3059696886,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.016 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.6","key":"","snapid":0,"hash":4251864065,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.016 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.2","key":"","snapid":0,"hash":4251863361,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.016 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.4","key":"","snapid":0,"hash":4251864993,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.016 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.8","key":"","snapid":0,"hash":4251864417,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.016 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.3","key":"","snapid":0,"hash":4251864593,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.016 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.7","key":"","snapid":0,"hash":4251864529,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.016 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.9","key":"","snapid":0,"hash":4251861553,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.016 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.1","key":"","snapid":0,"hash":4251863473,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.016 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.5","key":"","snapid":0,"hash":4251864945,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.016 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.10","key":"","snapid":0,"hash":4108959747,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.016 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.18","key":"","snapid":0,"hash":4108966531,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.016 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.21","key":"","snapid":0,"hash":4108965955,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.016 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.14","key":"","snapid":0,"hash":4108961731,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.016 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.16","key":"","snapid":0,"hash":4108960803,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.016 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.12","key":"","snapid":0,"hash":4108960099,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.016 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.22","key":"","snapid":0,"hash":4108966163,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.016 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.15","key":"","snapid":0,"hash":4108960915,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.016 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.19","key":"","snapid":0,"hash":4108966483,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.016 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.11","key":"","snapid":0,"hash":4108960211,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.016 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.13","key":"","snapid":0,"hash":4108961331,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.016 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.20","key":"","snapid":0,"hash":4108966067,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.016 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.17","key":"","snapid":0,"hash":4108961267,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.016 INFO:tasks.ceph_objectstore_tool:parsing ["2.1",{"oid":"","key":"","snapid":-2,"hash":1,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-26T03:16:16.016 INFO:tasks.ceph_objectstore_tool:parsing ["2.1",{"oid":"snapmapper","key":"","snapid":-2,"hash":1,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:16.016 INFO:tasks.ceph_objectstore_tool:parsing ["3.1",{"oid":"","key":"","snapid":-2,"hash":1,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:16.016 INFO:tasks.ceph_objectstore_tool:parsing ["3.1",{"oid":"snapmapper","key":"","snapid":-2,"hash":1,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:16.016 INFO:tasks.ceph_objectstore_tool:parsing ["3.2",{"oid":"","key":"","snapid":-2,"hash":2,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:16.016 INFO:tasks.ceph_objectstore_tool:parsing ["3.2",{"oid":"snapmapper","key":"","snapid":-2,"hash":2,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:16.016 INFO:tasks.ceph_objectstore_tool:parsing ["3.2",{"oid":"REPobject3","key":"","snapid":-2,"hash":1871562002,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:16.017 INFO:tasks.ceph_objectstore_tool:found REPobject3 2026-02-26T03:16:16.017 INFO:tasks.ceph_objectstore_tool:parsing ["2.3",{"oid":"","key":"","snapid":-2,"hash":3,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-26T03:16:16.017 INFO:tasks.ceph_objectstore_tool:parsing ["2.3",{"oid":"snapmapper","key":"","snapid":-2,"hash":3,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:16.017 INFO:tasks.ceph_objectstore_tool:parsing ["2.3",{"oid":"rbd_trash","key":"","snapid":-2,"hash":1517589283,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-26T03:16:16.017 INFO:tasks.ceph_objectstore_tool:parsing ["3.0",{"oid":"","key":"","snapid":-2,"hash":0,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:16.017 INFO:tasks.ceph_objectstore_tool:parsing ["3.0",{"oid":"snapmapper","key":"","snapid":-2,"hash":0,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:16.017 INFO:tasks.ceph_objectstore_tool:parsing ["3.3",{"oid":"","key":"","snapid":-2,"hash":3,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:16.017 INFO:tasks.ceph_objectstore_tool:parsing ["3.3",{"oid":"snapmapper","key":"","snapid":-2,"hash":3,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:16.017 INFO:tasks.ceph_objectstore_tool:parsing ["3.4",{"oid":"","key":"","snapid":-2,"hash":4,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:16.017 INFO:tasks.ceph_objectstore_tool:parsing ["3.4",{"oid":"snapmapper","key":"","snapid":-2,"hash":4,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:16.017 INFO:tasks.ceph_objectstore_tool:parsing ["3.4",{"oid":"REPobject1","key":"","snapid":-2,"hash":623868980,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:16.017 INFO:tasks.ceph_objectstore_tool:found REPobject1 2026-02-26T03:16:16.017 INFO:tasks.ceph_objectstore_tool:parsing ["3.4",{"oid":"REPobject2","key":"","snapid":-2,"hash":3521648588,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:16.017 INFO:tasks.ceph_objectstore_tool:found REPobject2 2026-02-26T03:16:16.017 INFO:tasks.ceph_objectstore_tool:parsing ["3.5",{"oid":"","key":"","snapid":-2,"hash":5,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:16.017 INFO:tasks.ceph_objectstore_tool:parsing ["3.5",{"oid":"snapmapper","key":"","snapid":-2,"hash":5,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:16.017 INFO:tasks.ceph_objectstore_tool:parsing ["3.5",{"oid":"REPobject5","key":"","snapid":-2,"hash":2508448421,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:16.017 INFO:tasks.ceph_objectstore_tool:found REPobject5 2026-02-26T03:16:16.017 INFO:tasks.ceph_objectstore_tool:process osd.3 on ubuntu@trial086.front.sepia.ceph.com 2026-02-26T03:16:16.017 DEBUG:teuthology.orchestra.run.trial086:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-3 --device-type SSD --op list 2026-02-26T03:16:16.160 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:16,158 seastar - Reactor backend: linux-aio 2026-02-26T03:16:16.171 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:16,169 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:16:16.172 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:16,169 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:16:16.174 INFO:teuthology.orchestra.run.trial086.stderr:==44732==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:16:16.781 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osd_superblock","key":"","snapid":-2,"hash":3572033044,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.781 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.13","key":"","snapid":0,"hash":1679232780,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.781 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.20","key":"","snapid":0,"hash":1679229324,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.781 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.17","key":"","snapid":0,"hash":1679229644,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.781 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.19","key":"","snapid":0,"hash":1679229740,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.782 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.11","key":"","snapid":0,"hash":1679232684,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.782 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.15","key":"","snapid":0,"hash":1679232108,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.782 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.22","key":"","snapid":0,"hash":1679230700,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.782 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.10","key":"","snapid":0,"hash":1679231260,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.782 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.18","key":"","snapid":0,"hash":1679229852,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.782 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.21","key":"","snapid":0,"hash":1679229276,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.782 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.14","key":"","snapid":0,"hash":1679232220,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.782 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.16","key":"","snapid":0,"hash":1679232316,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.782 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.12","key":"","snapid":0,"hash":1679232636,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.782 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.1","key":"","snapid":0,"hash":3059696390,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.782 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.9","key":"","snapid":0,"hash":3059697030,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.782 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.5","key":"","snapid":0,"hash":3059697350,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.782 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.7","key":"","snapid":0,"hash":3059697446,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.783 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.3","key":"","snapid":0,"hash":3059695718,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.783 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.6","key":"","snapid":0,"hash":3059697558,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.783 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.2","key":"","snapid":0,"hash":3059695830,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.783 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.4","key":"","snapid":0,"hash":3059695926,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.783 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.8","key":"","snapid":0,"hash":3059696886,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.783 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.6","key":"","snapid":0,"hash":4251864065,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.783 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.2","key":"","snapid":0,"hash":4251863361,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.783 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.4","key":"","snapid":0,"hash":4251864993,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.783 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.8","key":"","snapid":0,"hash":4251864417,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.783 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.3","key":"","snapid":0,"hash":4251864593,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.783 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.7","key":"","snapid":0,"hash":4251864529,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.783 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.9","key":"","snapid":0,"hash":4251861553,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.784 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.1","key":"","snapid":0,"hash":4251863473,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.784 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"osdmap.5","key":"","snapid":0,"hash":4251864945,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.784 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.10","key":"","snapid":0,"hash":4108959747,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.784 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.18","key":"","snapid":0,"hash":4108966531,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.784 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.21","key":"","snapid":0,"hash":4108965955,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.784 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.14","key":"","snapid":0,"hash":4108961731,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.784 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.16","key":"","snapid":0,"hash":4108960803,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.797 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.12","key":"","snapid":0,"hash":4108960099,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.797 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.22","key":"","snapid":0,"hash":4108966163,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.797 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.15","key":"","snapid":0,"hash":4108960915,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.797 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.19","key":"","snapid":0,"hash":4108966483,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.797 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.11","key":"","snapid":0,"hash":4108960211,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.797 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.13","key":"","snapid":0,"hash":4108961331,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.798 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.20","key":"","snapid":0,"hash":4108966067,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.798 INFO:teuthology.orchestra.run.trial086.stdout:["meta",{"oid":"inc_osdmap.17","key":"","snapid":0,"hash":4108961267,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:16.798 INFO:teuthology.orchestra.run.trial086.stdout:["2.0",{"oid":"","key":"","snapid":-2,"hash":0,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-26T03:16:16.798 INFO:teuthology.orchestra.run.trial086.stdout:["2.0",{"oid":"snapmapper","key":"","snapid":-2,"hash":0,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:16.798 INFO:teuthology.orchestra.run.trial086.stdout:["2.3",{"oid":"","key":"","snapid":-2,"hash":3,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-26T03:16:16.798 INFO:teuthology.orchestra.run.trial086.stdout:["2.3",{"oid":"snapmapper","key":"","snapid":-2,"hash":3,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:16.798 INFO:teuthology.orchestra.run.trial086.stdout:["2.3",{"oid":"rbd_trash","key":"","snapid":-2,"hash":1517589283,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-26T03:16:16.798 INFO:teuthology.orchestra.run.trial086.stdout:["3.2",{"oid":"","key":"","snapid":-2,"hash":2,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:16.798 INFO:teuthology.orchestra.run.trial086.stdout:["3.2",{"oid":"snapmapper","key":"","snapid":-2,"hash":2,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:16.798 INFO:teuthology.orchestra.run.trial086.stdout:["3.2",{"oid":"REPobject3","key":"","snapid":-2,"hash":1871562002,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:16.798 INFO:teuthology.orchestra.run.trial086.stdout:["2.2",{"oid":"","key":"","snapid":-2,"hash":2,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-26T03:16:16.799 INFO:teuthology.orchestra.run.trial086.stdout:["2.2",{"oid":"snapmapper","key":"","snapid":-2,"hash":2,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:16.799 INFO:teuthology.orchestra.run.trial086.stdout:["2.2",{"oid":"rbd_info","key":"","snapid":-2,"hash":2886620986,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-26T03:16:16.799 INFO:teuthology.orchestra.run.trial086.stdout:["2.5",{"oid":"","key":"","snapid":-2,"hash":5,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-26T03:16:16.799 INFO:teuthology.orchestra.run.trial086.stdout:["2.5",{"oid":"snapmapper","key":"","snapid":-2,"hash":5,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:16.799 INFO:teuthology.orchestra.run.trial086.stdout:["3.5",{"oid":"","key":"","snapid":-2,"hash":5,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:16.799 INFO:teuthology.orchestra.run.trial086.stdout:["3.5",{"oid":"snapmapper","key":"","snapid":-2,"hash":5,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:16.799 INFO:teuthology.orchestra.run.trial086.stdout:["3.5",{"oid":"REPobject5","key":"","snapid":-2,"hash":2508448421,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:16.799 INFO:teuthology.orchestra.run.trial086.stdout:["2.1",{"oid":"","key":"","snapid":-2,"hash":1,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-26T03:16:16.799 INFO:teuthology.orchestra.run.trial086.stdout:["2.1",{"oid":"snapmapper","key":"","snapid":-2,"hash":1,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:16.799 INFO:teuthology.orchestra.run.trial086.stdout:["2.7",{"oid":"","key":"","snapid":-2,"hash":7,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-26T03:16:16.799 INFO:teuthology.orchestra.run.trial086.stdout:["2.7",{"oid":"snapmapper","key":"","snapid":-2,"hash":7,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:16.799 INFO:teuthology.orchestra.run.trial086.stdout:["3.7",{"oid":"","key":"","snapid":-2,"hash":7,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:16.800 INFO:teuthology.orchestra.run.trial086.stdout:["3.7",{"oid":"snapmapper","key":"","snapid":-2,"hash":7,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:18.303 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:16:18.303 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:16:18.303 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:16:18.303 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:16:18.303 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:16:18.303 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:16:18.339 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osd_superblock","key":"","snapid":-2,"hash":3572033044,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:18.339 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.13","key":"","snapid":0,"hash":1679232780,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:18.339 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.20","key":"","snapid":0,"hash":1679229324,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:18.339 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.17","key":"","snapid":0,"hash":1679229644,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:18.339 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.19","key":"","snapid":0,"hash":1679229740,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:18.339 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.11","key":"","snapid":0,"hash":1679232684,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:18.339 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.15","key":"","snapid":0,"hash":1679232108,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:18.339 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.22","key":"","snapid":0,"hash":1679230700,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:18.339 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.10","key":"","snapid":0,"hash":1679231260,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:18.339 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.18","key":"","snapid":0,"hash":1679229852,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:18.339 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.21","key":"","snapid":0,"hash":1679229276,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:18.339 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.14","key":"","snapid":0,"hash":1679232220,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:18.340 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.16","key":"","snapid":0,"hash":1679232316,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:18.340 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.12","key":"","snapid":0,"hash":1679232636,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:18.340 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.1","key":"","snapid":0,"hash":3059696390,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:18.340 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.9","key":"","snapid":0,"hash":3059697030,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:18.340 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.5","key":"","snapid":0,"hash":3059697350,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:18.340 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.7","key":"","snapid":0,"hash":3059697446,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:18.340 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.3","key":"","snapid":0,"hash":3059695718,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:18.340 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.6","key":"","snapid":0,"hash":3059697558,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:18.340 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.2","key":"","snapid":0,"hash":3059695830,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:18.340 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.4","key":"","snapid":0,"hash":3059695926,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:18.340 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.8","key":"","snapid":0,"hash":3059696886,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:18.340 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.6","key":"","snapid":0,"hash":4251864065,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:18.340 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.2","key":"","snapid":0,"hash":4251863361,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:18.340 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.4","key":"","snapid":0,"hash":4251864993,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:18.340 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.8","key":"","snapid":0,"hash":4251864417,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:18.340 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.3","key":"","snapid":0,"hash":4251864593,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:18.340 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.7","key":"","snapid":0,"hash":4251864529,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:18.340 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.9","key":"","snapid":0,"hash":4251861553,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:18.340 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.1","key":"","snapid":0,"hash":4251863473,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:18.340 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.5","key":"","snapid":0,"hash":4251864945,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:18.340 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.10","key":"","snapid":0,"hash":4108959747,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:18.340 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.18","key":"","snapid":0,"hash":4108966531,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:18.340 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.21","key":"","snapid":0,"hash":4108965955,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:18.340 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.14","key":"","snapid":0,"hash":4108961731,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:18.340 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.16","key":"","snapid":0,"hash":4108960803,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:18.340 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.12","key":"","snapid":0,"hash":4108960099,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:18.340 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.22","key":"","snapid":0,"hash":4108966163,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:18.340 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.15","key":"","snapid":0,"hash":4108960915,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:18.340 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.19","key":"","snapid":0,"hash":4108966483,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:18.340 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.11","key":"","snapid":0,"hash":4108960211,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:18.340 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.13","key":"","snapid":0,"hash":4108961331,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:18.340 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.20","key":"","snapid":0,"hash":4108966067,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:18.340 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.17","key":"","snapid":0,"hash":4108961267,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-26T03:16:18.340 INFO:tasks.ceph_objectstore_tool:parsing ["2.0",{"oid":"","key":"","snapid":-2,"hash":0,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-26T03:16:18.340 INFO:tasks.ceph_objectstore_tool:parsing ["2.0",{"oid":"snapmapper","key":"","snapid":-2,"hash":0,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:18.340 INFO:tasks.ceph_objectstore_tool:parsing ["2.3",{"oid":"","key":"","snapid":-2,"hash":3,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-26T03:16:18.340 INFO:tasks.ceph_objectstore_tool:parsing ["2.3",{"oid":"snapmapper","key":"","snapid":-2,"hash":3,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:18.341 INFO:tasks.ceph_objectstore_tool:parsing ["2.3",{"oid":"rbd_trash","key":"","snapid":-2,"hash":1517589283,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-26T03:16:18.341 INFO:tasks.ceph_objectstore_tool:parsing ["3.2",{"oid":"","key":"","snapid":-2,"hash":2,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:18.341 INFO:tasks.ceph_objectstore_tool:parsing ["3.2",{"oid":"snapmapper","key":"","snapid":-2,"hash":2,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:18.341 INFO:tasks.ceph_objectstore_tool:parsing ["3.2",{"oid":"REPobject3","key":"","snapid":-2,"hash":1871562002,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:18.341 INFO:tasks.ceph_objectstore_tool:found REPobject3 2026-02-26T03:16:18.341 INFO:tasks.ceph_objectstore_tool:parsing ["2.2",{"oid":"","key":"","snapid":-2,"hash":2,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-26T03:16:18.341 INFO:tasks.ceph_objectstore_tool:parsing ["2.2",{"oid":"snapmapper","key":"","snapid":-2,"hash":2,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:18.341 INFO:tasks.ceph_objectstore_tool:parsing ["2.2",{"oid":"rbd_info","key":"","snapid":-2,"hash":2886620986,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-26T03:16:18.341 INFO:tasks.ceph_objectstore_tool:parsing ["2.5",{"oid":"","key":"","snapid":-2,"hash":5,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-26T03:16:18.341 INFO:tasks.ceph_objectstore_tool:parsing ["2.5",{"oid":"snapmapper","key":"","snapid":-2,"hash":5,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:18.341 INFO:tasks.ceph_objectstore_tool:parsing ["3.5",{"oid":"","key":"","snapid":-2,"hash":5,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:18.341 INFO:tasks.ceph_objectstore_tool:parsing ["3.5",{"oid":"snapmapper","key":"","snapid":-2,"hash":5,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:18.341 INFO:tasks.ceph_objectstore_tool:parsing ["3.5",{"oid":"REPobject5","key":"","snapid":-2,"hash":2508448421,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:18.341 INFO:tasks.ceph_objectstore_tool:found REPobject5 2026-02-26T03:16:18.341 INFO:tasks.ceph_objectstore_tool:parsing ["2.1",{"oid":"","key":"","snapid":-2,"hash":1,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-26T03:16:18.341 INFO:tasks.ceph_objectstore_tool:parsing ["2.1",{"oid":"snapmapper","key":"","snapid":-2,"hash":1,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:18.341 INFO:tasks.ceph_objectstore_tool:parsing ["2.7",{"oid":"","key":"","snapid":-2,"hash":7,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-26T03:16:18.341 INFO:tasks.ceph_objectstore_tool:parsing ["2.7",{"oid":"snapmapper","key":"","snapid":-2,"hash":7,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:18.341 INFO:tasks.ceph_objectstore_tool:parsing ["3.7",{"oid":"","key":"","snapid":-2,"hash":7,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-26T03:16:18.341 INFO:tasks.ceph_objectstore_tool:parsing ["3.7",{"oid":"snapmapper","key":"","snapid":-2,"hash":7,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-26T03:16:18.341 INFO:tasks.ceph_objectstore_tool:Finished --op list 2026-02-26T03:16:18.341 INFO:tasks.ceph_objectstore_tool:Found: {'REPobject1': {'xattr': {}, 'omap': {}, 'pg2json': {'3.4': '{"oid": "REPobject1", "key": "", "snapid": -2, "hash": 623868980, "max": 0, "pool": 3, "namespace": ""}'}}, 'REPobject2': {'xattr': {'key2-1': 'val2-1'}, 'omapheader': 'hdr2', 'omap': {'okey2-1': 'oval2-1'}, 'pg2json': {'3.4': '{"oid": "REPobject2", "key": "", "snapid": -2, "hash": 3521648588, "max": 0, "pool": 3, "namespace": ""}'}}, 'REPobject3': {'xattr': {'key3-1': 'val3-1', 'key3-2': 'val3-2'}, 'omapheader': 'hdr3', 'omap': {'okey3-1': 'oval3-1', 'okey3-2': 'oval3-2'}, 'pg2json': {'3.2': '{"oid": "REPobject3", "key": "", "snapid": -2, "hash": 1871562002, "max": 0, "pool": 3, "namespace": ""}'}}, 'REPobject4': {'xattr': {'key4-1': 'val4-1', 'key4-2': 'val4-2', 'key4-3': 'val4-3'}, 'omapheader': 'hdr4', 'omap': {'okey4-1': 'oval4-1', 'okey4-2': 'oval4-2', 'okey4-3': 'oval4-3'}, 'pg2json': {'3.6': '{"oid": "REPobject4", "key": "", "snapid": -2, "hash": 833930126, "max": 0, "pool": 3, "namespace": ""}'}}, 'REPobject5': {'xattr': {'key5-1': 'val5-1', 'key5-2': 'val5-2', 'key5-3': 'val5-3', 'key5-4': 'val5-4'}, 'omapheader': 'hdr5', 'omap': {'okey5-1': 'oval5-1', 'okey5-2': 'oval5-2', 'okey5-3': 'oval5-3', 'okey5-4': 'oval5-4'}, 'pg2json': {'3.5': '{"oid": "REPobject5", "key": "", "snapid": -2, "hash": 2508448421, "max": 0, "pool": 3, "namespace": ""}'}}} 2026-02-26T03:16:18.341 INFO:tasks.ceph_objectstore_tool:Found pgs: {'3.4', '3.2', '3.5', '3.6'} 2026-02-26T03:16:18.341 INFO:tasks.ceph_objectstore_tool:Found objects by pgs: {'3.6': ['REPobject4', 'REPobject4'], '3.4': ['REPobject1', 'REPobject2', 'REPobject1', 'REPobject2'], '3.2': ['REPobject3', 'REPobject3'], '3.5': ['REPobject5', 'REPobject5']} 2026-02-26T03:16:18.341 INFO:tasks.ceph_objectstore_tool:Test get-bytes and set-bytes 2026-02-26T03:16:18.341 DEBUG:teuthology.orchestra.run.trial086:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-2 --device-type SSD --pgid 3.2 '{"oid": "REPobject3", "key": "", "snapid": -2, "hash": 1871562002, "max": 0, "pool": 3, "namespace": ""}' get-bytes /home/ubuntu/cephtest/ceph.data/get 2026-02-26T03:16:18.482 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:18,480 seastar - Reactor backend: linux-aio 2026-02-26T03:16:18.493 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:18,490 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:16:18.493 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:18,490 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:16:18.495 INFO:teuthology.orchestra.run.trial086.stderr:==44763==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:16:20.553 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:16:20.553 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:16:20.553 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:16:20.553 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:16:20.553 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:16:20.553 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:16:20.585 DEBUG:teuthology.orchestra.run.trial086:> diff -q /home/ubuntu/cephtest/ceph.data/REPobject3 /home/ubuntu/cephtest/ceph.data/get 2026-02-26T03:16:20.602 DEBUG:tasks.ceph_objectstore_tool:Got original data from get-bytes REPobject3 successfully! 2026-02-26T03:16:20.602 DEBUG:teuthology.orchestra.run.trial086:> rm -f /home/ubuntu/cephtest/ceph.data/get 2026-02-26T03:16:20.659 DEBUG:tasks.ceph_objectstore_tool:Setting new data to REPobject3 2026-02-26T03:16:20.659 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-26T03:16:20.659 DEBUG:teuthology.orchestra.run.trial086:> dd of=/home/ubuntu/cephtest/ceph.data/set 2026-02-26T03:16:20.716 DEBUG:teuthology.orchestra.run.trial086:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-2 --device-type SSD --pgid 3.2 '{"oid": "REPobject3", "key": "", "snapid": -2, "hash": 1871562002, "max": 0, "pool": 3, "namespace": ""}' set-bytes /home/ubuntu/cephtest/ceph.data/set 2026-02-26T03:16:20.902 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:20,899 seastar - Reactor backend: linux-aio 2026-02-26T03:16:20.914 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:20,911 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:16:20.914 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:20,911 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:16:20.916 INFO:teuthology.orchestra.run.trial086.stderr:==44863==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:16:21.489 INFO:teuthology.orchestra.run.trial086.stdout:set bytes success: data size=64 2026-02-26T03:16:22.974 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:16:22.974 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:16:22.974 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:16:22.974 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:16:22.974 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:16:22.974 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:16:23.009 DEBUG:teuthology.orchestra.run.trial086:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-2 --device-type SSD --pgid 3.2 '{"oid": "REPobject3", "key": "", "snapid": -2, "hash": 1871562002, "max": 0, "pool": 3, "namespace": ""}' get-bytes - 2026-02-26T03:16:23.157 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:23,155 seastar - Reactor backend: linux-aio 2026-02-26T03:16:23.170 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:23,167 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:16:23.170 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:23,167 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:16:23.172 INFO:teuthology.orchestra.run.trial086.stderr:==44895==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:16:25.255 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:16:25.255 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:16:25.255 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:16:25.255 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:16:25.255 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:16:25.255 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:16:25.256 INFO:teuthology.orchestra.run.trial086.stdout:set-bytes going into /home/ubuntu/cephtest/ceph.data/REPobject3 2026-02-26T03:16:25.287 DEBUG:tasks.ceph_objectstore_tool:Got data after set-bytes to REPobject3 successfully! 2026-02-26T03:16:25.287 DEBUG:tasks.ceph_objectstore_tool:Retrning REPobject3 to orginal data 2026-02-26T03:16:25.287 DEBUG:teuthology.orchestra.run.trial086:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-2 --device-type SSD --pgid 3.2 '{"oid": "REPobject3", "key": "", "snapid": -2, "hash": 1871562002, "max": 0, "pool": 3, "namespace": ""}' set-bytes /home/ubuntu/cephtest/ceph.data/REPobject3 2026-02-26T03:16:25.430 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:25,428 seastar - Reactor backend: linux-aio 2026-02-26T03:16:25.437 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:25,435 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:16:25.437 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:25,435 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:16:25.440 INFO:teuthology.orchestra.run.trial086.stderr:==44926==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:16:25.936 INFO:teuthology.orchestra.run.trial086.stdout:set bytes success: data size=320000 2026-02-26T03:16:27.445 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:16:27.445 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:16:27.445 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:16:27.445 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:16:27.445 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:16:27.445 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:16:27.478 DEBUG:teuthology.orchestra.run.trial086:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-3 --device-type SSD --pgid 3.2 '{"oid": "REPobject3", "key": "", "snapid": -2, "hash": 1871562002, "max": 0, "pool": 3, "namespace": ""}' get-bytes /home/ubuntu/cephtest/ceph.data/get 2026-02-26T03:16:27.625 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:27,623 seastar - Reactor backend: linux-aio 2026-02-26T03:16:27.636 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:27,634 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:16:27.636 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:27,634 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:16:27.639 INFO:teuthology.orchestra.run.trial086.stderr:==44957==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:16:29.689 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:16:29.689 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:16:29.689 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:16:29.689 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:16:29.689 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:16:29.689 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:16:29.719 DEBUG:teuthology.orchestra.run.trial086:> diff -q /home/ubuntu/cephtest/ceph.data/REPobject3 /home/ubuntu/cephtest/ceph.data/get 2026-02-26T03:16:29.735 DEBUG:tasks.ceph_objectstore_tool:Got original data from get-bytes REPobject3 successfully! 2026-02-26T03:16:29.735 DEBUG:teuthology.orchestra.run.trial086:> rm -f /home/ubuntu/cephtest/ceph.data/get 2026-02-26T03:16:29.792 DEBUG:tasks.ceph_objectstore_tool:Setting new data to REPobject3 2026-02-26T03:16:29.793 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-26T03:16:29.793 DEBUG:teuthology.orchestra.run.trial086:> dd of=/home/ubuntu/cephtest/ceph.data/set 2026-02-26T03:16:29.848 DEBUG:teuthology.orchestra.run.trial086:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-3 --device-type SSD --pgid 3.2 '{"oid": "REPobject3", "key": "", "snapid": -2, "hash": 1871562002, "max": 0, "pool": 3, "namespace": ""}' set-bytes /home/ubuntu/cephtest/ceph.data/set 2026-02-26T03:16:30.030 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:30,028 seastar - Reactor backend: linux-aio 2026-02-26T03:16:30.037 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:30,035 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:16:30.038 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:30,035 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:16:30.040 INFO:teuthology.orchestra.run.trial086.stderr:==45057==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:16:30.558 INFO:teuthology.orchestra.run.trial086.stdout:set bytes success: data size=64 2026-02-26T03:16:32.075 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:16:32.075 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:16:32.075 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:16:32.076 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:16:32.076 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:16:32.076 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:16:32.108 DEBUG:teuthology.orchestra.run.trial086:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-3 --device-type SSD --pgid 3.2 '{"oid": "REPobject3", "key": "", "snapid": -2, "hash": 1871562002, "max": 0, "pool": 3, "namespace": ""}' get-bytes - 2026-02-26T03:16:32.253 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:32,251 seastar - Reactor backend: linux-aio 2026-02-26T03:16:32.264 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:32,262 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:16:32.265 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:32,262 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:16:32.267 INFO:teuthology.orchestra.run.trial086.stderr:==45088==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:16:34.262 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:16:34.262 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:16:34.263 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:16:34.263 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:16:34.263 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:16:34.263 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:16:34.263 INFO:teuthology.orchestra.run.trial086.stdout:set-bytes going into /home/ubuntu/cephtest/ceph.data/REPobject3 2026-02-26T03:16:34.295 DEBUG:tasks.ceph_objectstore_tool:Got data after set-bytes to REPobject3 successfully! 2026-02-26T03:16:34.295 DEBUG:tasks.ceph_objectstore_tool:Retrning REPobject3 to orginal data 2026-02-26T03:16:34.295 DEBUG:teuthology.orchestra.run.trial086:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-3 --device-type SSD --pgid 3.2 '{"oid": "REPobject3", "key": "", "snapid": -2, "hash": 1871562002, "max": 0, "pool": 3, "namespace": ""}' set-bytes /home/ubuntu/cephtest/ceph.data/REPobject3 2026-02-26T03:16:34.438 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:34,436 seastar - Reactor backend: linux-aio 2026-02-26T03:16:34.444 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:34,442 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:16:34.444 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:34,442 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:16:34.447 INFO:teuthology.orchestra.run.trial086.stderr:==45119==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:16:34.913 INFO:teuthology.orchestra.run.trial086.stdout:set bytes success: data size=320000 2026-02-26T03:16:36.397 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:16:36.397 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:16:36.398 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:16:36.398 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:16:36.398 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:16:36.398 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:16:36.429 DEBUG:teuthology.orchestra.run.trial086:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-0 --device-type SSD --pgid 3.6 '{"oid": "REPobject4", "key": "", "snapid": -2, "hash": 833930126, "max": 0, "pool": 3, "namespace": ""}' get-bytes /home/ubuntu/cephtest/ceph.data/get 2026-02-26T03:16:36.576 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:36,574 seastar - Reactor backend: linux-aio 2026-02-26T03:16:36.592 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:36,589 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:16:36.592 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:36,589 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:16:36.594 INFO:teuthology.orchestra.run.trial086.stderr:==45150==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:16:38.630 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:16:38.630 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:16:38.630 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:16:38.630 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:16:38.631 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:16:38.631 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:16:38.665 DEBUG:teuthology.orchestra.run.trial086:> diff -q /home/ubuntu/cephtest/ceph.data/REPobject4 /home/ubuntu/cephtest/ceph.data/get 2026-02-26T03:16:38.683 DEBUG:tasks.ceph_objectstore_tool:Got original data from get-bytes REPobject4 successfully! 2026-02-26T03:16:38.683 DEBUG:teuthology.orchestra.run.trial086:> rm -f /home/ubuntu/cephtest/ceph.data/get 2026-02-26T03:16:38.738 DEBUG:tasks.ceph_objectstore_tool:Setting new data to REPobject4 2026-02-26T03:16:38.739 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-26T03:16:38.739 DEBUG:teuthology.orchestra.run.trial086:> dd of=/home/ubuntu/cephtest/ceph.data/set 2026-02-26T03:16:38.793 DEBUG:teuthology.orchestra.run.trial086:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-0 --device-type SSD --pgid 3.6 '{"oid": "REPobject4", "key": "", "snapid": -2, "hash": 833930126, "max": 0, "pool": 3, "namespace": ""}' set-bytes /home/ubuntu/cephtest/ceph.data/set 2026-02-26T03:16:38.979 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:38,977 seastar - Reactor backend: linux-aio 2026-02-26T03:16:38.997 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:38,994 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:16:38.997 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:38,994 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:16:38.999 INFO:teuthology.orchestra.run.trial086.stderr:==45250==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:16:39.484 INFO:teuthology.orchestra.run.trial086.stdout:set bytes success: data size=64 2026-02-26T03:16:41.002 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:16:41.003 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:16:41.003 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:16:41.003 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:16:41.003 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:16:41.003 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:16:41.035 DEBUG:teuthology.orchestra.run.trial086:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-0 --device-type SSD --pgid 3.6 '{"oid": "REPobject4", "key": "", "snapid": -2, "hash": 833930126, "max": 0, "pool": 3, "namespace": ""}' get-bytes - 2026-02-26T03:16:41.180 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:41,178 seastar - Reactor backend: linux-aio 2026-02-26T03:16:41.191 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:41,189 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:16:41.191 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:41,189 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:16:41.194 INFO:teuthology.orchestra.run.trial086.stderr:==45281==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:16:43.189 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:16:43.189 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:16:43.190 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:16:43.190 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:16:43.190 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:16:43.190 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:16:43.190 INFO:teuthology.orchestra.run.trial086.stdout:set-bytes going into /home/ubuntu/cephtest/ceph.data/REPobject4 2026-02-26T03:16:43.222 DEBUG:tasks.ceph_objectstore_tool:Got data after set-bytes to REPobject4 successfully! 2026-02-26T03:16:43.223 DEBUG:tasks.ceph_objectstore_tool:Retrning REPobject4 to orginal data 2026-02-26T03:16:43.223 DEBUG:teuthology.orchestra.run.trial086:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-0 --device-type SSD --pgid 3.6 '{"oid": "REPobject4", "key": "", "snapid": -2, "hash": 833930126, "max": 0, "pool": 3, "namespace": ""}' set-bytes /home/ubuntu/cephtest/ceph.data/REPobject4 2026-02-26T03:16:43.370 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:43,368 seastar - Reactor backend: linux-aio 2026-02-26T03:16:43.386 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:43,384 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:16:43.386 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:43,384 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:16:43.389 INFO:teuthology.orchestra.run.trial086.stderr:==45312==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:16:43.826 INFO:teuthology.orchestra.run.trial086.stdout:set bytes success: data size=320000 2026-02-26T03:16:45.340 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:16:45.341 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:16:45.341 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:16:45.341 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:16:45.341 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:16:45.341 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:16:45.368 DEBUG:teuthology.orchestra.run.trial086:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-1 --device-type SSD --pgid 3.6 '{"oid": "REPobject4", "key": "", "snapid": -2, "hash": 833930126, "max": 0, "pool": 3, "namespace": ""}' get-bytes /home/ubuntu/cephtest/ceph.data/get 2026-02-26T03:16:45.510 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:45,508 seastar - Reactor backend: linux-aio 2026-02-26T03:16:45.525 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:45,522 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:16:45.525 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:45,522 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:16:45.527 INFO:teuthology.orchestra.run.trial086.stderr:==45343==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:16:47.641 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:16:47.642 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:16:47.642 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:16:47.642 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:16:47.642 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:16:47.642 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:16:47.677 DEBUG:teuthology.orchestra.run.trial086:> diff -q /home/ubuntu/cephtest/ceph.data/REPobject4 /home/ubuntu/cephtest/ceph.data/get 2026-02-26T03:16:47.693 DEBUG:tasks.ceph_objectstore_tool:Got original data from get-bytes REPobject4 successfully! 2026-02-26T03:16:47.693 DEBUG:teuthology.orchestra.run.trial086:> rm -f /home/ubuntu/cephtest/ceph.data/get 2026-02-26T03:16:47.749 DEBUG:tasks.ceph_objectstore_tool:Setting new data to REPobject4 2026-02-26T03:16:47.749 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-26T03:16:47.749 DEBUG:teuthology.orchestra.run.trial086:> dd of=/home/ubuntu/cephtest/ceph.data/set 2026-02-26T03:16:47.805 DEBUG:teuthology.orchestra.run.trial086:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-1 --device-type SSD --pgid 3.6 '{"oid": "REPobject4", "key": "", "snapid": -2, "hash": 833930126, "max": 0, "pool": 3, "namespace": ""}' set-bytes /home/ubuntu/cephtest/ceph.data/set 2026-02-26T03:16:47.995 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:47,993 seastar - Reactor backend: linux-aio 2026-02-26T03:16:48.003 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:48,001 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:16:48.003 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:48,001 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:16:48.006 INFO:teuthology.orchestra.run.trial086.stderr:==45443==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:16:48.563 INFO:teuthology.orchestra.run.trial086.stdout:set bytes success: data size=64 2026-02-26T03:16:50.083 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:16:50.083 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:16:50.083 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:16:50.083 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:16:50.083 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:16:50.083 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:16:50.116 DEBUG:teuthology.orchestra.run.trial086:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-1 --device-type SSD --pgid 3.6 '{"oid": "REPobject4", "key": "", "snapid": -2, "hash": 833930126, "max": 0, "pool": 3, "namespace": ""}' get-bytes - 2026-02-26T03:16:50.256 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:50,254 seastar - Reactor backend: linux-aio 2026-02-26T03:16:50.268 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:50,265 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:16:50.268 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:50,265 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:16:50.270 INFO:teuthology.orchestra.run.trial086.stderr:==45474==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:16:52.292 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:16:52.292 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:16:52.292 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:16:52.292 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:16:52.293 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:16:52.293 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:16:52.293 INFO:teuthology.orchestra.run.trial086.stdout:set-bytes going into /home/ubuntu/cephtest/ceph.data/REPobject4 2026-02-26T03:16:52.324 DEBUG:tasks.ceph_objectstore_tool:Got data after set-bytes to REPobject4 successfully! 2026-02-26T03:16:52.324 DEBUG:tasks.ceph_objectstore_tool:Retrning REPobject4 to orginal data 2026-02-26T03:16:52.325 DEBUG:teuthology.orchestra.run.trial086:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-1 --device-type SSD --pgid 3.6 '{"oid": "REPobject4", "key": "", "snapid": -2, "hash": 833930126, "max": 0, "pool": 3, "namespace": ""}' set-bytes /home/ubuntu/cephtest/ceph.data/REPobject4 2026-02-26T03:16:52.464 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:52,461 seastar - Reactor backend: linux-aio 2026-02-26T03:16:52.471 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:52,469 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:16:52.471 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:52,469 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:16:52.475 INFO:teuthology.orchestra.run.trial086.stderr:==45505==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:16:52.957 INFO:teuthology.orchestra.run.trial086.stdout:set bytes success: data size=320000 2026-02-26T03:16:54.466 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:16:54.466 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:16:54.466 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:16:54.466 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:16:54.466 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:16:54.466 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:16:54.498 INFO:tasks.ceph_objectstore_tool:Test list-attrs get-attr 2026-02-26T03:16:54.499 DEBUG:teuthology.orchestra.run.trial086:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-2 --device-type SSD --pgid 3.2 '{"oid": "REPobject3", "key": "", "snapid": -2, "hash": 1871562002, "max": 0, "pool": 3, "namespace": ""}' list-attrs 2026-02-26T03:16:54.647 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:54,645 seastar - Reactor backend: linux-aio 2026-02-26T03:16:54.658 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:54,656 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:16:54.658 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:54,656 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:16:54.662 INFO:teuthology.orchestra.run.trial086.stderr:==45536==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:16:55.152 INFO:teuthology.orchestra.run.trial086.stdout:_ 2026-02-26T03:16:55.152 INFO:teuthology.orchestra.run.trial086.stdout:_key3-1 2026-02-26T03:16:55.152 INFO:teuthology.orchestra.run.trial086.stdout:_key3-2 2026-02-26T03:16:55.152 INFO:teuthology.orchestra.run.trial086.stdout:omap_header 2026-02-26T03:16:55.152 INFO:teuthology.orchestra.run.trial086.stdout:snapset 2026-02-26T03:16:56.664 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:16:56.664 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:16:56.665 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:16:56.665 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:16:56.665 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:16:56.665 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:16:56.698 DEBUG:teuthology.orchestra.run.trial086:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-2 --device-type SSD --pgid 3.2 '{"oid": "REPobject3", "key": "", "snapid": -2, "hash": 1871562002, "max": 0, "pool": 3, "namespace": ""}' get-attr _key3-1 2026-02-26T03:16:56.838 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:56,835 seastar - Reactor backend: linux-aio 2026-02-26T03:16:56.850 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:56,848 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:16:56.851 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:56,848 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:16:56.852 INFO:teuthology.orchestra.run.trial086.stderr:==45567==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:16:58.840 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:16:58.841 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:16:58.841 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:16:58.841 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:16:58.841 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:16:58.841 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:16:58.874 INFO:teuthology.orchestra.run.trial086.stdout:val3-1 2026-02-26T03:16:58.874 DEBUG:teuthology.orchestra.run.trial086:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-2 --device-type SSD --pgid 3.2 '{"oid": "REPobject3", "key": "", "snapid": -2, "hash": 1871562002, "max": 0, "pool": 3, "namespace": ""}' get-attr _key3-2 2026-02-26T03:16:59.021 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:59,019 seastar - Reactor backend: linux-aio 2026-02-26T03:16:59.035 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:59,033 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:16:59.035 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:16:59,033 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:16:59.038 INFO:teuthology.orchestra.run.trial086.stderr:==45598==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:17:01.003 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:17:01.004 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:17:01.004 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:17:01.004 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:17:01.004 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:17:01.004 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:17:01.035 INFO:teuthology.orchestra.run.trial086.stdout:val3-2 2026-02-26T03:17:01.035 DEBUG:teuthology.orchestra.run.trial086:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-3 --device-type SSD --pgid 3.2 '{"oid": "REPobject3", "key": "", "snapid": -2, "hash": 1871562002, "max": 0, "pool": 3, "namespace": ""}' list-attrs 2026-02-26T03:17:01.177 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:01,175 seastar - Reactor backend: linux-aio 2026-02-26T03:17:01.185 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:01,183 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:17:01.186 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:01,183 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:17:01.189 INFO:teuthology.orchestra.run.trial086.stderr:==45629==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:17:01.641 INFO:teuthology.orchestra.run.trial086.stdout:_ 2026-02-26T03:17:01.641 INFO:teuthology.orchestra.run.trial086.stdout:_key3-1 2026-02-26T03:17:01.641 INFO:teuthology.orchestra.run.trial086.stdout:_key3-2 2026-02-26T03:17:01.641 INFO:teuthology.orchestra.run.trial086.stdout:omap_header 2026-02-26T03:17:01.642 INFO:teuthology.orchestra.run.trial086.stdout:snapset 2026-02-26T03:17:03.156 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:17:03.156 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:17:03.156 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:17:03.156 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:17:03.156 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:17:03.156 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:17:03.188 DEBUG:teuthology.orchestra.run.trial086:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-3 --device-type SSD --pgid 3.2 '{"oid": "REPobject3", "key": "", "snapid": -2, "hash": 1871562002, "max": 0, "pool": 3, "namespace": ""}' get-attr _key3-1 2026-02-26T03:17:03.331 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:03,329 seastar - Reactor backend: linux-aio 2026-02-26T03:17:03.341 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:03,339 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:17:03.341 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:03,339 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:17:03.344 INFO:teuthology.orchestra.run.trial086.stderr:==45660==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:17:05.284 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:17:05.285 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:17:05.285 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:17:05.285 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:17:05.285 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:17:05.285 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:17:05.317 INFO:teuthology.orchestra.run.trial086.stdout:val3-1 2026-02-26T03:17:05.318 DEBUG:teuthology.orchestra.run.trial086:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-3 --device-type SSD --pgid 3.2 '{"oid": "REPobject3", "key": "", "snapid": -2, "hash": 1871562002, "max": 0, "pool": 3, "namespace": ""}' get-attr _key3-2 2026-02-26T03:17:05.462 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:05,460 seastar - Reactor backend: linux-aio 2026-02-26T03:17:05.472 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:05,470 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:17:05.473 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:05,470 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:17:05.475 INFO:teuthology.orchestra.run.trial086.stderr:==45691==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:17:07.418 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:17:07.418 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:17:07.418 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:17:07.418 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:17:07.419 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:17:07.419 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:17:07.448 INFO:teuthology.orchestra.run.trial086.stdout:val3-2 2026-02-26T03:17:07.448 DEBUG:teuthology.orchestra.run.trial086:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-0 --device-type SSD --pgid 3.6 '{"oid": "REPobject4", "key": "", "snapid": -2, "hash": 833930126, "max": 0, "pool": 3, "namespace": ""}' list-attrs 2026-02-26T03:17:07.595 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:07,593 seastar - Reactor backend: linux-aio 2026-02-26T03:17:07.606 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:07,604 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:17:07.606 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:07,604 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:17:07.609 INFO:teuthology.orchestra.run.trial086.stderr:==45722==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:17:08.039 INFO:teuthology.orchestra.run.trial086.stdout:_ 2026-02-26T03:17:08.039 INFO:teuthology.orchestra.run.trial086.stdout:_key4-1 2026-02-26T03:17:08.039 INFO:teuthology.orchestra.run.trial086.stdout:_key4-2 2026-02-26T03:17:08.040 INFO:teuthology.orchestra.run.trial086.stdout:_key4-3 2026-02-26T03:17:08.040 INFO:teuthology.orchestra.run.trial086.stdout:omap_header 2026-02-26T03:17:08.040 INFO:teuthology.orchestra.run.trial086.stdout:snapset 2026-02-26T03:17:09.537 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:17:09.538 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:17:09.538 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:17:09.538 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:17:09.538 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:17:09.538 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:17:09.570 DEBUG:teuthology.orchestra.run.trial086:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-0 --device-type SSD --pgid 3.6 '{"oid": "REPobject4", "key": "", "snapid": -2, "hash": 833930126, "max": 0, "pool": 3, "namespace": ""}' get-attr _key4-1 2026-02-26T03:17:09.715 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:09,713 seastar - Reactor backend: linux-aio 2026-02-26T03:17:09.724 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:09,721 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:17:09.724 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:09,721 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:17:09.726 INFO:teuthology.orchestra.run.trial086.stderr:==45753==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:17:11.671 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:17:11.671 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:17:11.671 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:17:11.671 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:17:11.671 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:17:11.671 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:17:11.698 INFO:teuthology.orchestra.run.trial086.stdout:val4-1 2026-02-26T03:17:11.698 DEBUG:teuthology.orchestra.run.trial086:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-0 --device-type SSD --pgid 3.6 '{"oid": "REPobject4", "key": "", "snapid": -2, "hash": 833930126, "max": 0, "pool": 3, "namespace": ""}' get-attr _key4-2 2026-02-26T03:17:11.838 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:11,836 seastar - Reactor backend: linux-aio 2026-02-26T03:17:11.849 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:11,846 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:17:11.849 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:11,846 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:17:11.851 INFO:teuthology.orchestra.run.trial086.stderr:==45784==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:17:13.790 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:17:13.790 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:17:13.790 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:17:13.791 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:17:13.791 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:17:13.791 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:17:13.821 INFO:teuthology.orchestra.run.trial086.stdout:val4-2 2026-02-26T03:17:13.822 DEBUG:teuthology.orchestra.run.trial086:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-0 --device-type SSD --pgid 3.6 '{"oid": "REPobject4", "key": "", "snapid": -2, "hash": 833930126, "max": 0, "pool": 3, "namespace": ""}' get-attr _key4-3 2026-02-26T03:17:13.962 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:13,960 seastar - Reactor backend: linux-aio 2026-02-26T03:17:13.973 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:13,971 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:17:13.974 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:13,971 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:17:13.976 INFO:teuthology.orchestra.run.trial086.stderr:==45815==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:17:15.842 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:17:15.843 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:17:15.843 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:17:15.843 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:17:15.843 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:17:15.843 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:17:15.873 INFO:teuthology.orchestra.run.trial086.stdout:val4-3 2026-02-26T03:17:15.874 DEBUG:teuthology.orchestra.run.trial086:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-1 --device-type SSD --pgid 3.6 '{"oid": "REPobject4", "key": "", "snapid": -2, "hash": 833930126, "max": 0, "pool": 3, "namespace": ""}' list-attrs 2026-02-26T03:17:16.017 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:16,015 seastar - Reactor backend: linux-aio 2026-02-26T03:17:16.028 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:16,026 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:17:16.029 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:16,026 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:17:16.031 INFO:teuthology.orchestra.run.trial086.stderr:==45846==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:17:16.498 INFO:teuthology.orchestra.run.trial086.stdout:_ 2026-02-26T03:17:16.498 INFO:teuthology.orchestra.run.trial086.stdout:_key4-1 2026-02-26T03:17:16.498 INFO:teuthology.orchestra.run.trial086.stdout:_key4-2 2026-02-26T03:17:16.498 INFO:teuthology.orchestra.run.trial086.stdout:_key4-3 2026-02-26T03:17:16.498 INFO:teuthology.orchestra.run.trial086.stdout:omap_header 2026-02-26T03:17:16.499 INFO:teuthology.orchestra.run.trial086.stdout:snapset 2026-02-26T03:17:18.009 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:17:18.010 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:17:18.010 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:17:18.010 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:17:18.010 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:17:18.010 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:17:18.042 DEBUG:teuthology.orchestra.run.trial086:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-1 --device-type SSD --pgid 3.6 '{"oid": "REPobject4", "key": "", "snapid": -2, "hash": 833930126, "max": 0, "pool": 3, "namespace": ""}' get-attr _key4-1 2026-02-26T03:17:18.186 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:18,184 seastar - Reactor backend: linux-aio 2026-02-26T03:17:18.193 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:18,191 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:17:18.193 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:18,191 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:17:18.196 INFO:teuthology.orchestra.run.trial086.stderr:==45877==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:17:20.206 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:17:20.207 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:17:20.207 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:17:20.207 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:17:20.207 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:17:20.207 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:17:20.240 INFO:teuthology.orchestra.run.trial086.stdout:val4-1 2026-02-26T03:17:20.240 DEBUG:teuthology.orchestra.run.trial086:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-1 --device-type SSD --pgid 3.6 '{"oid": "REPobject4", "key": "", "snapid": -2, "hash": 833930126, "max": 0, "pool": 3, "namespace": ""}' get-attr _key4-2 2026-02-26T03:17:20.383 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:20,380 seastar - Reactor backend: linux-aio 2026-02-26T03:17:20.396 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:20,394 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:17:20.396 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:20,394 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:17:20.399 INFO:teuthology.orchestra.run.trial086.stderr:==45908==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:17:22.343 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:17:22.344 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:17:22.344 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:17:22.344 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:17:22.344 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:17:22.344 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:17:22.376 INFO:teuthology.orchestra.run.trial086.stdout:val4-2 2026-02-26T03:17:22.376 DEBUG:teuthology.orchestra.run.trial086:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-1 --device-type SSD --pgid 3.6 '{"oid": "REPobject4", "key": "", "snapid": -2, "hash": 833930126, "max": 0, "pool": 3, "namespace": ""}' get-attr _key4-3 2026-02-26T03:17:22.521 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:22,519 seastar - Reactor backend: linux-aio 2026-02-26T03:17:22.528 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:22,526 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:17:22.529 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:22,526 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:17:22.531 INFO:teuthology.orchestra.run.trial086.stderr:==45939==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:17:24.492 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:17:24.493 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:17:24.493 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:17:24.493 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:17:24.493 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:17:24.493 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:17:24.523 INFO:teuthology.orchestra.run.trial086.stdout:val4-3 2026-02-26T03:17:24.523 INFO:tasks.ceph_objectstore_tool:Test pg info 2026-02-26T03:17:24.524 DEBUG:teuthology.orchestra.run.trial086:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-0 --device-type SSD --op info --pgid 3.1 2026-02-26T03:17:24.666 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:24,663 seastar - Reactor backend: linux-aio 2026-02-26T03:17:24.676 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:24,674 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:17:24.676 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:24,674 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:17:24.679 INFO:teuthology.orchestra.run.trial086.stderr:==45970==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:17:25.101 INFO:teuthology.orchestra.run.trial086.stdout:object name is empty, use pgmeta oid 2026-02-26T03:17:25.102 INFO:teuthology.orchestra.run.trial086.stdout:{ 2026-02-26T03:17:25.102 INFO:teuthology.orchestra.run.trial086.stdout: "pgid": "3.1", 2026-02-26T03:17:25.102 INFO:teuthology.orchestra.run.trial086.stdout: "shard": "255", 2026-02-26T03:17:25.102 INFO:teuthology.orchestra.run.trial086.stdout: "last_update": "0'0", 2026-02-26T03:17:25.102 INFO:teuthology.orchestra.run.trial086.stdout: "last_complete": "0'0", 2026-02-26T03:17:25.102 INFO:teuthology.orchestra.run.trial086.stdout: "log_tail": "0'0", 2026-02-26T03:17:25.102 INFO:teuthology.orchestra.run.trial086.stdout: "last_user_version": 0, 2026-02-26T03:17:25.102 INFO:teuthology.orchestra.run.trial086.stdout: "last_backfill": "MAX", 2026-02-26T03:17:25.102 INFO:teuthology.orchestra.run.trial086.stdout: "partial_writes_last_complete": [], 2026-02-26T03:17:25.102 INFO:teuthology.orchestra.run.trial086.stdout: "partial_writes_last_complete_epoch": "0", 2026-02-26T03:17:25.102 INFO:teuthology.orchestra.run.trial086.stdout: "purged_snaps": [], 2026-02-26T03:17:25.102 INFO:teuthology.orchestra.run.trial086.stdout: "history": { 2026-02-26T03:17:25.102 INFO:teuthology.orchestra.run.trial086.stdout: "epoch_created": 0, 2026-02-26T03:17:25.102 INFO:teuthology.orchestra.run.trial086.stdout: "epoch_pool_created": 0, 2026-02-26T03:17:25.102 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_started": 0, 2026-02-26T03:17:25.102 INFO:teuthology.orchestra.run.trial086.stdout: "last_interval_started": 0, 2026-02-26T03:17:25.102 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_clean": 0, 2026-02-26T03:17:25.102 INFO:teuthology.orchestra.run.trial086.stdout: "last_interval_clean": 0, 2026-02-26T03:17:25.102 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_split": 0, 2026-02-26T03:17:25.102 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_marked_full": 0, 2026-02-26T03:17:25.102 INFO:teuthology.orchestra.run.trial086.stdout: "same_up_since": 0, 2026-02-26T03:17:25.102 INFO:teuthology.orchestra.run.trial086.stdout: "same_interval_since": 0, 2026-02-26T03:17:25.102 INFO:teuthology.orchestra.run.trial086.stdout: "same_primary_since": 0, 2026-02-26T03:17:25.102 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub": "0'0", 2026-02-26T03:17:25.102 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub_stamp": "0.000000", 2026-02-26T03:17:25.102 INFO:teuthology.orchestra.run.trial086.stdout: "last_deep_scrub": "0'0", 2026-02-26T03:17:25.102 INFO:teuthology.orchestra.run.trial086.stdout: "last_deep_scrub_stamp": "0.000000", 2026-02-26T03:17:25.103 INFO:teuthology.orchestra.run.trial086.stdout: "last_clean_scrub_stamp": "0.000000", 2026-02-26T03:17:25.103 INFO:teuthology.orchestra.run.trial086.stdout: "prior_readable_until_ub": 0 2026-02-26T03:17:25.103 INFO:teuthology.orchestra.run.trial086.stdout: }, 2026-02-26T03:17:25.103 INFO:teuthology.orchestra.run.trial086.stdout: "stats": { 2026-02-26T03:17:25.103 INFO:teuthology.orchestra.run.trial086.stdout: "version": "0'0", 2026-02-26T03:17:25.103 INFO:teuthology.orchestra.run.trial086.stdout: "reported_seq": 0, 2026-02-26T03:17:25.103 INFO:teuthology.orchestra.run.trial086.stdout: "reported_epoch": 0, 2026-02-26T03:17:25.103 INFO:teuthology.orchestra.run.trial086.stdout: "state": "unknown", 2026-02-26T03:17:25.103 INFO:teuthology.orchestra.run.trial086.stdout: "last_fresh": "0.000000", 2026-02-26T03:17:25.103 INFO:teuthology.orchestra.run.trial086.stdout: "last_change": "0.000000", 2026-02-26T03:17:25.103 INFO:teuthology.orchestra.run.trial086.stdout: "last_active": "0.000000", 2026-02-26T03:17:25.103 INFO:teuthology.orchestra.run.trial086.stdout: "last_peered": "0.000000", 2026-02-26T03:17:25.103 INFO:teuthology.orchestra.run.trial086.stdout: "last_clean": "0.000000", 2026-02-26T03:17:25.103 INFO:teuthology.orchestra.run.trial086.stdout: "last_became_active": "0.000000", 2026-02-26T03:17:25.103 INFO:teuthology.orchestra.run.trial086.stdout: "last_became_peered": "0.000000", 2026-02-26T03:17:25.103 INFO:teuthology.orchestra.run.trial086.stdout: "last_unstale": "0.000000", 2026-02-26T03:17:25.103 INFO:teuthology.orchestra.run.trial086.stdout: "last_undegraded": "0.000000", 2026-02-26T03:17:25.103 INFO:teuthology.orchestra.run.trial086.stdout: "last_fullsized": "0.000000", 2026-02-26T03:17:25.103 INFO:teuthology.orchestra.run.trial086.stdout: "mapping_epoch": 0, 2026-02-26T03:17:25.103 INFO:teuthology.orchestra.run.trial086.stdout: "log_start": "0'0", 2026-02-26T03:17:25.103 INFO:teuthology.orchestra.run.trial086.stdout: "ondisk_log_start": "0'0", 2026-02-26T03:17:25.103 INFO:teuthology.orchestra.run.trial086.stdout: "created": 0, 2026-02-26T03:17:25.103 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_clean": 0, 2026-02-26T03:17:25.103 INFO:teuthology.orchestra.run.trial086.stdout: "parent": "0.0", 2026-02-26T03:17:25.103 INFO:teuthology.orchestra.run.trial086.stdout: "parent_split_bits": 0, 2026-02-26T03:17:25.103 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub": "0'0", 2026-02-26T03:17:25.103 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub_stamp": "0.000000", 2026-02-26T03:17:25.103 INFO:teuthology.orchestra.run.trial086.stdout: "last_deep_scrub": "0'0", 2026-02-26T03:17:25.103 INFO:teuthology.orchestra.run.trial086.stdout: "last_deep_scrub_stamp": "0.000000", 2026-02-26T03:17:25.103 INFO:teuthology.orchestra.run.trial086.stdout: "last_clean_scrub_stamp": "0.000000", 2026-02-26T03:17:25.103 INFO:teuthology.orchestra.run.trial086.stdout: "objects_scrubbed": 0, 2026-02-26T03:17:25.103 INFO:teuthology.orchestra.run.trial086.stdout: "log_size": 0, 2026-02-26T03:17:25.104 INFO:teuthology.orchestra.run.trial086.stdout: "log_dups_size": 0, 2026-02-26T03:17:25.104 INFO:teuthology.orchestra.run.trial086.stdout: "ondisk_log_size": 0, 2026-02-26T03:17:25.104 INFO:teuthology.orchestra.run.trial086.stdout: "stats_invalid": false, 2026-02-26T03:17:25.104 INFO:teuthology.orchestra.run.trial086.stdout: "dirty_stats_invalid": false, 2026-02-26T03:17:25.104 INFO:teuthology.orchestra.run.trial086.stdout: "omap_stats_invalid": false, 2026-02-26T03:17:25.104 INFO:teuthology.orchestra.run.trial086.stdout: "hitset_stats_invalid": false, 2026-02-26T03:17:25.104 INFO:teuthology.orchestra.run.trial086.stdout: "hitset_bytes_stats_invalid": false, 2026-02-26T03:17:25.104 INFO:teuthology.orchestra.run.trial086.stdout: "pin_stats_invalid": false, 2026-02-26T03:17:25.104 INFO:teuthology.orchestra.run.trial086.stdout: "manifest_stats_invalid": false, 2026-02-26T03:17:25.104 INFO:teuthology.orchestra.run.trial086.stdout: "snaptrimq_len": 0, 2026-02-26T03:17:25.104 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub_duration": 0, 2026-02-26T03:17:25.104 INFO:teuthology.orchestra.run.trial086.stdout: "scrub_schedule": "--", 2026-02-26T03:17:25.104 INFO:teuthology.orchestra.run.trial086.stdout: "scrub_duration": 0, 2026-02-26T03:17:25.104 INFO:teuthology.orchestra.run.trial086.stdout: "objects_trimmed": 0, 2026-02-26T03:17:25.104 INFO:teuthology.orchestra.run.trial086.stdout: "snaptrim_duration": 0, 2026-02-26T03:17:25.104 INFO:teuthology.orchestra.run.trial086.stdout: "stat_sum": { 2026-02-26T03:17:25.104 INFO:teuthology.orchestra.run.trial086.stdout: "num_bytes": 0, 2026-02-26T03:17:25.104 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects": 0, 2026-02-26T03:17:25.104 INFO:teuthology.orchestra.run.trial086.stdout: "num_object_clones": 0, 2026-02-26T03:17:25.104 INFO:teuthology.orchestra.run.trial086.stdout: "num_object_copies": 0, 2026-02-26T03:17:25.104 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_missing_on_primary": 0, 2026-02-26T03:17:25.104 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_missing": 0, 2026-02-26T03:17:25.104 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_degraded": 0, 2026-02-26T03:17:25.104 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_misplaced": 0, 2026-02-26T03:17:25.104 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_unfound": 0, 2026-02-26T03:17:25.104 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_dirty": 0, 2026-02-26T03:17:25.104 INFO:teuthology.orchestra.run.trial086.stdout: "num_whiteouts": 0, 2026-02-26T03:17:25.104 INFO:teuthology.orchestra.run.trial086.stdout: "num_read": 0, 2026-02-26T03:17:25.104 INFO:teuthology.orchestra.run.trial086.stdout: "num_read_kb": 0, 2026-02-26T03:17:25.104 INFO:teuthology.orchestra.run.trial086.stdout: "num_write": 0, 2026-02-26T03:17:25.104 INFO:teuthology.orchestra.run.trial086.stdout: "num_write_kb": 0, 2026-02-26T03:17:25.104 INFO:teuthology.orchestra.run.trial086.stdout: "num_scrub_errors": 0, 2026-02-26T03:17:25.104 INFO:teuthology.orchestra.run.trial086.stdout: "num_shallow_scrub_errors": 0, 2026-02-26T03:17:25.105 INFO:teuthology.orchestra.run.trial086.stdout: "num_deep_scrub_errors": 0, 2026-02-26T03:17:25.105 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_recovered": 0, 2026-02-26T03:17:25.105 INFO:teuthology.orchestra.run.trial086.stdout: "num_bytes_recovered": 0, 2026-02-26T03:17:25.105 INFO:teuthology.orchestra.run.trial086.stdout: "num_keys_recovered": 0, 2026-02-26T03:17:25.105 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_omap": 0, 2026-02-26T03:17:25.105 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_hit_set_archive": 0, 2026-02-26T03:17:25.105 INFO:teuthology.orchestra.run.trial086.stdout: "num_bytes_hit_set_archive": 0, 2026-02-26T03:17:25.105 INFO:teuthology.orchestra.run.trial086.stdout: "num_flush": 0, 2026-02-26T03:17:25.105 INFO:teuthology.orchestra.run.trial086.stdout: "num_flush_kb": 0, 2026-02-26T03:17:25.105 INFO:teuthology.orchestra.run.trial086.stdout: "num_evict": 0, 2026-02-26T03:17:25.105 INFO:teuthology.orchestra.run.trial086.stdout: "num_evict_kb": 0, 2026-02-26T03:17:25.105 INFO:teuthology.orchestra.run.trial086.stdout: "num_promote": 0, 2026-02-26T03:17:25.105 INFO:teuthology.orchestra.run.trial086.stdout: "num_flush_mode_high": 0, 2026-02-26T03:17:25.105 INFO:teuthology.orchestra.run.trial086.stdout: "num_flush_mode_low": 0, 2026-02-26T03:17:25.105 INFO:teuthology.orchestra.run.trial086.stdout: "num_evict_mode_some": 0, 2026-02-26T03:17:25.105 INFO:teuthology.orchestra.run.trial086.stdout: "num_evict_mode_full": 0, 2026-02-26T03:17:25.105 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_pinned": 0, 2026-02-26T03:17:25.105 INFO:teuthology.orchestra.run.trial086.stdout: "num_legacy_snapsets": 0, 2026-02-26T03:17:25.105 INFO:teuthology.orchestra.run.trial086.stdout: "num_large_omap_objects": 0, 2026-02-26T03:17:25.105 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_manifest": 0, 2026-02-26T03:17:25.105 INFO:teuthology.orchestra.run.trial086.stdout: "num_omap_bytes": 0, 2026-02-26T03:17:25.105 INFO:teuthology.orchestra.run.trial086.stdout: "num_omap_keys": 0, 2026-02-26T03:17:25.105 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_repaired": 0 2026-02-26T03:17:25.105 INFO:teuthology.orchestra.run.trial086.stdout: }, 2026-02-26T03:17:25.105 INFO:teuthology.orchestra.run.trial086.stdout: "up": [], 2026-02-26T03:17:25.105 INFO:teuthology.orchestra.run.trial086.stdout: "acting": [], 2026-02-26T03:17:25.105 INFO:teuthology.orchestra.run.trial086.stdout: "avail_no_missing": [], 2026-02-26T03:17:25.105 INFO:teuthology.orchestra.run.trial086.stdout: "object_location_counts": [], 2026-02-26T03:17:25.105 INFO:teuthology.orchestra.run.trial086.stdout: "blocked_by": [], 2026-02-26T03:17:25.105 INFO:teuthology.orchestra.run.trial086.stdout: "up_primary": -1, 2026-02-26T03:17:25.105 INFO:teuthology.orchestra.run.trial086.stdout: "acting_primary": -1, 2026-02-26T03:17:25.105 INFO:teuthology.orchestra.run.trial086.stdout: "purged_snaps": [] 2026-02-26T03:17:25.105 INFO:teuthology.orchestra.run.trial086.stdout: }, 2026-02-26T03:17:25.105 INFO:teuthology.orchestra.run.trial086.stdout: "empty": 1, 2026-02-26T03:17:25.105 INFO:teuthology.orchestra.run.trial086.stdout: "dne": 1, 2026-02-26T03:17:25.106 INFO:teuthology.orchestra.run.trial086.stdout: "incomplete": 0, 2026-02-26T03:17:25.106 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_started": 0, 2026-02-26T03:17:25.106 INFO:teuthology.orchestra.run.trial086.stdout: "hit_set_history": { 2026-02-26T03:17:25.106 INFO:teuthology.orchestra.run.trial086.stdout: "current_last_update": "0'0", 2026-02-26T03:17:25.106 INFO:teuthology.orchestra.run.trial086.stdout: "history": [] 2026-02-26T03:17:25.106 INFO:teuthology.orchestra.run.trial086.stdout: } 2026-02-26T03:17:25.106 INFO:teuthology.orchestra.run.trial086.stdout:} 2026-02-26T03:17:26.626 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:17:26.626 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:17:26.627 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:17:26.627 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:17:26.627 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:17:26.627 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:17:26.655 DEBUG:teuthology.orchestra.run.trial086:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-0 --device-type SSD --op info --pgid 3.3 2026-02-26T03:17:26.797 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:26,794 seastar - Reactor backend: linux-aio 2026-02-26T03:17:26.808 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:26,806 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:17:26.808 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:26,806 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:17:26.811 INFO:teuthology.orchestra.run.trial086.stderr:==46001==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:17:27.266 INFO:teuthology.orchestra.run.trial086.stdout:object name is empty, use pgmeta oid 2026-02-26T03:17:27.266 INFO:teuthology.orchestra.run.trial086.stdout:{ 2026-02-26T03:17:27.266 INFO:teuthology.orchestra.run.trial086.stdout: "pgid": "3.3", 2026-02-26T03:17:27.266 INFO:teuthology.orchestra.run.trial086.stdout: "shard": "255", 2026-02-26T03:17:27.266 INFO:teuthology.orchestra.run.trial086.stdout: "last_update": "0'0", 2026-02-26T03:17:27.267 INFO:teuthology.orchestra.run.trial086.stdout: "last_complete": "0'0", 2026-02-26T03:17:27.267 INFO:teuthology.orchestra.run.trial086.stdout: "log_tail": "0'0", 2026-02-26T03:17:27.267 INFO:teuthology.orchestra.run.trial086.stdout: "last_user_version": 0, 2026-02-26T03:17:27.267 INFO:teuthology.orchestra.run.trial086.stdout: "last_backfill": "MAX", 2026-02-26T03:17:27.267 INFO:teuthology.orchestra.run.trial086.stdout: "partial_writes_last_complete": [], 2026-02-26T03:17:27.267 INFO:teuthology.orchestra.run.trial086.stdout: "partial_writes_last_complete_epoch": "0", 2026-02-26T03:17:27.267 INFO:teuthology.orchestra.run.trial086.stdout: "purged_snaps": [], 2026-02-26T03:17:27.267 INFO:teuthology.orchestra.run.trial086.stdout: "history": { 2026-02-26T03:17:27.267 INFO:teuthology.orchestra.run.trial086.stdout: "epoch_created": 0, 2026-02-26T03:17:27.267 INFO:teuthology.orchestra.run.trial086.stdout: "epoch_pool_created": 0, 2026-02-26T03:17:27.267 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_started": 0, 2026-02-26T03:17:27.267 INFO:teuthology.orchestra.run.trial086.stdout: "last_interval_started": 0, 2026-02-26T03:17:27.268 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_clean": 0, 2026-02-26T03:17:27.268 INFO:teuthology.orchestra.run.trial086.stdout: "last_interval_clean": 0, 2026-02-26T03:17:27.268 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_split": 0, 2026-02-26T03:17:27.268 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_marked_full": 0, 2026-02-26T03:17:27.268 INFO:teuthology.orchestra.run.trial086.stdout: "same_up_since": 0, 2026-02-26T03:17:27.268 INFO:teuthology.orchestra.run.trial086.stdout: "same_interval_since": 0, 2026-02-26T03:17:27.268 INFO:teuthology.orchestra.run.trial086.stdout: "same_primary_since": 0, 2026-02-26T03:17:27.268 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub": "0'0", 2026-02-26T03:17:27.268 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub_stamp": "0.000000", 2026-02-26T03:17:27.268 INFO:teuthology.orchestra.run.trial086.stdout: "last_deep_scrub": "0'0", 2026-02-26T03:17:27.268 INFO:teuthology.orchestra.run.trial086.stdout: "last_deep_scrub_stamp": "0.000000", 2026-02-26T03:17:27.269 INFO:teuthology.orchestra.run.trial086.stdout: "last_clean_scrub_stamp": "0.000000", 2026-02-26T03:17:27.269 INFO:teuthology.orchestra.run.trial086.stdout: "prior_readable_until_ub": 0 2026-02-26T03:17:27.269 INFO:teuthology.orchestra.run.trial086.stdout: }, 2026-02-26T03:17:27.269 INFO:teuthology.orchestra.run.trial086.stdout: "stats": { 2026-02-26T03:17:27.269 INFO:teuthology.orchestra.run.trial086.stdout: "version": "0'0", 2026-02-26T03:17:27.269 INFO:teuthology.orchestra.run.trial086.stdout: "reported_seq": 0, 2026-02-26T03:17:27.269 INFO:teuthology.orchestra.run.trial086.stdout: "reported_epoch": 0, 2026-02-26T03:17:27.269 INFO:teuthology.orchestra.run.trial086.stdout: "state": "unknown", 2026-02-26T03:17:27.269 INFO:teuthology.orchestra.run.trial086.stdout: "last_fresh": "0.000000", 2026-02-26T03:17:27.269 INFO:teuthology.orchestra.run.trial086.stdout: "last_change": "0.000000", 2026-02-26T03:17:27.269 INFO:teuthology.orchestra.run.trial086.stdout: "last_active": "0.000000", 2026-02-26T03:17:27.269 INFO:teuthology.orchestra.run.trial086.stdout: "last_peered": "0.000000", 2026-02-26T03:17:27.270 INFO:teuthology.orchestra.run.trial086.stdout: "last_clean": "0.000000", 2026-02-26T03:17:27.270 INFO:teuthology.orchestra.run.trial086.stdout: "last_became_active": "0.000000", 2026-02-26T03:17:27.270 INFO:teuthology.orchestra.run.trial086.stdout: "last_became_peered": "0.000000", 2026-02-26T03:17:27.270 INFO:teuthology.orchestra.run.trial086.stdout: "last_unstale": "0.000000", 2026-02-26T03:17:27.270 INFO:teuthology.orchestra.run.trial086.stdout: "last_undegraded": "0.000000", 2026-02-26T03:17:27.270 INFO:teuthology.orchestra.run.trial086.stdout: "last_fullsized": "0.000000", 2026-02-26T03:17:27.270 INFO:teuthology.orchestra.run.trial086.stdout: "mapping_epoch": 0, 2026-02-26T03:17:27.270 INFO:teuthology.orchestra.run.trial086.stdout: "log_start": "0'0", 2026-02-26T03:17:27.270 INFO:teuthology.orchestra.run.trial086.stdout: "ondisk_log_start": "0'0", 2026-02-26T03:17:27.270 INFO:teuthology.orchestra.run.trial086.stdout: "created": 0, 2026-02-26T03:17:27.270 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_clean": 0, 2026-02-26T03:17:27.270 INFO:teuthology.orchestra.run.trial086.stdout: "parent": "0.0", 2026-02-26T03:17:27.271 INFO:teuthology.orchestra.run.trial086.stdout: "parent_split_bits": 0, 2026-02-26T03:17:27.271 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub": "0'0", 2026-02-26T03:17:27.271 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub_stamp": "0.000000", 2026-02-26T03:17:27.271 INFO:teuthology.orchestra.run.trial086.stdout: "last_deep_scrub": "0'0", 2026-02-26T03:17:27.271 INFO:teuthology.orchestra.run.trial086.stdout: "last_deep_scrub_stamp": "0.000000", 2026-02-26T03:17:27.271 INFO:teuthology.orchestra.run.trial086.stdout: "last_clean_scrub_stamp": "0.000000", 2026-02-26T03:17:27.271 INFO:teuthology.orchestra.run.trial086.stdout: "objects_scrubbed": 0, 2026-02-26T03:17:27.271 INFO:teuthology.orchestra.run.trial086.stdout: "log_size": 0, 2026-02-26T03:17:27.271 INFO:teuthology.orchestra.run.trial086.stdout: "log_dups_size": 0, 2026-02-26T03:17:27.271 INFO:teuthology.orchestra.run.trial086.stdout: "ondisk_log_size": 0, 2026-02-26T03:17:27.271 INFO:teuthology.orchestra.run.trial086.stdout: "stats_invalid": false, 2026-02-26T03:17:27.271 INFO:teuthology.orchestra.run.trial086.stdout: "dirty_stats_invalid": false, 2026-02-26T03:17:27.271 INFO:teuthology.orchestra.run.trial086.stdout: "omap_stats_invalid": false, 2026-02-26T03:17:27.272 INFO:teuthology.orchestra.run.trial086.stdout: "hitset_stats_invalid": false, 2026-02-26T03:17:27.272 INFO:teuthology.orchestra.run.trial086.stdout: "hitset_bytes_stats_invalid": false, 2026-02-26T03:17:27.272 INFO:teuthology.orchestra.run.trial086.stdout: "pin_stats_invalid": false, 2026-02-26T03:17:27.272 INFO:teuthology.orchestra.run.trial086.stdout: "manifest_stats_invalid": false, 2026-02-26T03:17:27.272 INFO:teuthology.orchestra.run.trial086.stdout: "snaptrimq_len": 0, 2026-02-26T03:17:27.272 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub_duration": 0, 2026-02-26T03:17:27.272 INFO:teuthology.orchestra.run.trial086.stdout: "scrub_schedule": "--", 2026-02-26T03:17:27.272 INFO:teuthology.orchestra.run.trial086.stdout: "scrub_duration": 0, 2026-02-26T03:17:27.272 INFO:teuthology.orchestra.run.trial086.stdout: "objects_trimmed": 0, 2026-02-26T03:17:27.272 INFO:teuthology.orchestra.run.trial086.stdout: "snaptrim_duration": 0, 2026-02-26T03:17:27.272 INFO:teuthology.orchestra.run.trial086.stdout: "stat_sum": { 2026-02-26T03:17:27.272 INFO:teuthology.orchestra.run.trial086.stdout: "num_bytes": 0, 2026-02-26T03:17:27.273 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects": 0, 2026-02-26T03:17:27.273 INFO:teuthology.orchestra.run.trial086.stdout: "num_object_clones": 0, 2026-02-26T03:17:27.273 INFO:teuthology.orchestra.run.trial086.stdout: "num_object_copies": 0, 2026-02-26T03:17:27.273 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_missing_on_primary": 0, 2026-02-26T03:17:27.273 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_missing": 0, 2026-02-26T03:17:27.273 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_degraded": 0, 2026-02-26T03:17:27.273 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_misplaced": 0, 2026-02-26T03:17:27.273 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_unfound": 0, 2026-02-26T03:17:27.273 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_dirty": 0, 2026-02-26T03:17:27.273 INFO:teuthology.orchestra.run.trial086.stdout: "num_whiteouts": 0, 2026-02-26T03:17:27.274 INFO:teuthology.orchestra.run.trial086.stdout: "num_read": 0, 2026-02-26T03:17:27.274 INFO:teuthology.orchestra.run.trial086.stdout: "num_read_kb": 0, 2026-02-26T03:17:27.274 INFO:teuthology.orchestra.run.trial086.stdout: "num_write": 0, 2026-02-26T03:17:27.274 INFO:teuthology.orchestra.run.trial086.stdout: "num_write_kb": 0, 2026-02-26T03:17:27.274 INFO:teuthology.orchestra.run.trial086.stdout: "num_scrub_errors": 0, 2026-02-26T03:17:27.274 INFO:teuthology.orchestra.run.trial086.stdout: "num_shallow_scrub_errors": 0, 2026-02-26T03:17:27.274 INFO:teuthology.orchestra.run.trial086.stdout: "num_deep_scrub_errors": 0, 2026-02-26T03:17:27.274 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_recovered": 0, 2026-02-26T03:17:27.274 INFO:teuthology.orchestra.run.trial086.stdout: "num_bytes_recovered": 0, 2026-02-26T03:17:27.274 INFO:teuthology.orchestra.run.trial086.stdout: "num_keys_recovered": 0, 2026-02-26T03:17:27.274 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_omap": 0, 2026-02-26T03:17:27.274 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_hit_set_archive": 0, 2026-02-26T03:17:27.275 INFO:teuthology.orchestra.run.trial086.stdout: "num_bytes_hit_set_archive": 0, 2026-02-26T03:17:27.275 INFO:teuthology.orchestra.run.trial086.stdout: "num_flush": 0, 2026-02-26T03:17:27.275 INFO:teuthology.orchestra.run.trial086.stdout: "num_flush_kb": 0, 2026-02-26T03:17:27.275 INFO:teuthology.orchestra.run.trial086.stdout: "num_evict": 0, 2026-02-26T03:17:27.275 INFO:teuthology.orchestra.run.trial086.stdout: "num_evict_kb": 0, 2026-02-26T03:17:27.275 INFO:teuthology.orchestra.run.trial086.stdout: "num_promote": 0, 2026-02-26T03:17:27.275 INFO:teuthology.orchestra.run.trial086.stdout: "num_flush_mode_high": 0, 2026-02-26T03:17:27.275 INFO:teuthology.orchestra.run.trial086.stdout: "num_flush_mode_low": 0, 2026-02-26T03:17:27.275 INFO:teuthology.orchestra.run.trial086.stdout: "num_evict_mode_some": 0, 2026-02-26T03:17:27.275 INFO:teuthology.orchestra.run.trial086.stdout: "num_evict_mode_full": 0, 2026-02-26T03:17:27.275 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_pinned": 0, 2026-02-26T03:17:27.275 INFO:teuthology.orchestra.run.trial086.stdout: "num_legacy_snapsets": 0, 2026-02-26T03:17:27.275 INFO:teuthology.orchestra.run.trial086.stdout: "num_large_omap_objects": 0, 2026-02-26T03:17:27.276 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_manifest": 0, 2026-02-26T03:17:27.276 INFO:teuthology.orchestra.run.trial086.stdout: "num_omap_bytes": 0, 2026-02-26T03:17:27.276 INFO:teuthology.orchestra.run.trial086.stdout: "num_omap_keys": 0, 2026-02-26T03:17:27.276 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_repaired": 0 2026-02-26T03:17:27.276 INFO:teuthology.orchestra.run.trial086.stdout: }, 2026-02-26T03:17:27.276 INFO:teuthology.orchestra.run.trial086.stdout: "up": [], 2026-02-26T03:17:27.276 INFO:teuthology.orchestra.run.trial086.stdout: "acting": [], 2026-02-26T03:17:27.276 INFO:teuthology.orchestra.run.trial086.stdout: "avail_no_missing": [], 2026-02-26T03:17:27.276 INFO:teuthology.orchestra.run.trial086.stdout: "object_location_counts": [], 2026-02-26T03:17:27.276 INFO:teuthology.orchestra.run.trial086.stdout: "blocked_by": [], 2026-02-26T03:17:27.276 INFO:teuthology.orchestra.run.trial086.stdout: "up_primary": -1, 2026-02-26T03:17:27.276 INFO:teuthology.orchestra.run.trial086.stdout: "acting_primary": -1, 2026-02-26T03:17:27.276 INFO:teuthology.orchestra.run.trial086.stdout: "purged_snaps": [] 2026-02-26T03:17:27.277 INFO:teuthology.orchestra.run.trial086.stdout: }, 2026-02-26T03:17:27.277 INFO:teuthology.orchestra.run.trial086.stdout: "empty": 1, 2026-02-26T03:17:27.277 INFO:teuthology.orchestra.run.trial086.stdout: "dne": 1, 2026-02-26T03:17:27.277 INFO:teuthology.orchestra.run.trial086.stdout: "incomplete": 0, 2026-02-26T03:17:27.277 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_started": 0, 2026-02-26T03:17:27.277 INFO:teuthology.orchestra.run.trial086.stdout: "hit_set_history": { 2026-02-26T03:17:27.277 INFO:teuthology.orchestra.run.trial086.stdout: "current_last_update": "0'0", 2026-02-26T03:17:27.277 INFO:teuthology.orchestra.run.trial086.stdout: "history": [] 2026-02-26T03:17:27.277 INFO:teuthology.orchestra.run.trial086.stdout: } 2026-02-26T03:17:27.277 INFO:teuthology.orchestra.run.trial086.stdout:} 2026-02-26T03:17:28.771 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:17:28.771 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:17:28.772 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:17:28.772 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:17:28.772 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:17:28.772 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:17:28.803 DEBUG:teuthology.orchestra.run.trial086:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-0 --device-type SSD --op info --pgid 3.6 2026-02-26T03:17:28.950 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:28,948 seastar - Reactor backend: linux-aio 2026-02-26T03:17:28.958 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:28,956 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:17:28.959 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:28,956 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:17:28.961 INFO:teuthology.orchestra.run.trial086.stderr:==46032==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:17:29.412 INFO:teuthology.orchestra.run.trial086.stdout:object name is empty, use pgmeta oid 2026-02-26T03:17:29.412 INFO:teuthology.orchestra.run.trial086.stdout:{ 2026-02-26T03:17:29.412 INFO:teuthology.orchestra.run.trial086.stdout: "pgid": "3.6", 2026-02-26T03:17:29.412 INFO:teuthology.orchestra.run.trial086.stdout: "shard": "255", 2026-02-26T03:17:29.413 INFO:teuthology.orchestra.run.trial086.stdout: "last_update": "0'0", 2026-02-26T03:17:29.413 INFO:teuthology.orchestra.run.trial086.stdout: "last_complete": "0'0", 2026-02-26T03:17:29.413 INFO:teuthology.orchestra.run.trial086.stdout: "log_tail": "0'0", 2026-02-26T03:17:29.413 INFO:teuthology.orchestra.run.trial086.stdout: "last_user_version": 0, 2026-02-26T03:17:29.413 INFO:teuthology.orchestra.run.trial086.stdout: "last_backfill": "MAX", 2026-02-26T03:17:29.413 INFO:teuthology.orchestra.run.trial086.stdout: "partial_writes_last_complete": [], 2026-02-26T03:17:29.413 INFO:teuthology.orchestra.run.trial086.stdout: "partial_writes_last_complete_epoch": "0", 2026-02-26T03:17:29.413 INFO:teuthology.orchestra.run.trial086.stdout: "purged_snaps": [], 2026-02-26T03:17:29.413 INFO:teuthology.orchestra.run.trial086.stdout: "history": { 2026-02-26T03:17:29.413 INFO:teuthology.orchestra.run.trial086.stdout: "epoch_created": 0, 2026-02-26T03:17:29.413 INFO:teuthology.orchestra.run.trial086.stdout: "epoch_pool_created": 0, 2026-02-26T03:17:29.413 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_started": 0, 2026-02-26T03:17:29.413 INFO:teuthology.orchestra.run.trial086.stdout: "last_interval_started": 0, 2026-02-26T03:17:29.413 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_clean": 0, 2026-02-26T03:17:29.413 INFO:teuthology.orchestra.run.trial086.stdout: "last_interval_clean": 0, 2026-02-26T03:17:29.413 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_split": 0, 2026-02-26T03:17:29.413 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_marked_full": 0, 2026-02-26T03:17:29.413 INFO:teuthology.orchestra.run.trial086.stdout: "same_up_since": 0, 2026-02-26T03:17:29.413 INFO:teuthology.orchestra.run.trial086.stdout: "same_interval_since": 0, 2026-02-26T03:17:29.413 INFO:teuthology.orchestra.run.trial086.stdout: "same_primary_since": 0, 2026-02-26T03:17:29.413 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub": "0'0", 2026-02-26T03:17:29.413 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub_stamp": "0.000000", 2026-02-26T03:17:29.413 INFO:teuthology.orchestra.run.trial086.stdout: "last_deep_scrub": "0'0", 2026-02-26T03:17:29.413 INFO:teuthology.orchestra.run.trial086.stdout: "last_deep_scrub_stamp": "0.000000", 2026-02-26T03:17:29.413 INFO:teuthology.orchestra.run.trial086.stdout: "last_clean_scrub_stamp": "0.000000", 2026-02-26T03:17:29.413 INFO:teuthology.orchestra.run.trial086.stdout: "prior_readable_until_ub": 0 2026-02-26T03:17:29.414 INFO:teuthology.orchestra.run.trial086.stdout: }, 2026-02-26T03:17:29.414 INFO:teuthology.orchestra.run.trial086.stdout: "stats": { 2026-02-26T03:17:29.414 INFO:teuthology.orchestra.run.trial086.stdout: "version": "0'0", 2026-02-26T03:17:29.414 INFO:teuthology.orchestra.run.trial086.stdout: "reported_seq": 0, 2026-02-26T03:17:29.414 INFO:teuthology.orchestra.run.trial086.stdout: "reported_epoch": 0, 2026-02-26T03:17:29.414 INFO:teuthology.orchestra.run.trial086.stdout: "state": "unknown", 2026-02-26T03:17:29.414 INFO:teuthology.orchestra.run.trial086.stdout: "last_fresh": "0.000000", 2026-02-26T03:17:29.414 INFO:teuthology.orchestra.run.trial086.stdout: "last_change": "0.000000", 2026-02-26T03:17:29.414 INFO:teuthology.orchestra.run.trial086.stdout: "last_active": "0.000000", 2026-02-26T03:17:29.414 INFO:teuthology.orchestra.run.trial086.stdout: "last_peered": "0.000000", 2026-02-26T03:17:29.414 INFO:teuthology.orchestra.run.trial086.stdout: "last_clean": "0.000000", 2026-02-26T03:17:29.414 INFO:teuthology.orchestra.run.trial086.stdout: "last_became_active": "0.000000", 2026-02-26T03:17:29.414 INFO:teuthology.orchestra.run.trial086.stdout: "last_became_peered": "0.000000", 2026-02-26T03:17:29.414 INFO:teuthology.orchestra.run.trial086.stdout: "last_unstale": "0.000000", 2026-02-26T03:17:29.414 INFO:teuthology.orchestra.run.trial086.stdout: "last_undegraded": "0.000000", 2026-02-26T03:17:29.414 INFO:teuthology.orchestra.run.trial086.stdout: "last_fullsized": "0.000000", 2026-02-26T03:17:29.414 INFO:teuthology.orchestra.run.trial086.stdout: "mapping_epoch": 0, 2026-02-26T03:17:29.414 INFO:teuthology.orchestra.run.trial086.stdout: "log_start": "0'0", 2026-02-26T03:17:29.414 INFO:teuthology.orchestra.run.trial086.stdout: "ondisk_log_start": "0'0", 2026-02-26T03:17:29.414 INFO:teuthology.orchestra.run.trial086.stdout: "created": 0, 2026-02-26T03:17:29.414 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_clean": 0, 2026-02-26T03:17:29.414 INFO:teuthology.orchestra.run.trial086.stdout: "parent": "0.0", 2026-02-26T03:17:29.414 INFO:teuthology.orchestra.run.trial086.stdout: "parent_split_bits": 0, 2026-02-26T03:17:29.415 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub": "0'0", 2026-02-26T03:17:29.415 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub_stamp": "0.000000", 2026-02-26T03:17:29.415 INFO:teuthology.orchestra.run.trial086.stdout: "last_deep_scrub": "0'0", 2026-02-26T03:17:29.415 INFO:teuthology.orchestra.run.trial086.stdout: "last_deep_scrub_stamp": "0.000000", 2026-02-26T03:17:29.415 INFO:teuthology.orchestra.run.trial086.stdout: "last_clean_scrub_stamp": "0.000000", 2026-02-26T03:17:29.415 INFO:teuthology.orchestra.run.trial086.stdout: "objects_scrubbed": 0, 2026-02-26T03:17:29.415 INFO:teuthology.orchestra.run.trial086.stdout: "log_size": 0, 2026-02-26T03:17:29.415 INFO:teuthology.orchestra.run.trial086.stdout: "log_dups_size": 0, 2026-02-26T03:17:29.415 INFO:teuthology.orchestra.run.trial086.stdout: "ondisk_log_size": 0, 2026-02-26T03:17:29.415 INFO:teuthology.orchestra.run.trial086.stdout: "stats_invalid": false, 2026-02-26T03:17:29.415 INFO:teuthology.orchestra.run.trial086.stdout: "dirty_stats_invalid": false, 2026-02-26T03:17:29.415 INFO:teuthology.orchestra.run.trial086.stdout: "omap_stats_invalid": false, 2026-02-26T03:17:29.415 INFO:teuthology.orchestra.run.trial086.stdout: "hitset_stats_invalid": false, 2026-02-26T03:17:29.415 INFO:teuthology.orchestra.run.trial086.stdout: "hitset_bytes_stats_invalid": false, 2026-02-26T03:17:29.415 INFO:teuthology.orchestra.run.trial086.stdout: "pin_stats_invalid": false, 2026-02-26T03:17:29.415 INFO:teuthology.orchestra.run.trial086.stdout: "manifest_stats_invalid": false, 2026-02-26T03:17:29.415 INFO:teuthology.orchestra.run.trial086.stdout: "snaptrimq_len": 0, 2026-02-26T03:17:29.415 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub_duration": 0, 2026-02-26T03:17:29.415 INFO:teuthology.orchestra.run.trial086.stdout: "scrub_schedule": "--", 2026-02-26T03:17:29.415 INFO:teuthology.orchestra.run.trial086.stdout: "scrub_duration": 0, 2026-02-26T03:17:29.415 INFO:teuthology.orchestra.run.trial086.stdout: "objects_trimmed": 0, 2026-02-26T03:17:29.415 INFO:teuthology.orchestra.run.trial086.stdout: "snaptrim_duration": 0, 2026-02-26T03:17:29.415 INFO:teuthology.orchestra.run.trial086.stdout: "stat_sum": { 2026-02-26T03:17:29.415 INFO:teuthology.orchestra.run.trial086.stdout: "num_bytes": 0, 2026-02-26T03:17:29.415 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects": 0, 2026-02-26T03:17:29.416 INFO:teuthology.orchestra.run.trial086.stdout: "num_object_clones": 0, 2026-02-26T03:17:29.416 INFO:teuthology.orchestra.run.trial086.stdout: "num_object_copies": 0, 2026-02-26T03:17:29.416 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_missing_on_primary": 0, 2026-02-26T03:17:29.416 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_missing": 0, 2026-02-26T03:17:29.416 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_degraded": 0, 2026-02-26T03:17:29.416 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_misplaced": 0, 2026-02-26T03:17:29.416 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_unfound": 0, 2026-02-26T03:17:29.416 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_dirty": 0, 2026-02-26T03:17:29.416 INFO:teuthology.orchestra.run.trial086.stdout: "num_whiteouts": 0, 2026-02-26T03:17:29.416 INFO:teuthology.orchestra.run.trial086.stdout: "num_read": 0, 2026-02-26T03:17:29.416 INFO:teuthology.orchestra.run.trial086.stdout: "num_read_kb": 0, 2026-02-26T03:17:29.416 INFO:teuthology.orchestra.run.trial086.stdout: "num_write": 0, 2026-02-26T03:17:29.416 INFO:teuthology.orchestra.run.trial086.stdout: "num_write_kb": 0, 2026-02-26T03:17:29.416 INFO:teuthology.orchestra.run.trial086.stdout: "num_scrub_errors": 0, 2026-02-26T03:17:29.416 INFO:teuthology.orchestra.run.trial086.stdout: "num_shallow_scrub_errors": 0, 2026-02-26T03:17:29.416 INFO:teuthology.orchestra.run.trial086.stdout: "num_deep_scrub_errors": 0, 2026-02-26T03:17:29.416 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_recovered": 0, 2026-02-26T03:17:29.416 INFO:teuthology.orchestra.run.trial086.stdout: "num_bytes_recovered": 0, 2026-02-26T03:17:29.416 INFO:teuthology.orchestra.run.trial086.stdout: "num_keys_recovered": 0, 2026-02-26T03:17:29.416 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_omap": 0, 2026-02-26T03:17:29.416 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_hit_set_archive": 0, 2026-02-26T03:17:29.416 INFO:teuthology.orchestra.run.trial086.stdout: "num_bytes_hit_set_archive": 0, 2026-02-26T03:17:29.416 INFO:teuthology.orchestra.run.trial086.stdout: "num_flush": 0, 2026-02-26T03:17:29.416 INFO:teuthology.orchestra.run.trial086.stdout: "num_flush_kb": 0, 2026-02-26T03:17:29.416 INFO:teuthology.orchestra.run.trial086.stdout: "num_evict": 0, 2026-02-26T03:17:29.416 INFO:teuthology.orchestra.run.trial086.stdout: "num_evict_kb": 0, 2026-02-26T03:17:29.417 INFO:teuthology.orchestra.run.trial086.stdout: "num_promote": 0, 2026-02-26T03:17:29.417 INFO:teuthology.orchestra.run.trial086.stdout: "num_flush_mode_high": 0, 2026-02-26T03:17:29.417 INFO:teuthology.orchestra.run.trial086.stdout: "num_flush_mode_low": 0, 2026-02-26T03:17:29.417 INFO:teuthology.orchestra.run.trial086.stdout: "num_evict_mode_some": 0, 2026-02-26T03:17:29.417 INFO:teuthology.orchestra.run.trial086.stdout: "num_evict_mode_full": 0, 2026-02-26T03:17:29.417 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_pinned": 0, 2026-02-26T03:17:29.417 INFO:teuthology.orchestra.run.trial086.stdout: "num_legacy_snapsets": 0, 2026-02-26T03:17:29.417 INFO:teuthology.orchestra.run.trial086.stdout: "num_large_omap_objects": 0, 2026-02-26T03:17:29.417 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_manifest": 0, 2026-02-26T03:17:29.417 INFO:teuthology.orchestra.run.trial086.stdout: "num_omap_bytes": 0, 2026-02-26T03:17:29.417 INFO:teuthology.orchestra.run.trial086.stdout: "num_omap_keys": 0, 2026-02-26T03:17:29.417 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_repaired": 0 2026-02-26T03:17:29.417 INFO:teuthology.orchestra.run.trial086.stdout: }, 2026-02-26T03:17:29.417 INFO:teuthology.orchestra.run.trial086.stdout: "up": [], 2026-02-26T03:17:29.417 INFO:teuthology.orchestra.run.trial086.stdout: "acting": [], 2026-02-26T03:17:29.417 INFO:teuthology.orchestra.run.trial086.stdout: "avail_no_missing": [], 2026-02-26T03:17:29.417 INFO:teuthology.orchestra.run.trial086.stdout: "object_location_counts": [], 2026-02-26T03:17:29.417 INFO:teuthology.orchestra.run.trial086.stdout: "blocked_by": [], 2026-02-26T03:17:29.417 INFO:teuthology.orchestra.run.trial086.stdout: "up_primary": -1, 2026-02-26T03:17:29.417 INFO:teuthology.orchestra.run.trial086.stdout: "acting_primary": -1, 2026-02-26T03:17:29.417 INFO:teuthology.orchestra.run.trial086.stdout: "purged_snaps": [] 2026-02-26T03:17:29.417 INFO:teuthology.orchestra.run.trial086.stdout: }, 2026-02-26T03:17:29.417 INFO:teuthology.orchestra.run.trial086.stdout: "empty": 1, 2026-02-26T03:17:29.417 INFO:teuthology.orchestra.run.trial086.stdout: "dne": 1, 2026-02-26T03:17:29.417 INFO:teuthology.orchestra.run.trial086.stdout: "incomplete": 0, 2026-02-26T03:17:29.417 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_started": 0, 2026-02-26T03:17:29.417 INFO:teuthology.orchestra.run.trial086.stdout: "hit_set_history": { 2026-02-26T03:17:29.418 INFO:teuthology.orchestra.run.trial086.stdout: "current_last_update": "0'0", 2026-02-26T03:17:29.418 INFO:teuthology.orchestra.run.trial086.stdout: "history": [] 2026-02-26T03:17:29.418 INFO:teuthology.orchestra.run.trial086.stdout: } 2026-02-26T03:17:29.418 INFO:teuthology.orchestra.run.trial086.stdout:} 2026-02-26T03:17:30.915 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:17:30.916 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:17:30.916 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:17:30.916 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:17:30.916 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:17:30.916 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:17:30.948 DEBUG:teuthology.orchestra.run.trial086:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-1 --device-type SSD --op info --pgid 3.7 2026-02-26T03:17:31.093 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:31,091 seastar - Reactor backend: linux-aio 2026-02-26T03:17:31.107 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:31,105 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:17:31.107 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:31,105 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:17:31.110 INFO:teuthology.orchestra.run.trial086.stderr:==46076==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:17:31.544 INFO:teuthology.orchestra.run.trial086.stdout:object name is empty, use pgmeta oid 2026-02-26T03:17:31.544 INFO:teuthology.orchestra.run.trial086.stdout:{ 2026-02-26T03:17:31.544 INFO:teuthology.orchestra.run.trial086.stdout: "pgid": "3.7", 2026-02-26T03:17:31.544 INFO:teuthology.orchestra.run.trial086.stdout: "shard": "255", 2026-02-26T03:17:31.545 INFO:teuthology.orchestra.run.trial086.stdout: "last_update": "0'0", 2026-02-26T03:17:31.545 INFO:teuthology.orchestra.run.trial086.stdout: "last_complete": "0'0", 2026-02-26T03:17:31.545 INFO:teuthology.orchestra.run.trial086.stdout: "log_tail": "0'0", 2026-02-26T03:17:31.545 INFO:teuthology.orchestra.run.trial086.stdout: "last_user_version": 0, 2026-02-26T03:17:31.545 INFO:teuthology.orchestra.run.trial086.stdout: "last_backfill": "MAX", 2026-02-26T03:17:31.545 INFO:teuthology.orchestra.run.trial086.stdout: "partial_writes_last_complete": [], 2026-02-26T03:17:31.545 INFO:teuthology.orchestra.run.trial086.stdout: "partial_writes_last_complete_epoch": "0", 2026-02-26T03:17:31.545 INFO:teuthology.orchestra.run.trial086.stdout: "purged_snaps": [], 2026-02-26T03:17:31.545 INFO:teuthology.orchestra.run.trial086.stdout: "history": { 2026-02-26T03:17:31.545 INFO:teuthology.orchestra.run.trial086.stdout: "epoch_created": 0, 2026-02-26T03:17:31.545 INFO:teuthology.orchestra.run.trial086.stdout: "epoch_pool_created": 0, 2026-02-26T03:17:31.545 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_started": 0, 2026-02-26T03:17:31.545 INFO:teuthology.orchestra.run.trial086.stdout: "last_interval_started": 0, 2026-02-26T03:17:31.545 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_clean": 0, 2026-02-26T03:17:31.545 INFO:teuthology.orchestra.run.trial086.stdout: "last_interval_clean": 0, 2026-02-26T03:17:31.545 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_split": 0, 2026-02-26T03:17:31.545 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_marked_full": 0, 2026-02-26T03:17:31.545 INFO:teuthology.orchestra.run.trial086.stdout: "same_up_since": 0, 2026-02-26T03:17:31.546 INFO:teuthology.orchestra.run.trial086.stdout: "same_interval_since": 0, 2026-02-26T03:17:31.546 INFO:teuthology.orchestra.run.trial086.stdout: "same_primary_since": 0, 2026-02-26T03:17:31.546 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub": "0'0", 2026-02-26T03:17:31.546 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub_stamp": "0.000000", 2026-02-26T03:17:31.546 INFO:teuthology.orchestra.run.trial086.stdout: "last_deep_scrub": "0'0", 2026-02-26T03:17:31.546 INFO:teuthology.orchestra.run.trial086.stdout: "last_deep_scrub_stamp": "0.000000", 2026-02-26T03:17:31.546 INFO:teuthology.orchestra.run.trial086.stdout: "last_clean_scrub_stamp": "0.000000", 2026-02-26T03:17:31.546 INFO:teuthology.orchestra.run.trial086.stdout: "prior_readable_until_ub": 0 2026-02-26T03:17:31.546 INFO:teuthology.orchestra.run.trial086.stdout: }, 2026-02-26T03:17:31.546 INFO:teuthology.orchestra.run.trial086.stdout: "stats": { 2026-02-26T03:17:31.546 INFO:teuthology.orchestra.run.trial086.stdout: "version": "0'0", 2026-02-26T03:17:31.546 INFO:teuthology.orchestra.run.trial086.stdout: "reported_seq": 0, 2026-02-26T03:17:31.546 INFO:teuthology.orchestra.run.trial086.stdout: "reported_epoch": 0, 2026-02-26T03:17:31.546 INFO:teuthology.orchestra.run.trial086.stdout: "state": "unknown", 2026-02-26T03:17:31.546 INFO:teuthology.orchestra.run.trial086.stdout: "last_fresh": "0.000000", 2026-02-26T03:17:31.546 INFO:teuthology.orchestra.run.trial086.stdout: "last_change": "0.000000", 2026-02-26T03:17:31.546 INFO:teuthology.orchestra.run.trial086.stdout: "last_active": "0.000000", 2026-02-26T03:17:31.546 INFO:teuthology.orchestra.run.trial086.stdout: "last_peered": "0.000000", 2026-02-26T03:17:31.546 INFO:teuthology.orchestra.run.trial086.stdout: "last_clean": "0.000000", 2026-02-26T03:17:31.547 INFO:teuthology.orchestra.run.trial086.stdout: "last_became_active": "0.000000", 2026-02-26T03:17:31.547 INFO:teuthology.orchestra.run.trial086.stdout: "last_became_peered": "0.000000", 2026-02-26T03:17:31.547 INFO:teuthology.orchestra.run.trial086.stdout: "last_unstale": "0.000000", 2026-02-26T03:17:31.547 INFO:teuthology.orchestra.run.trial086.stdout: "last_undegraded": "0.000000", 2026-02-26T03:17:31.547 INFO:teuthology.orchestra.run.trial086.stdout: "last_fullsized": "0.000000", 2026-02-26T03:17:31.547 INFO:teuthology.orchestra.run.trial086.stdout: "mapping_epoch": 0, 2026-02-26T03:17:31.547 INFO:teuthology.orchestra.run.trial086.stdout: "log_start": "0'0", 2026-02-26T03:17:31.547 INFO:teuthology.orchestra.run.trial086.stdout: "ondisk_log_start": "0'0", 2026-02-26T03:17:31.547 INFO:teuthology.orchestra.run.trial086.stdout: "created": 0, 2026-02-26T03:17:31.547 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_clean": 0, 2026-02-26T03:17:31.547 INFO:teuthology.orchestra.run.trial086.stdout: "parent": "0.0", 2026-02-26T03:17:31.547 INFO:teuthology.orchestra.run.trial086.stdout: "parent_split_bits": 0, 2026-02-26T03:17:31.547 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub": "0'0", 2026-02-26T03:17:31.547 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub_stamp": "0.000000", 2026-02-26T03:17:31.547 INFO:teuthology.orchestra.run.trial086.stdout: "last_deep_scrub": "0'0", 2026-02-26T03:17:31.547 INFO:teuthology.orchestra.run.trial086.stdout: "last_deep_scrub_stamp": "0.000000", 2026-02-26T03:17:31.547 INFO:teuthology.orchestra.run.trial086.stdout: "last_clean_scrub_stamp": "0.000000", 2026-02-26T03:17:31.547 INFO:teuthology.orchestra.run.trial086.stdout: "objects_scrubbed": 0, 2026-02-26T03:17:31.547 INFO:teuthology.orchestra.run.trial086.stdout: "log_size": 0, 2026-02-26T03:17:31.547 INFO:teuthology.orchestra.run.trial086.stdout: "log_dups_size": 0, 2026-02-26T03:17:31.548 INFO:teuthology.orchestra.run.trial086.stdout: "ondisk_log_size": 0, 2026-02-26T03:17:31.548 INFO:teuthology.orchestra.run.trial086.stdout: "stats_invalid": false, 2026-02-26T03:17:31.548 INFO:teuthology.orchestra.run.trial086.stdout: "dirty_stats_invalid": false, 2026-02-26T03:17:31.548 INFO:teuthology.orchestra.run.trial086.stdout: "omap_stats_invalid": false, 2026-02-26T03:17:31.548 INFO:teuthology.orchestra.run.trial086.stdout: "hitset_stats_invalid": false, 2026-02-26T03:17:31.548 INFO:teuthology.orchestra.run.trial086.stdout: "hitset_bytes_stats_invalid": false, 2026-02-26T03:17:31.548 INFO:teuthology.orchestra.run.trial086.stdout: "pin_stats_invalid": false, 2026-02-26T03:17:31.548 INFO:teuthology.orchestra.run.trial086.stdout: "manifest_stats_invalid": false, 2026-02-26T03:17:31.548 INFO:teuthology.orchestra.run.trial086.stdout: "snaptrimq_len": 0, 2026-02-26T03:17:31.548 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub_duration": 0, 2026-02-26T03:17:31.548 INFO:teuthology.orchestra.run.trial086.stdout: "scrub_schedule": "--", 2026-02-26T03:17:31.548 INFO:teuthology.orchestra.run.trial086.stdout: "scrub_duration": 0, 2026-02-26T03:17:31.548 INFO:teuthology.orchestra.run.trial086.stdout: "objects_trimmed": 0, 2026-02-26T03:17:31.548 INFO:teuthology.orchestra.run.trial086.stdout: "snaptrim_duration": 0, 2026-02-26T03:17:31.548 INFO:teuthology.orchestra.run.trial086.stdout: "stat_sum": { 2026-02-26T03:17:31.548 INFO:teuthology.orchestra.run.trial086.stdout: "num_bytes": 0, 2026-02-26T03:17:31.548 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects": 0, 2026-02-26T03:17:31.548 INFO:teuthology.orchestra.run.trial086.stdout: "num_object_clones": 0, 2026-02-26T03:17:31.548 INFO:teuthology.orchestra.run.trial086.stdout: "num_object_copies": 0, 2026-02-26T03:17:31.548 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_missing_on_primary": 0, 2026-02-26T03:17:31.548 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_missing": 0, 2026-02-26T03:17:31.549 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_degraded": 0, 2026-02-26T03:17:31.549 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_misplaced": 0, 2026-02-26T03:17:31.549 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_unfound": 0, 2026-02-26T03:17:31.549 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_dirty": 0, 2026-02-26T03:17:31.549 INFO:teuthology.orchestra.run.trial086.stdout: "num_whiteouts": 0, 2026-02-26T03:17:31.549 INFO:teuthology.orchestra.run.trial086.stdout: "num_read": 0, 2026-02-26T03:17:31.549 INFO:teuthology.orchestra.run.trial086.stdout: "num_read_kb": 0, 2026-02-26T03:17:31.549 INFO:teuthology.orchestra.run.trial086.stdout: "num_write": 0, 2026-02-26T03:17:31.549 INFO:teuthology.orchestra.run.trial086.stdout: "num_write_kb": 0, 2026-02-26T03:17:31.549 INFO:teuthology.orchestra.run.trial086.stdout: "num_scrub_errors": 0, 2026-02-26T03:17:31.549 INFO:teuthology.orchestra.run.trial086.stdout: "num_shallow_scrub_errors": 0, 2026-02-26T03:17:31.549 INFO:teuthology.orchestra.run.trial086.stdout: "num_deep_scrub_errors": 0, 2026-02-26T03:17:31.549 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_recovered": 0, 2026-02-26T03:17:31.549 INFO:teuthology.orchestra.run.trial086.stdout: "num_bytes_recovered": 0, 2026-02-26T03:17:31.549 INFO:teuthology.orchestra.run.trial086.stdout: "num_keys_recovered": 0, 2026-02-26T03:17:31.549 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_omap": 0, 2026-02-26T03:17:31.549 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_hit_set_archive": 0, 2026-02-26T03:17:31.549 INFO:teuthology.orchestra.run.trial086.stdout: "num_bytes_hit_set_archive": 0, 2026-02-26T03:17:31.549 INFO:teuthology.orchestra.run.trial086.stdout: "num_flush": 0, 2026-02-26T03:17:31.549 INFO:teuthology.orchestra.run.trial086.stdout: "num_flush_kb": 0, 2026-02-26T03:17:31.549 INFO:teuthology.orchestra.run.trial086.stdout: "num_evict": 0, 2026-02-26T03:17:31.550 INFO:teuthology.orchestra.run.trial086.stdout: "num_evict_kb": 0, 2026-02-26T03:17:31.550 INFO:teuthology.orchestra.run.trial086.stdout: "num_promote": 0, 2026-02-26T03:17:31.550 INFO:teuthology.orchestra.run.trial086.stdout: "num_flush_mode_high": 0, 2026-02-26T03:17:31.550 INFO:teuthology.orchestra.run.trial086.stdout: "num_flush_mode_low": 0, 2026-02-26T03:17:31.550 INFO:teuthology.orchestra.run.trial086.stdout: "num_evict_mode_some": 0, 2026-02-26T03:17:31.550 INFO:teuthology.orchestra.run.trial086.stdout: "num_evict_mode_full": 0, 2026-02-26T03:17:31.550 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_pinned": 0, 2026-02-26T03:17:31.550 INFO:teuthology.orchestra.run.trial086.stdout: "num_legacy_snapsets": 0, 2026-02-26T03:17:31.550 INFO:teuthology.orchestra.run.trial086.stdout: "num_large_omap_objects": 0, 2026-02-26T03:17:31.550 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_manifest": 0, 2026-02-26T03:17:31.550 INFO:teuthology.orchestra.run.trial086.stdout: "num_omap_bytes": 0, 2026-02-26T03:17:31.550 INFO:teuthology.orchestra.run.trial086.stdout: "num_omap_keys": 0, 2026-02-26T03:17:31.550 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_repaired": 0 2026-02-26T03:17:31.550 INFO:teuthology.orchestra.run.trial086.stdout: }, 2026-02-26T03:17:31.550 INFO:teuthology.orchestra.run.trial086.stdout: "up": [], 2026-02-26T03:17:31.550 INFO:teuthology.orchestra.run.trial086.stdout: "acting": [], 2026-02-26T03:17:31.550 INFO:teuthology.orchestra.run.trial086.stdout: "avail_no_missing": [], 2026-02-26T03:17:31.550 INFO:teuthology.orchestra.run.trial086.stdout: "object_location_counts": [], 2026-02-26T03:17:31.550 INFO:teuthology.orchestra.run.trial086.stdout: "blocked_by": [], 2026-02-26T03:17:31.550 INFO:teuthology.orchestra.run.trial086.stdout: "up_primary": -1, 2026-02-26T03:17:31.550 INFO:teuthology.orchestra.run.trial086.stdout: "acting_primary": -1, 2026-02-26T03:17:31.550 INFO:teuthology.orchestra.run.trial086.stdout: "purged_snaps": [] 2026-02-26T03:17:31.551 INFO:teuthology.orchestra.run.trial086.stdout: }, 2026-02-26T03:17:31.551 INFO:teuthology.orchestra.run.trial086.stdout: "empty": 1, 2026-02-26T03:17:31.551 INFO:teuthology.orchestra.run.trial086.stdout: "dne": 1, 2026-02-26T03:17:31.551 INFO:teuthology.orchestra.run.trial086.stdout: "incomplete": 0, 2026-02-26T03:17:31.551 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_started": 0, 2026-02-26T03:17:31.551 INFO:teuthology.orchestra.run.trial086.stdout: "hit_set_history": { 2026-02-26T03:17:31.551 INFO:teuthology.orchestra.run.trial086.stdout: "current_last_update": "0'0", 2026-02-26T03:17:31.551 INFO:teuthology.orchestra.run.trial086.stdout: "history": [] 2026-02-26T03:17:31.551 INFO:teuthology.orchestra.run.trial086.stdout: } 2026-02-26T03:17:31.551 INFO:teuthology.orchestra.run.trial086.stdout:} 2026-02-26T03:17:33.029 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:17:33.029 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:17:33.029 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:17:33.029 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:17:33.029 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:17:33.029 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:17:33.060 DEBUG:teuthology.orchestra.run.trial086:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-1 --device-type SSD --op info --pgid 3.6 2026-02-26T03:17:33.208 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:33,206 seastar - Reactor backend: linux-aio 2026-02-26T03:17:33.226 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:33,224 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:17:33.226 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:33,224 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:17:33.229 INFO:teuthology.orchestra.run.trial086.stderr:==46107==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:17:33.666 INFO:teuthology.orchestra.run.trial086.stdout:object name is empty, use pgmeta oid 2026-02-26T03:17:33.666 INFO:teuthology.orchestra.run.trial086.stdout:{ 2026-02-26T03:17:33.666 INFO:teuthology.orchestra.run.trial086.stdout: "pgid": "3.6", 2026-02-26T03:17:33.666 INFO:teuthology.orchestra.run.trial086.stdout: "shard": "255", 2026-02-26T03:17:33.666 INFO:teuthology.orchestra.run.trial086.stdout: "last_update": "0'0", 2026-02-26T03:17:33.666 INFO:teuthology.orchestra.run.trial086.stdout: "last_complete": "0'0", 2026-02-26T03:17:33.666 INFO:teuthology.orchestra.run.trial086.stdout: "log_tail": "0'0", 2026-02-26T03:17:33.667 INFO:teuthology.orchestra.run.trial086.stdout: "last_user_version": 0, 2026-02-26T03:17:33.667 INFO:teuthology.orchestra.run.trial086.stdout: "last_backfill": "MAX", 2026-02-26T03:17:33.667 INFO:teuthology.orchestra.run.trial086.stdout: "partial_writes_last_complete": [], 2026-02-26T03:17:33.667 INFO:teuthology.orchestra.run.trial086.stdout: "partial_writes_last_complete_epoch": "0", 2026-02-26T03:17:33.667 INFO:teuthology.orchestra.run.trial086.stdout: "purged_snaps": [], 2026-02-26T03:17:33.667 INFO:teuthology.orchestra.run.trial086.stdout: "history": { 2026-02-26T03:17:33.667 INFO:teuthology.orchestra.run.trial086.stdout: "epoch_created": 0, 2026-02-26T03:17:33.667 INFO:teuthology.orchestra.run.trial086.stdout: "epoch_pool_created": 0, 2026-02-26T03:17:33.667 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_started": 0, 2026-02-26T03:17:33.667 INFO:teuthology.orchestra.run.trial086.stdout: "last_interval_started": 0, 2026-02-26T03:17:33.667 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_clean": 0, 2026-02-26T03:17:33.667 INFO:teuthology.orchestra.run.trial086.stdout: "last_interval_clean": 0, 2026-02-26T03:17:33.667 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_split": 0, 2026-02-26T03:17:33.667 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_marked_full": 0, 2026-02-26T03:17:33.667 INFO:teuthology.orchestra.run.trial086.stdout: "same_up_since": 0, 2026-02-26T03:17:33.667 INFO:teuthology.orchestra.run.trial086.stdout: "same_interval_since": 0, 2026-02-26T03:17:33.668 INFO:teuthology.orchestra.run.trial086.stdout: "same_primary_since": 0, 2026-02-26T03:17:33.668 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub": "0'0", 2026-02-26T03:17:33.668 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub_stamp": "0.000000", 2026-02-26T03:17:33.668 INFO:teuthology.orchestra.run.trial086.stdout: "last_deep_scrub": "0'0", 2026-02-26T03:17:33.668 INFO:teuthology.orchestra.run.trial086.stdout: "last_deep_scrub_stamp": "0.000000", 2026-02-26T03:17:33.668 INFO:teuthology.orchestra.run.trial086.stdout: "last_clean_scrub_stamp": "0.000000", 2026-02-26T03:17:33.668 INFO:teuthology.orchestra.run.trial086.stdout: "prior_readable_until_ub": 0 2026-02-26T03:17:33.668 INFO:teuthology.orchestra.run.trial086.stdout: }, 2026-02-26T03:17:33.668 INFO:teuthology.orchestra.run.trial086.stdout: "stats": { 2026-02-26T03:17:33.668 INFO:teuthology.orchestra.run.trial086.stdout: "version": "0'0", 2026-02-26T03:17:33.668 INFO:teuthology.orchestra.run.trial086.stdout: "reported_seq": 0, 2026-02-26T03:17:33.668 INFO:teuthology.orchestra.run.trial086.stdout: "reported_epoch": 0, 2026-02-26T03:17:33.668 INFO:teuthology.orchestra.run.trial086.stdout: "state": "unknown", 2026-02-26T03:17:33.668 INFO:teuthology.orchestra.run.trial086.stdout: "last_fresh": "0.000000", 2026-02-26T03:17:33.668 INFO:teuthology.orchestra.run.trial086.stdout: "last_change": "0.000000", 2026-02-26T03:17:33.668 INFO:teuthology.orchestra.run.trial086.stdout: "last_active": "0.000000", 2026-02-26T03:17:33.669 INFO:teuthology.orchestra.run.trial086.stdout: "last_peered": "0.000000", 2026-02-26T03:17:33.669 INFO:teuthology.orchestra.run.trial086.stdout: "last_clean": "0.000000", 2026-02-26T03:17:33.669 INFO:teuthology.orchestra.run.trial086.stdout: "last_became_active": "0.000000", 2026-02-26T03:17:33.669 INFO:teuthology.orchestra.run.trial086.stdout: "last_became_peered": "0.000000", 2026-02-26T03:17:33.669 INFO:teuthology.orchestra.run.trial086.stdout: "last_unstale": "0.000000", 2026-02-26T03:17:33.669 INFO:teuthology.orchestra.run.trial086.stdout: "last_undegraded": "0.000000", 2026-02-26T03:17:33.669 INFO:teuthology.orchestra.run.trial086.stdout: "last_fullsized": "0.000000", 2026-02-26T03:17:33.669 INFO:teuthology.orchestra.run.trial086.stdout: "mapping_epoch": 0, 2026-02-26T03:17:33.669 INFO:teuthology.orchestra.run.trial086.stdout: "log_start": "0'0", 2026-02-26T03:17:33.669 INFO:teuthology.orchestra.run.trial086.stdout: "ondisk_log_start": "0'0", 2026-02-26T03:17:33.669 INFO:teuthology.orchestra.run.trial086.stdout: "created": 0, 2026-02-26T03:17:33.669 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_clean": 0, 2026-02-26T03:17:33.669 INFO:teuthology.orchestra.run.trial086.stdout: "parent": "0.0", 2026-02-26T03:17:33.669 INFO:teuthology.orchestra.run.trial086.stdout: "parent_split_bits": 0, 2026-02-26T03:17:33.669 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub": "0'0", 2026-02-26T03:17:33.669 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub_stamp": "0.000000", 2026-02-26T03:17:33.669 INFO:teuthology.orchestra.run.trial086.stdout: "last_deep_scrub": "0'0", 2026-02-26T03:17:33.670 INFO:teuthology.orchestra.run.trial086.stdout: "last_deep_scrub_stamp": "0.000000", 2026-02-26T03:17:33.670 INFO:teuthology.orchestra.run.trial086.stdout: "last_clean_scrub_stamp": "0.000000", 2026-02-26T03:17:33.670 INFO:teuthology.orchestra.run.trial086.stdout: "objects_scrubbed": 0, 2026-02-26T03:17:33.670 INFO:teuthology.orchestra.run.trial086.stdout: "log_size": 0, 2026-02-26T03:17:33.670 INFO:teuthology.orchestra.run.trial086.stdout: "log_dups_size": 0, 2026-02-26T03:17:33.670 INFO:teuthology.orchestra.run.trial086.stdout: "ondisk_log_size": 0, 2026-02-26T03:17:33.670 INFO:teuthology.orchestra.run.trial086.stdout: "stats_invalid": false, 2026-02-26T03:17:33.670 INFO:teuthology.orchestra.run.trial086.stdout: "dirty_stats_invalid": false, 2026-02-26T03:17:33.670 INFO:teuthology.orchestra.run.trial086.stdout: "omap_stats_invalid": false, 2026-02-26T03:17:33.670 INFO:teuthology.orchestra.run.trial086.stdout: "hitset_stats_invalid": false, 2026-02-26T03:17:33.670 INFO:teuthology.orchestra.run.trial086.stdout: "hitset_bytes_stats_invalid": false, 2026-02-26T03:17:33.670 INFO:teuthology.orchestra.run.trial086.stdout: "pin_stats_invalid": false, 2026-02-26T03:17:33.670 INFO:teuthology.orchestra.run.trial086.stdout: "manifest_stats_invalid": false, 2026-02-26T03:17:33.670 INFO:teuthology.orchestra.run.trial086.stdout: "snaptrimq_len": 0, 2026-02-26T03:17:33.670 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub_duration": 0, 2026-02-26T03:17:33.670 INFO:teuthology.orchestra.run.trial086.stdout: "scrub_schedule": "--", 2026-02-26T03:17:33.670 INFO:teuthology.orchestra.run.trial086.stdout: "scrub_duration": 0, 2026-02-26T03:17:33.670 INFO:teuthology.orchestra.run.trial086.stdout: "objects_trimmed": 0, 2026-02-26T03:17:33.671 INFO:teuthology.orchestra.run.trial086.stdout: "snaptrim_duration": 0, 2026-02-26T03:17:33.671 INFO:teuthology.orchestra.run.trial086.stdout: "stat_sum": { 2026-02-26T03:17:33.671 INFO:teuthology.orchestra.run.trial086.stdout: "num_bytes": 0, 2026-02-26T03:17:33.671 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects": 0, 2026-02-26T03:17:33.671 INFO:teuthology.orchestra.run.trial086.stdout: "num_object_clones": 0, 2026-02-26T03:17:33.671 INFO:teuthology.orchestra.run.trial086.stdout: "num_object_copies": 0, 2026-02-26T03:17:33.671 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_missing_on_primary": 0, 2026-02-26T03:17:33.671 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_missing": 0, 2026-02-26T03:17:33.671 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_degraded": 0, 2026-02-26T03:17:33.671 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_misplaced": 0, 2026-02-26T03:17:33.671 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_unfound": 0, 2026-02-26T03:17:33.671 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_dirty": 0, 2026-02-26T03:17:33.671 INFO:teuthology.orchestra.run.trial086.stdout: "num_whiteouts": 0, 2026-02-26T03:17:33.671 INFO:teuthology.orchestra.run.trial086.stdout: "num_read": 0, 2026-02-26T03:17:33.671 INFO:teuthology.orchestra.run.trial086.stdout: "num_read_kb": 0, 2026-02-26T03:17:33.671 INFO:teuthology.orchestra.run.trial086.stdout: "num_write": 0, 2026-02-26T03:17:33.671 INFO:teuthology.orchestra.run.trial086.stdout: "num_write_kb": 0, 2026-02-26T03:17:33.671 INFO:teuthology.orchestra.run.trial086.stdout: "num_scrub_errors": 0, 2026-02-26T03:17:33.672 INFO:teuthology.orchestra.run.trial086.stdout: "num_shallow_scrub_errors": 0, 2026-02-26T03:17:33.672 INFO:teuthology.orchestra.run.trial086.stdout: "num_deep_scrub_errors": 0, 2026-02-26T03:17:33.672 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_recovered": 0, 2026-02-26T03:17:33.672 INFO:teuthology.orchestra.run.trial086.stdout: "num_bytes_recovered": 0, 2026-02-26T03:17:33.672 INFO:teuthology.orchestra.run.trial086.stdout: "num_keys_recovered": 0, 2026-02-26T03:17:33.672 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_omap": 0, 2026-02-26T03:17:33.672 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_hit_set_archive": 0, 2026-02-26T03:17:33.672 INFO:teuthology.orchestra.run.trial086.stdout: "num_bytes_hit_set_archive": 0, 2026-02-26T03:17:33.672 INFO:teuthology.orchestra.run.trial086.stdout: "num_flush": 0, 2026-02-26T03:17:33.672 INFO:teuthology.orchestra.run.trial086.stdout: "num_flush_kb": 0, 2026-02-26T03:17:33.672 INFO:teuthology.orchestra.run.trial086.stdout: "num_evict": 0, 2026-02-26T03:17:33.672 INFO:teuthology.orchestra.run.trial086.stdout: "num_evict_kb": 0, 2026-02-26T03:17:33.672 INFO:teuthology.orchestra.run.trial086.stdout: "num_promote": 0, 2026-02-26T03:17:33.672 INFO:teuthology.orchestra.run.trial086.stdout: "num_flush_mode_high": 0, 2026-02-26T03:17:33.672 INFO:teuthology.orchestra.run.trial086.stdout: "num_flush_mode_low": 0, 2026-02-26T03:17:33.672 INFO:teuthology.orchestra.run.trial086.stdout: "num_evict_mode_some": 0, 2026-02-26T03:17:33.672 INFO:teuthology.orchestra.run.trial086.stdout: "num_evict_mode_full": 0, 2026-02-26T03:17:33.672 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_pinned": 0, 2026-02-26T03:17:33.672 INFO:teuthology.orchestra.run.trial086.stdout: "num_legacy_snapsets": 0, 2026-02-26T03:17:33.673 INFO:teuthology.orchestra.run.trial086.stdout: "num_large_omap_objects": 0, 2026-02-26T03:17:33.673 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_manifest": 0, 2026-02-26T03:17:33.673 INFO:teuthology.orchestra.run.trial086.stdout: "num_omap_bytes": 0, 2026-02-26T03:17:33.673 INFO:teuthology.orchestra.run.trial086.stdout: "num_omap_keys": 0, 2026-02-26T03:17:33.673 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_repaired": 0 2026-02-26T03:17:33.673 INFO:teuthology.orchestra.run.trial086.stdout: }, 2026-02-26T03:17:33.673 INFO:teuthology.orchestra.run.trial086.stdout: "up": [], 2026-02-26T03:17:33.673 INFO:teuthology.orchestra.run.trial086.stdout: "acting": [], 2026-02-26T03:17:33.673 INFO:teuthology.orchestra.run.trial086.stdout: "avail_no_missing": [], 2026-02-26T03:17:33.673 INFO:teuthology.orchestra.run.trial086.stdout: "object_location_counts": [], 2026-02-26T03:17:33.673 INFO:teuthology.orchestra.run.trial086.stdout: "blocked_by": [], 2026-02-26T03:17:33.673 INFO:teuthology.orchestra.run.trial086.stdout: "up_primary": -1, 2026-02-26T03:17:33.673 INFO:teuthology.orchestra.run.trial086.stdout: "acting_primary": -1, 2026-02-26T03:17:33.673 INFO:teuthology.orchestra.run.trial086.stdout: "purged_snaps": [] 2026-02-26T03:17:33.673 INFO:teuthology.orchestra.run.trial086.stdout: }, 2026-02-26T03:17:33.673 INFO:teuthology.orchestra.run.trial086.stdout: "empty": 1, 2026-02-26T03:17:33.673 INFO:teuthology.orchestra.run.trial086.stdout: "dne": 1, 2026-02-26T03:17:33.673 INFO:teuthology.orchestra.run.trial086.stdout: "incomplete": 0, 2026-02-26T03:17:33.674 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_started": 0, 2026-02-26T03:17:33.674 INFO:teuthology.orchestra.run.trial086.stdout: "hit_set_history": { 2026-02-26T03:17:33.674 INFO:teuthology.orchestra.run.trial086.stdout: "current_last_update": "0'0", 2026-02-26T03:17:33.674 INFO:teuthology.orchestra.run.trial086.stdout: "history": [] 2026-02-26T03:17:33.674 INFO:teuthology.orchestra.run.trial086.stdout: } 2026-02-26T03:17:33.674 INFO:teuthology.orchestra.run.trial086.stdout:} 2026-02-26T03:17:35.170 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:17:35.171 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:17:35.171 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:17:35.171 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:17:35.171 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:17:35.171 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:17:35.201 DEBUG:teuthology.orchestra.run.trial086:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-2 --device-type SSD --op info --pgid 3.2 2026-02-26T03:17:35.344 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:35,342 seastar - Reactor backend: linux-aio 2026-02-26T03:17:35.352 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:35,349 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:17:35.352 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:35,349 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:17:35.354 INFO:teuthology.orchestra.run.trial086.stderr:==46138==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:17:35.769 INFO:teuthology.orchestra.run.trial086.stdout:object name is empty, use pgmeta oid 2026-02-26T03:17:35.769 INFO:teuthology.orchestra.run.trial086.stdout:{ 2026-02-26T03:17:35.770 INFO:teuthology.orchestra.run.trial086.stdout: "pgid": "3.2", 2026-02-26T03:17:35.770 INFO:teuthology.orchestra.run.trial086.stdout: "shard": "255", 2026-02-26T03:17:35.770 INFO:teuthology.orchestra.run.trial086.stdout: "last_update": "0'0", 2026-02-26T03:17:35.770 INFO:teuthology.orchestra.run.trial086.stdout: "last_complete": "0'0", 2026-02-26T03:17:35.770 INFO:teuthology.orchestra.run.trial086.stdout: "log_tail": "0'0", 2026-02-26T03:17:35.770 INFO:teuthology.orchestra.run.trial086.stdout: "last_user_version": 0, 2026-02-26T03:17:35.770 INFO:teuthology.orchestra.run.trial086.stdout: "last_backfill": "MAX", 2026-02-26T03:17:35.770 INFO:teuthology.orchestra.run.trial086.stdout: "partial_writes_last_complete": [], 2026-02-26T03:17:35.770 INFO:teuthology.orchestra.run.trial086.stdout: "partial_writes_last_complete_epoch": "0", 2026-02-26T03:17:35.771 INFO:teuthology.orchestra.run.trial086.stdout: "purged_snaps": [], 2026-02-26T03:17:35.771 INFO:teuthology.orchestra.run.trial086.stdout: "history": { 2026-02-26T03:17:35.771 INFO:teuthology.orchestra.run.trial086.stdout: "epoch_created": 0, 2026-02-26T03:17:35.771 INFO:teuthology.orchestra.run.trial086.stdout: "epoch_pool_created": 0, 2026-02-26T03:17:35.771 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_started": 0, 2026-02-26T03:17:35.771 INFO:teuthology.orchestra.run.trial086.stdout: "last_interval_started": 0, 2026-02-26T03:17:35.771 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_clean": 0, 2026-02-26T03:17:35.771 INFO:teuthology.orchestra.run.trial086.stdout: "last_interval_clean": 0, 2026-02-26T03:17:35.771 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_split": 0, 2026-02-26T03:17:35.771 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_marked_full": 0, 2026-02-26T03:17:35.772 INFO:teuthology.orchestra.run.trial086.stdout: "same_up_since": 0, 2026-02-26T03:17:35.772 INFO:teuthology.orchestra.run.trial086.stdout: "same_interval_since": 0, 2026-02-26T03:17:35.772 INFO:teuthology.orchestra.run.trial086.stdout: "same_primary_since": 0, 2026-02-26T03:17:35.772 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub": "0'0", 2026-02-26T03:17:35.772 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub_stamp": "0.000000", 2026-02-26T03:17:35.772 INFO:teuthology.orchestra.run.trial086.stdout: "last_deep_scrub": "0'0", 2026-02-26T03:17:35.772 INFO:teuthology.orchestra.run.trial086.stdout: "last_deep_scrub_stamp": "0.000000", 2026-02-26T03:17:35.772 INFO:teuthology.orchestra.run.trial086.stdout: "last_clean_scrub_stamp": "0.000000", 2026-02-26T03:17:35.772 INFO:teuthology.orchestra.run.trial086.stdout: "prior_readable_until_ub": 0 2026-02-26T03:17:35.772 INFO:teuthology.orchestra.run.trial086.stdout: }, 2026-02-26T03:17:35.772 INFO:teuthology.orchestra.run.trial086.stdout: "stats": { 2026-02-26T03:17:35.772 INFO:teuthology.orchestra.run.trial086.stdout: "version": "0'0", 2026-02-26T03:17:35.773 INFO:teuthology.orchestra.run.trial086.stdout: "reported_seq": 0, 2026-02-26T03:17:35.773 INFO:teuthology.orchestra.run.trial086.stdout: "reported_epoch": 0, 2026-02-26T03:17:35.773 INFO:teuthology.orchestra.run.trial086.stdout: "state": "unknown", 2026-02-26T03:17:35.773 INFO:teuthology.orchestra.run.trial086.stdout: "last_fresh": "0.000000", 2026-02-26T03:17:35.773 INFO:teuthology.orchestra.run.trial086.stdout: "last_change": "0.000000", 2026-02-26T03:17:35.773 INFO:teuthology.orchestra.run.trial086.stdout: "last_active": "0.000000", 2026-02-26T03:17:35.773 INFO:teuthology.orchestra.run.trial086.stdout: "last_peered": "0.000000", 2026-02-26T03:17:35.773 INFO:teuthology.orchestra.run.trial086.stdout: "last_clean": "0.000000", 2026-02-26T03:17:35.773 INFO:teuthology.orchestra.run.trial086.stdout: "last_became_active": "0.000000", 2026-02-26T03:17:35.773 INFO:teuthology.orchestra.run.trial086.stdout: "last_became_peered": "0.000000", 2026-02-26T03:17:35.773 INFO:teuthology.orchestra.run.trial086.stdout: "last_unstale": "0.000000", 2026-02-26T03:17:35.773 INFO:teuthology.orchestra.run.trial086.stdout: "last_undegraded": "0.000000", 2026-02-26T03:17:35.773 INFO:teuthology.orchestra.run.trial086.stdout: "last_fullsized": "0.000000", 2026-02-26T03:17:35.774 INFO:teuthology.orchestra.run.trial086.stdout: "mapping_epoch": 0, 2026-02-26T03:17:35.774 INFO:teuthology.orchestra.run.trial086.stdout: "log_start": "0'0", 2026-02-26T03:17:35.774 INFO:teuthology.orchestra.run.trial086.stdout: "ondisk_log_start": "0'0", 2026-02-26T03:17:35.774 INFO:teuthology.orchestra.run.trial086.stdout: "created": 0, 2026-02-26T03:17:35.774 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_clean": 0, 2026-02-26T03:17:35.774 INFO:teuthology.orchestra.run.trial086.stdout: "parent": "0.0", 2026-02-26T03:17:35.774 INFO:teuthology.orchestra.run.trial086.stdout: "parent_split_bits": 0, 2026-02-26T03:17:35.774 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub": "0'0", 2026-02-26T03:17:35.774 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub_stamp": "0.000000", 2026-02-26T03:17:35.774 INFO:teuthology.orchestra.run.trial086.stdout: "last_deep_scrub": "0'0", 2026-02-26T03:17:35.774 INFO:teuthology.orchestra.run.trial086.stdout: "last_deep_scrub_stamp": "0.000000", 2026-02-26T03:17:35.774 INFO:teuthology.orchestra.run.trial086.stdout: "last_clean_scrub_stamp": "0.000000", 2026-02-26T03:17:35.775 INFO:teuthology.orchestra.run.trial086.stdout: "objects_scrubbed": 0, 2026-02-26T03:17:35.775 INFO:teuthology.orchestra.run.trial086.stdout: "log_size": 0, 2026-02-26T03:17:35.775 INFO:teuthology.orchestra.run.trial086.stdout: "log_dups_size": 0, 2026-02-26T03:17:35.775 INFO:teuthology.orchestra.run.trial086.stdout: "ondisk_log_size": 0, 2026-02-26T03:17:35.775 INFO:teuthology.orchestra.run.trial086.stdout: "stats_invalid": false, 2026-02-26T03:17:35.775 INFO:teuthology.orchestra.run.trial086.stdout: "dirty_stats_invalid": false, 2026-02-26T03:17:35.775 INFO:teuthology.orchestra.run.trial086.stdout: "omap_stats_invalid": false, 2026-02-26T03:17:35.775 INFO:teuthology.orchestra.run.trial086.stdout: "hitset_stats_invalid": false, 2026-02-26T03:17:35.775 INFO:teuthology.orchestra.run.trial086.stdout: "hitset_bytes_stats_invalid": false, 2026-02-26T03:17:35.775 INFO:teuthology.orchestra.run.trial086.stdout: "pin_stats_invalid": false, 2026-02-26T03:17:35.775 INFO:teuthology.orchestra.run.trial086.stdout: "manifest_stats_invalid": false, 2026-02-26T03:17:35.775 INFO:teuthology.orchestra.run.trial086.stdout: "snaptrimq_len": 0, 2026-02-26T03:17:35.776 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub_duration": 0, 2026-02-26T03:17:35.776 INFO:teuthology.orchestra.run.trial086.stdout: "scrub_schedule": "--", 2026-02-26T03:17:35.776 INFO:teuthology.orchestra.run.trial086.stdout: "scrub_duration": 0, 2026-02-26T03:17:35.776 INFO:teuthology.orchestra.run.trial086.stdout: "objects_trimmed": 0, 2026-02-26T03:17:35.776 INFO:teuthology.orchestra.run.trial086.stdout: "snaptrim_duration": 0, 2026-02-26T03:17:35.776 INFO:teuthology.orchestra.run.trial086.stdout: "stat_sum": { 2026-02-26T03:17:35.776 INFO:teuthology.orchestra.run.trial086.stdout: "num_bytes": 0, 2026-02-26T03:17:35.776 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects": 0, 2026-02-26T03:17:35.776 INFO:teuthology.orchestra.run.trial086.stdout: "num_object_clones": 0, 2026-02-26T03:17:35.776 INFO:teuthology.orchestra.run.trial086.stdout: "num_object_copies": 0, 2026-02-26T03:17:35.776 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_missing_on_primary": 0, 2026-02-26T03:17:35.776 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_missing": 0, 2026-02-26T03:17:35.776 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_degraded": 0, 2026-02-26T03:17:35.777 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_misplaced": 0, 2026-02-26T03:17:35.777 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_unfound": 0, 2026-02-26T03:17:35.777 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_dirty": 0, 2026-02-26T03:17:35.777 INFO:teuthology.orchestra.run.trial086.stdout: "num_whiteouts": 0, 2026-02-26T03:17:35.777 INFO:teuthology.orchestra.run.trial086.stdout: "num_read": 0, 2026-02-26T03:17:35.777 INFO:teuthology.orchestra.run.trial086.stdout: "num_read_kb": 0, 2026-02-26T03:17:35.777 INFO:teuthology.orchestra.run.trial086.stdout: "num_write": 0, 2026-02-26T03:17:35.777 INFO:teuthology.orchestra.run.trial086.stdout: "num_write_kb": 0, 2026-02-26T03:17:35.777 INFO:teuthology.orchestra.run.trial086.stdout: "num_scrub_errors": 0, 2026-02-26T03:17:35.777 INFO:teuthology.orchestra.run.trial086.stdout: "num_shallow_scrub_errors": 0, 2026-02-26T03:17:35.777 INFO:teuthology.orchestra.run.trial086.stdout: "num_deep_scrub_errors": 0, 2026-02-26T03:17:35.777 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_recovered": 0, 2026-02-26T03:17:35.778 INFO:teuthology.orchestra.run.trial086.stdout: "num_bytes_recovered": 0, 2026-02-26T03:17:35.778 INFO:teuthology.orchestra.run.trial086.stdout: "num_keys_recovered": 0, 2026-02-26T03:17:35.778 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_omap": 0, 2026-02-26T03:17:35.778 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_hit_set_archive": 0, 2026-02-26T03:17:35.778 INFO:teuthology.orchestra.run.trial086.stdout: "num_bytes_hit_set_archive": 0, 2026-02-26T03:17:35.778 INFO:teuthology.orchestra.run.trial086.stdout: "num_flush": 0, 2026-02-26T03:17:35.778 INFO:teuthology.orchestra.run.trial086.stdout: "num_flush_kb": 0, 2026-02-26T03:17:35.778 INFO:teuthology.orchestra.run.trial086.stdout: "num_evict": 0, 2026-02-26T03:17:35.778 INFO:teuthology.orchestra.run.trial086.stdout: "num_evict_kb": 0, 2026-02-26T03:17:35.778 INFO:teuthology.orchestra.run.trial086.stdout: "num_promote": 0, 2026-02-26T03:17:35.778 INFO:teuthology.orchestra.run.trial086.stdout: "num_flush_mode_high": 0, 2026-02-26T03:17:35.778 INFO:teuthology.orchestra.run.trial086.stdout: "num_flush_mode_low": 0, 2026-02-26T03:17:35.778 INFO:teuthology.orchestra.run.trial086.stdout: "num_evict_mode_some": 0, 2026-02-26T03:17:35.779 INFO:teuthology.orchestra.run.trial086.stdout: "num_evict_mode_full": 0, 2026-02-26T03:17:35.779 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_pinned": 0, 2026-02-26T03:17:35.779 INFO:teuthology.orchestra.run.trial086.stdout: "num_legacy_snapsets": 0, 2026-02-26T03:17:35.779 INFO:teuthology.orchestra.run.trial086.stdout: "num_large_omap_objects": 0, 2026-02-26T03:17:35.779 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_manifest": 0, 2026-02-26T03:17:35.779 INFO:teuthology.orchestra.run.trial086.stdout: "num_omap_bytes": 0, 2026-02-26T03:17:35.779 INFO:teuthology.orchestra.run.trial086.stdout: "num_omap_keys": 0, 2026-02-26T03:17:35.779 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_repaired": 0 2026-02-26T03:17:35.779 INFO:teuthology.orchestra.run.trial086.stdout: }, 2026-02-26T03:17:35.779 INFO:teuthology.orchestra.run.trial086.stdout: "up": [], 2026-02-26T03:17:35.779 INFO:teuthology.orchestra.run.trial086.stdout: "acting": [], 2026-02-26T03:17:35.779 INFO:teuthology.orchestra.run.trial086.stdout: "avail_no_missing": [], 2026-02-26T03:17:35.779 INFO:teuthology.orchestra.run.trial086.stdout: "object_location_counts": [], 2026-02-26T03:17:35.780 INFO:teuthology.orchestra.run.trial086.stdout: "blocked_by": [], 2026-02-26T03:17:35.780 INFO:teuthology.orchestra.run.trial086.stdout: "up_primary": -1, 2026-02-26T03:17:35.780 INFO:teuthology.orchestra.run.trial086.stdout: "acting_primary": -1, 2026-02-26T03:17:35.780 INFO:teuthology.orchestra.run.trial086.stdout: "purged_snaps": [] 2026-02-26T03:17:35.780 INFO:teuthology.orchestra.run.trial086.stdout: }, 2026-02-26T03:17:35.780 INFO:teuthology.orchestra.run.trial086.stdout: "empty": 1, 2026-02-26T03:17:35.780 INFO:teuthology.orchestra.run.trial086.stdout: "dne": 1, 2026-02-26T03:17:35.780 INFO:teuthology.orchestra.run.trial086.stdout: "incomplete": 0, 2026-02-26T03:17:35.780 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_started": 0, 2026-02-26T03:17:35.780 INFO:teuthology.orchestra.run.trial086.stdout: "hit_set_history": { 2026-02-26T03:17:35.780 INFO:teuthology.orchestra.run.trial086.stdout: "current_last_update": "0'0", 2026-02-26T03:17:35.780 INFO:teuthology.orchestra.run.trial086.stdout: "history": [] 2026-02-26T03:17:35.781 INFO:teuthology.orchestra.run.trial086.stdout: } 2026-02-26T03:17:35.781 INFO:teuthology.orchestra.run.trial086.stdout:} 2026-02-26T03:17:37.296 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:17:37.297 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:17:37.297 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:17:37.297 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:17:37.297 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:17:37.297 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:17:37.327 DEBUG:teuthology.orchestra.run.trial086:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-2 --device-type SSD --op info --pgid 3.1 2026-02-26T03:17:37.468 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:37,466 seastar - Reactor backend: linux-aio 2026-02-26T03:17:37.483 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:37,481 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:17:37.484 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:37,481 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:17:37.486 INFO:teuthology.orchestra.run.trial086.stderr:==46169==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:17:37.937 INFO:teuthology.orchestra.run.trial086.stdout:object name is empty, use pgmeta oid 2026-02-26T03:17:37.937 INFO:teuthology.orchestra.run.trial086.stdout:{ 2026-02-26T03:17:37.938 INFO:teuthology.orchestra.run.trial086.stdout: "pgid": "3.1", 2026-02-26T03:17:37.938 INFO:teuthology.orchestra.run.trial086.stdout: "shard": "255", 2026-02-26T03:17:37.938 INFO:teuthology.orchestra.run.trial086.stdout: "last_update": "0'0", 2026-02-26T03:17:37.938 INFO:teuthology.orchestra.run.trial086.stdout: "last_complete": "0'0", 2026-02-26T03:17:37.938 INFO:teuthology.orchestra.run.trial086.stdout: "log_tail": "0'0", 2026-02-26T03:17:37.938 INFO:teuthology.orchestra.run.trial086.stdout: "last_user_version": 0, 2026-02-26T03:17:37.938 INFO:teuthology.orchestra.run.trial086.stdout: "last_backfill": "MAX", 2026-02-26T03:17:37.938 INFO:teuthology.orchestra.run.trial086.stdout: "partial_writes_last_complete": [], 2026-02-26T03:17:37.938 INFO:teuthology.orchestra.run.trial086.stdout: "partial_writes_last_complete_epoch": "0", 2026-02-26T03:17:37.939 INFO:teuthology.orchestra.run.trial086.stdout: "purged_snaps": [], 2026-02-26T03:17:37.939 INFO:teuthology.orchestra.run.trial086.stdout: "history": { 2026-02-26T03:17:37.939 INFO:teuthology.orchestra.run.trial086.stdout: "epoch_created": 0, 2026-02-26T03:17:37.939 INFO:teuthology.orchestra.run.trial086.stdout: "epoch_pool_created": 0, 2026-02-26T03:17:37.939 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_started": 0, 2026-02-26T03:17:37.939 INFO:teuthology.orchestra.run.trial086.stdout: "last_interval_started": 0, 2026-02-26T03:17:37.939 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_clean": 0, 2026-02-26T03:17:37.939 INFO:teuthology.orchestra.run.trial086.stdout: "last_interval_clean": 0, 2026-02-26T03:17:37.939 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_split": 0, 2026-02-26T03:17:37.939 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_marked_full": 0, 2026-02-26T03:17:37.939 INFO:teuthology.orchestra.run.trial086.stdout: "same_up_since": 0, 2026-02-26T03:17:37.939 INFO:teuthology.orchestra.run.trial086.stdout: "same_interval_since": 0, 2026-02-26T03:17:37.940 INFO:teuthology.orchestra.run.trial086.stdout: "same_primary_since": 0, 2026-02-26T03:17:37.940 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub": "0'0", 2026-02-26T03:17:37.940 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub_stamp": "0.000000", 2026-02-26T03:17:37.940 INFO:teuthology.orchestra.run.trial086.stdout: "last_deep_scrub": "0'0", 2026-02-26T03:17:37.940 INFO:teuthology.orchestra.run.trial086.stdout: "last_deep_scrub_stamp": "0.000000", 2026-02-26T03:17:37.940 INFO:teuthology.orchestra.run.trial086.stdout: "last_clean_scrub_stamp": "0.000000", 2026-02-26T03:17:37.940 INFO:teuthology.orchestra.run.trial086.stdout: "prior_readable_until_ub": 0 2026-02-26T03:17:37.940 INFO:teuthology.orchestra.run.trial086.stdout: }, 2026-02-26T03:17:37.940 INFO:teuthology.orchestra.run.trial086.stdout: "stats": { 2026-02-26T03:17:37.941 INFO:teuthology.orchestra.run.trial086.stdout: "version": "0'0", 2026-02-26T03:17:37.941 INFO:teuthology.orchestra.run.trial086.stdout: "reported_seq": 0, 2026-02-26T03:17:37.941 INFO:teuthology.orchestra.run.trial086.stdout: "reported_epoch": 0, 2026-02-26T03:17:37.941 INFO:teuthology.orchestra.run.trial086.stdout: "state": "unknown", 2026-02-26T03:17:37.941 INFO:teuthology.orchestra.run.trial086.stdout: "last_fresh": "0.000000", 2026-02-26T03:17:37.941 INFO:teuthology.orchestra.run.trial086.stdout: "last_change": "0.000000", 2026-02-26T03:17:37.941 INFO:teuthology.orchestra.run.trial086.stdout: "last_active": "0.000000", 2026-02-26T03:17:37.941 INFO:teuthology.orchestra.run.trial086.stdout: "last_peered": "0.000000", 2026-02-26T03:17:37.941 INFO:teuthology.orchestra.run.trial086.stdout: "last_clean": "0.000000", 2026-02-26T03:17:37.941 INFO:teuthology.orchestra.run.trial086.stdout: "last_became_active": "0.000000", 2026-02-26T03:17:37.941 INFO:teuthology.orchestra.run.trial086.stdout: "last_became_peered": "0.000000", 2026-02-26T03:17:37.942 INFO:teuthology.orchestra.run.trial086.stdout: "last_unstale": "0.000000", 2026-02-26T03:17:37.942 INFO:teuthology.orchestra.run.trial086.stdout: "last_undegraded": "0.000000", 2026-02-26T03:17:37.942 INFO:teuthology.orchestra.run.trial086.stdout: "last_fullsized": "0.000000", 2026-02-26T03:17:37.942 INFO:teuthology.orchestra.run.trial086.stdout: "mapping_epoch": 0, 2026-02-26T03:17:37.942 INFO:teuthology.orchestra.run.trial086.stdout: "log_start": "0'0", 2026-02-26T03:17:37.942 INFO:teuthology.orchestra.run.trial086.stdout: "ondisk_log_start": "0'0", 2026-02-26T03:17:37.942 INFO:teuthology.orchestra.run.trial086.stdout: "created": 0, 2026-02-26T03:17:37.942 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_clean": 0, 2026-02-26T03:17:37.942 INFO:teuthology.orchestra.run.trial086.stdout: "parent": "0.0", 2026-02-26T03:17:37.942 INFO:teuthology.orchestra.run.trial086.stdout: "parent_split_bits": 0, 2026-02-26T03:17:37.942 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub": "0'0", 2026-02-26T03:17:37.942 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub_stamp": "0.000000", 2026-02-26T03:17:37.943 INFO:teuthology.orchestra.run.trial086.stdout: "last_deep_scrub": "0'0", 2026-02-26T03:17:37.943 INFO:teuthology.orchestra.run.trial086.stdout: "last_deep_scrub_stamp": "0.000000", 2026-02-26T03:17:37.943 INFO:teuthology.orchestra.run.trial086.stdout: "last_clean_scrub_stamp": "0.000000", 2026-02-26T03:17:37.943 INFO:teuthology.orchestra.run.trial086.stdout: "objects_scrubbed": 0, 2026-02-26T03:17:37.943 INFO:teuthology.orchestra.run.trial086.stdout: "log_size": 0, 2026-02-26T03:17:37.943 INFO:teuthology.orchestra.run.trial086.stdout: "log_dups_size": 0, 2026-02-26T03:17:37.943 INFO:teuthology.orchestra.run.trial086.stdout: "ondisk_log_size": 0, 2026-02-26T03:17:37.943 INFO:teuthology.orchestra.run.trial086.stdout: "stats_invalid": false, 2026-02-26T03:17:37.943 INFO:teuthology.orchestra.run.trial086.stdout: "dirty_stats_invalid": false, 2026-02-26T03:17:37.943 INFO:teuthology.orchestra.run.trial086.stdout: "omap_stats_invalid": false, 2026-02-26T03:17:37.943 INFO:teuthology.orchestra.run.trial086.stdout: "hitset_stats_invalid": false, 2026-02-26T03:17:37.943 INFO:teuthology.orchestra.run.trial086.stdout: "hitset_bytes_stats_invalid": false, 2026-02-26T03:17:37.944 INFO:teuthology.orchestra.run.trial086.stdout: "pin_stats_invalid": false, 2026-02-26T03:17:37.944 INFO:teuthology.orchestra.run.trial086.stdout: "manifest_stats_invalid": false, 2026-02-26T03:17:37.944 INFO:teuthology.orchestra.run.trial086.stdout: "snaptrimq_len": 0, 2026-02-26T03:17:37.944 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub_duration": 0, 2026-02-26T03:17:37.944 INFO:teuthology.orchestra.run.trial086.stdout: "scrub_schedule": "--", 2026-02-26T03:17:37.944 INFO:teuthology.orchestra.run.trial086.stdout: "scrub_duration": 0, 2026-02-26T03:17:37.944 INFO:teuthology.orchestra.run.trial086.stdout: "objects_trimmed": 0, 2026-02-26T03:17:37.944 INFO:teuthology.orchestra.run.trial086.stdout: "snaptrim_duration": 0, 2026-02-26T03:17:37.944 INFO:teuthology.orchestra.run.trial086.stdout: "stat_sum": { 2026-02-26T03:17:37.944 INFO:teuthology.orchestra.run.trial086.stdout: "num_bytes": 0, 2026-02-26T03:17:37.944 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects": 0, 2026-02-26T03:17:37.944 INFO:teuthology.orchestra.run.trial086.stdout: "num_object_clones": 0, 2026-02-26T03:17:37.945 INFO:teuthology.orchestra.run.trial086.stdout: "num_object_copies": 0, 2026-02-26T03:17:37.945 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_missing_on_primary": 0, 2026-02-26T03:17:37.945 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_missing": 0, 2026-02-26T03:17:37.945 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_degraded": 0, 2026-02-26T03:17:37.945 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_misplaced": 0, 2026-02-26T03:17:37.945 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_unfound": 0, 2026-02-26T03:17:37.945 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_dirty": 0, 2026-02-26T03:17:37.945 INFO:teuthology.orchestra.run.trial086.stdout: "num_whiteouts": 0, 2026-02-26T03:17:37.945 INFO:teuthology.orchestra.run.trial086.stdout: "num_read": 0, 2026-02-26T03:17:37.945 INFO:teuthology.orchestra.run.trial086.stdout: "num_read_kb": 0, 2026-02-26T03:17:37.945 INFO:teuthology.orchestra.run.trial086.stdout: "num_write": 0, 2026-02-26T03:17:37.945 INFO:teuthology.orchestra.run.trial086.stdout: "num_write_kb": 0, 2026-02-26T03:17:37.946 INFO:teuthology.orchestra.run.trial086.stdout: "num_scrub_errors": 0, 2026-02-26T03:17:37.946 INFO:teuthology.orchestra.run.trial086.stdout: "num_shallow_scrub_errors": 0, 2026-02-26T03:17:37.946 INFO:teuthology.orchestra.run.trial086.stdout: "num_deep_scrub_errors": 0, 2026-02-26T03:17:37.946 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_recovered": 0, 2026-02-26T03:17:37.946 INFO:teuthology.orchestra.run.trial086.stdout: "num_bytes_recovered": 0, 2026-02-26T03:17:37.946 INFO:teuthology.orchestra.run.trial086.stdout: "num_keys_recovered": 0, 2026-02-26T03:17:37.946 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_omap": 0, 2026-02-26T03:17:37.946 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_hit_set_archive": 0, 2026-02-26T03:17:37.946 INFO:teuthology.orchestra.run.trial086.stdout: "num_bytes_hit_set_archive": 0, 2026-02-26T03:17:37.946 INFO:teuthology.orchestra.run.trial086.stdout: "num_flush": 0, 2026-02-26T03:17:37.946 INFO:teuthology.orchestra.run.trial086.stdout: "num_flush_kb": 0, 2026-02-26T03:17:37.946 INFO:teuthology.orchestra.run.trial086.stdout: "num_evict": 0, 2026-02-26T03:17:37.946 INFO:teuthology.orchestra.run.trial086.stdout: "num_evict_kb": 0, 2026-02-26T03:17:37.947 INFO:teuthology.orchestra.run.trial086.stdout: "num_promote": 0, 2026-02-26T03:17:37.947 INFO:teuthology.orchestra.run.trial086.stdout: "num_flush_mode_high": 0, 2026-02-26T03:17:37.947 INFO:teuthology.orchestra.run.trial086.stdout: "num_flush_mode_low": 0, 2026-02-26T03:17:37.947 INFO:teuthology.orchestra.run.trial086.stdout: "num_evict_mode_some": 0, 2026-02-26T03:17:37.947 INFO:teuthology.orchestra.run.trial086.stdout: "num_evict_mode_full": 0, 2026-02-26T03:17:37.947 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_pinned": 0, 2026-02-26T03:17:37.947 INFO:teuthology.orchestra.run.trial086.stdout: "num_legacy_snapsets": 0, 2026-02-26T03:17:37.947 INFO:teuthology.orchestra.run.trial086.stdout: "num_large_omap_objects": 0, 2026-02-26T03:17:37.947 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_manifest": 0, 2026-02-26T03:17:37.947 INFO:teuthology.orchestra.run.trial086.stdout: "num_omap_bytes": 0, 2026-02-26T03:17:37.947 INFO:teuthology.orchestra.run.trial086.stdout: "num_omap_keys": 0, 2026-02-26T03:17:37.947 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_repaired": 0 2026-02-26T03:17:37.947 INFO:teuthology.orchestra.run.trial086.stdout: }, 2026-02-26T03:17:37.947 INFO:teuthology.orchestra.run.trial086.stdout: "up": [], 2026-02-26T03:17:37.948 INFO:teuthology.orchestra.run.trial086.stdout: "acting": [], 2026-02-26T03:17:37.948 INFO:teuthology.orchestra.run.trial086.stdout: "avail_no_missing": [], 2026-02-26T03:17:37.948 INFO:teuthology.orchestra.run.trial086.stdout: "object_location_counts": [], 2026-02-26T03:17:37.948 INFO:teuthology.orchestra.run.trial086.stdout: "blocked_by": [], 2026-02-26T03:17:37.948 INFO:teuthology.orchestra.run.trial086.stdout: "up_primary": -1, 2026-02-26T03:17:37.948 INFO:teuthology.orchestra.run.trial086.stdout: "acting_primary": -1, 2026-02-26T03:17:37.948 INFO:teuthology.orchestra.run.trial086.stdout: "purged_snaps": [] 2026-02-26T03:17:37.948 INFO:teuthology.orchestra.run.trial086.stdout: }, 2026-02-26T03:17:37.948 INFO:teuthology.orchestra.run.trial086.stdout: "empty": 1, 2026-02-26T03:17:37.948 INFO:teuthology.orchestra.run.trial086.stdout: "dne": 1, 2026-02-26T03:17:37.948 INFO:teuthology.orchestra.run.trial086.stdout: "incomplete": 0, 2026-02-26T03:17:37.948 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_started": 0, 2026-02-26T03:17:37.948 INFO:teuthology.orchestra.run.trial086.stdout: "hit_set_history": { 2026-02-26T03:17:37.948 INFO:teuthology.orchestra.run.trial086.stdout: "current_last_update": "0'0", 2026-02-26T03:17:37.949 INFO:teuthology.orchestra.run.trial086.stdout: "history": [] 2026-02-26T03:17:37.949 INFO:teuthology.orchestra.run.trial086.stdout: } 2026-02-26T03:17:37.949 INFO:teuthology.orchestra.run.trial086.stdout:} 2026-02-26T03:17:39.445 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:17:39.445 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:17:39.445 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:17:39.445 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:17:39.445 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:17:39.445 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:17:39.475 DEBUG:teuthology.orchestra.run.trial086:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-2 --device-type SSD --op info --pgid 3.3 2026-02-26T03:17:39.618 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:39,616 seastar - Reactor backend: linux-aio 2026-02-26T03:17:39.630 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:39,628 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:17:39.630 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:39,628 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:17:39.633 INFO:teuthology.orchestra.run.trial086.stderr:==46200==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:17:40.074 INFO:teuthology.orchestra.run.trial086.stdout:object name is empty, use pgmeta oid 2026-02-26T03:17:40.074 INFO:teuthology.orchestra.run.trial086.stdout:{ 2026-02-26T03:17:40.075 INFO:teuthology.orchestra.run.trial086.stdout: "pgid": "3.3", 2026-02-26T03:17:40.075 INFO:teuthology.orchestra.run.trial086.stdout: "shard": "255", 2026-02-26T03:17:40.075 INFO:teuthology.orchestra.run.trial086.stdout: "last_update": "0'0", 2026-02-26T03:17:40.075 INFO:teuthology.orchestra.run.trial086.stdout: "last_complete": "0'0", 2026-02-26T03:17:40.075 INFO:teuthology.orchestra.run.trial086.stdout: "log_tail": "0'0", 2026-02-26T03:17:40.075 INFO:teuthology.orchestra.run.trial086.stdout: "last_user_version": 0, 2026-02-26T03:17:40.075 INFO:teuthology.orchestra.run.trial086.stdout: "last_backfill": "MAX", 2026-02-26T03:17:40.075 INFO:teuthology.orchestra.run.trial086.stdout: "partial_writes_last_complete": [], 2026-02-26T03:17:40.075 INFO:teuthology.orchestra.run.trial086.stdout: "partial_writes_last_complete_epoch": "0", 2026-02-26T03:17:40.076 INFO:teuthology.orchestra.run.trial086.stdout: "purged_snaps": [], 2026-02-26T03:17:40.076 INFO:teuthology.orchestra.run.trial086.stdout: "history": { 2026-02-26T03:17:40.076 INFO:teuthology.orchestra.run.trial086.stdout: "epoch_created": 0, 2026-02-26T03:17:40.076 INFO:teuthology.orchestra.run.trial086.stdout: "epoch_pool_created": 0, 2026-02-26T03:17:40.076 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_started": 0, 2026-02-26T03:17:40.076 INFO:teuthology.orchestra.run.trial086.stdout: "last_interval_started": 0, 2026-02-26T03:17:40.076 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_clean": 0, 2026-02-26T03:17:40.076 INFO:teuthology.orchestra.run.trial086.stdout: "last_interval_clean": 0, 2026-02-26T03:17:40.076 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_split": 0, 2026-02-26T03:17:40.076 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_marked_full": 0, 2026-02-26T03:17:40.077 INFO:teuthology.orchestra.run.trial086.stdout: "same_up_since": 0, 2026-02-26T03:17:40.077 INFO:teuthology.orchestra.run.trial086.stdout: "same_interval_since": 0, 2026-02-26T03:17:40.077 INFO:teuthology.orchestra.run.trial086.stdout: "same_primary_since": 0, 2026-02-26T03:17:40.077 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub": "0'0", 2026-02-26T03:17:40.077 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub_stamp": "0.000000", 2026-02-26T03:17:40.077 INFO:teuthology.orchestra.run.trial086.stdout: "last_deep_scrub": "0'0", 2026-02-26T03:17:40.077 INFO:teuthology.orchestra.run.trial086.stdout: "last_deep_scrub_stamp": "0.000000", 2026-02-26T03:17:40.077 INFO:teuthology.orchestra.run.trial086.stdout: "last_clean_scrub_stamp": "0.000000", 2026-02-26T03:17:40.077 INFO:teuthology.orchestra.run.trial086.stdout: "prior_readable_until_ub": 0 2026-02-26T03:17:40.077 INFO:teuthology.orchestra.run.trial086.stdout: }, 2026-02-26T03:17:40.078 INFO:teuthology.orchestra.run.trial086.stdout: "stats": { 2026-02-26T03:17:40.078 INFO:teuthology.orchestra.run.trial086.stdout: "version": "0'0", 2026-02-26T03:17:40.078 INFO:teuthology.orchestra.run.trial086.stdout: "reported_seq": 0, 2026-02-26T03:17:40.078 INFO:teuthology.orchestra.run.trial086.stdout: "reported_epoch": 0, 2026-02-26T03:17:40.078 INFO:teuthology.orchestra.run.trial086.stdout: "state": "unknown", 2026-02-26T03:17:40.078 INFO:teuthology.orchestra.run.trial086.stdout: "last_fresh": "0.000000", 2026-02-26T03:17:40.078 INFO:teuthology.orchestra.run.trial086.stdout: "last_change": "0.000000", 2026-02-26T03:17:40.078 INFO:teuthology.orchestra.run.trial086.stdout: "last_active": "0.000000", 2026-02-26T03:17:40.078 INFO:teuthology.orchestra.run.trial086.stdout: "last_peered": "0.000000", 2026-02-26T03:17:40.078 INFO:teuthology.orchestra.run.trial086.stdout: "last_clean": "0.000000", 2026-02-26T03:17:40.078 INFO:teuthology.orchestra.run.trial086.stdout: "last_became_active": "0.000000", 2026-02-26T03:17:40.079 INFO:teuthology.orchestra.run.trial086.stdout: "last_became_peered": "0.000000", 2026-02-26T03:17:40.079 INFO:teuthology.orchestra.run.trial086.stdout: "last_unstale": "0.000000", 2026-02-26T03:17:40.079 INFO:teuthology.orchestra.run.trial086.stdout: "last_undegraded": "0.000000", 2026-02-26T03:17:40.079 INFO:teuthology.orchestra.run.trial086.stdout: "last_fullsized": "0.000000", 2026-02-26T03:17:40.079 INFO:teuthology.orchestra.run.trial086.stdout: "mapping_epoch": 0, 2026-02-26T03:17:40.079 INFO:teuthology.orchestra.run.trial086.stdout: "log_start": "0'0", 2026-02-26T03:17:40.079 INFO:teuthology.orchestra.run.trial086.stdout: "ondisk_log_start": "0'0", 2026-02-26T03:17:40.079 INFO:teuthology.orchestra.run.trial086.stdout: "created": 0, 2026-02-26T03:17:40.079 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_clean": 0, 2026-02-26T03:17:40.079 INFO:teuthology.orchestra.run.trial086.stdout: "parent": "0.0", 2026-02-26T03:17:40.080 INFO:teuthology.orchestra.run.trial086.stdout: "parent_split_bits": 0, 2026-02-26T03:17:40.080 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub": "0'0", 2026-02-26T03:17:40.080 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub_stamp": "0.000000", 2026-02-26T03:17:40.080 INFO:teuthology.orchestra.run.trial086.stdout: "last_deep_scrub": "0'0", 2026-02-26T03:17:40.080 INFO:teuthology.orchestra.run.trial086.stdout: "last_deep_scrub_stamp": "0.000000", 2026-02-26T03:17:40.080 INFO:teuthology.orchestra.run.trial086.stdout: "last_clean_scrub_stamp": "0.000000", 2026-02-26T03:17:40.080 INFO:teuthology.orchestra.run.trial086.stdout: "objects_scrubbed": 0, 2026-02-26T03:17:40.080 INFO:teuthology.orchestra.run.trial086.stdout: "log_size": 0, 2026-02-26T03:17:40.080 INFO:teuthology.orchestra.run.trial086.stdout: "log_dups_size": 0, 2026-02-26T03:17:40.080 INFO:teuthology.orchestra.run.trial086.stdout: "ondisk_log_size": 0, 2026-02-26T03:17:40.080 INFO:teuthology.orchestra.run.trial086.stdout: "stats_invalid": false, 2026-02-26T03:17:40.081 INFO:teuthology.orchestra.run.trial086.stdout: "dirty_stats_invalid": false, 2026-02-26T03:17:40.081 INFO:teuthology.orchestra.run.trial086.stdout: "omap_stats_invalid": false, 2026-02-26T03:17:40.081 INFO:teuthology.orchestra.run.trial086.stdout: "hitset_stats_invalid": false, 2026-02-26T03:17:40.081 INFO:teuthology.orchestra.run.trial086.stdout: "hitset_bytes_stats_invalid": false, 2026-02-26T03:17:40.081 INFO:teuthology.orchestra.run.trial086.stdout: "pin_stats_invalid": false, 2026-02-26T03:17:40.081 INFO:teuthology.orchestra.run.trial086.stdout: "manifest_stats_invalid": false, 2026-02-26T03:17:40.081 INFO:teuthology.orchestra.run.trial086.stdout: "snaptrimq_len": 0, 2026-02-26T03:17:40.081 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub_duration": 0, 2026-02-26T03:17:40.081 INFO:teuthology.orchestra.run.trial086.stdout: "scrub_schedule": "--", 2026-02-26T03:17:40.081 INFO:teuthology.orchestra.run.trial086.stdout: "scrub_duration": 0, 2026-02-26T03:17:40.081 INFO:teuthology.orchestra.run.trial086.stdout: "objects_trimmed": 0, 2026-02-26T03:17:40.082 INFO:teuthology.orchestra.run.trial086.stdout: "snaptrim_duration": 0, 2026-02-26T03:17:40.082 INFO:teuthology.orchestra.run.trial086.stdout: "stat_sum": { 2026-02-26T03:17:40.082 INFO:teuthology.orchestra.run.trial086.stdout: "num_bytes": 0, 2026-02-26T03:17:40.082 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects": 0, 2026-02-26T03:17:40.082 INFO:teuthology.orchestra.run.trial086.stdout: "num_object_clones": 0, 2026-02-26T03:17:40.082 INFO:teuthology.orchestra.run.trial086.stdout: "num_object_copies": 0, 2026-02-26T03:17:40.082 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_missing_on_primary": 0, 2026-02-26T03:17:40.082 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_missing": 0, 2026-02-26T03:17:40.082 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_degraded": 0, 2026-02-26T03:17:40.082 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_misplaced": 0, 2026-02-26T03:17:40.082 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_unfound": 0, 2026-02-26T03:17:40.083 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_dirty": 0, 2026-02-26T03:17:40.083 INFO:teuthology.orchestra.run.trial086.stdout: "num_whiteouts": 0, 2026-02-26T03:17:40.083 INFO:teuthology.orchestra.run.trial086.stdout: "num_read": 0, 2026-02-26T03:17:40.083 INFO:teuthology.orchestra.run.trial086.stdout: "num_read_kb": 0, 2026-02-26T03:17:40.083 INFO:teuthology.orchestra.run.trial086.stdout: "num_write": 0, 2026-02-26T03:17:40.083 INFO:teuthology.orchestra.run.trial086.stdout: "num_write_kb": 0, 2026-02-26T03:17:40.083 INFO:teuthology.orchestra.run.trial086.stdout: "num_scrub_errors": 0, 2026-02-26T03:17:40.083 INFO:teuthology.orchestra.run.trial086.stdout: "num_shallow_scrub_errors": 0, 2026-02-26T03:17:40.083 INFO:teuthology.orchestra.run.trial086.stdout: "num_deep_scrub_errors": 0, 2026-02-26T03:17:40.083 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_recovered": 0, 2026-02-26T03:17:40.083 INFO:teuthology.orchestra.run.trial086.stdout: "num_bytes_recovered": 0, 2026-02-26T03:17:40.084 INFO:teuthology.orchestra.run.trial086.stdout: "num_keys_recovered": 0, 2026-02-26T03:17:40.084 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_omap": 0, 2026-02-26T03:17:40.084 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_hit_set_archive": 0, 2026-02-26T03:17:40.084 INFO:teuthology.orchestra.run.trial086.stdout: "num_bytes_hit_set_archive": 0, 2026-02-26T03:17:40.084 INFO:teuthology.orchestra.run.trial086.stdout: "num_flush": 0, 2026-02-26T03:17:40.084 INFO:teuthology.orchestra.run.trial086.stdout: "num_flush_kb": 0, 2026-02-26T03:17:40.084 INFO:teuthology.orchestra.run.trial086.stdout: "num_evict": 0, 2026-02-26T03:17:40.084 INFO:teuthology.orchestra.run.trial086.stdout: "num_evict_kb": 0, 2026-02-26T03:17:40.084 INFO:teuthology.orchestra.run.trial086.stdout: "num_promote": 0, 2026-02-26T03:17:40.084 INFO:teuthology.orchestra.run.trial086.stdout: "num_flush_mode_high": 0, 2026-02-26T03:17:40.084 INFO:teuthology.orchestra.run.trial086.stdout: "num_flush_mode_low": 0, 2026-02-26T03:17:40.085 INFO:teuthology.orchestra.run.trial086.stdout: "num_evict_mode_some": 0, 2026-02-26T03:17:40.085 INFO:teuthology.orchestra.run.trial086.stdout: "num_evict_mode_full": 0, 2026-02-26T03:17:40.085 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_pinned": 0, 2026-02-26T03:17:40.085 INFO:teuthology.orchestra.run.trial086.stdout: "num_legacy_snapsets": 0, 2026-02-26T03:17:40.085 INFO:teuthology.orchestra.run.trial086.stdout: "num_large_omap_objects": 0, 2026-02-26T03:17:40.085 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_manifest": 0, 2026-02-26T03:17:40.085 INFO:teuthology.orchestra.run.trial086.stdout: "num_omap_bytes": 0, 2026-02-26T03:17:40.085 INFO:teuthology.orchestra.run.trial086.stdout: "num_omap_keys": 0, 2026-02-26T03:17:40.085 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_repaired": 0 2026-02-26T03:17:40.086 INFO:teuthology.orchestra.run.trial086.stdout: }, 2026-02-26T03:17:40.086 INFO:teuthology.orchestra.run.trial086.stdout: "up": [], 2026-02-26T03:17:40.086 INFO:teuthology.orchestra.run.trial086.stdout: "acting": [], 2026-02-26T03:17:40.086 INFO:teuthology.orchestra.run.trial086.stdout: "avail_no_missing": [], 2026-02-26T03:17:40.086 INFO:teuthology.orchestra.run.trial086.stdout: "object_location_counts": [], 2026-02-26T03:17:40.086 INFO:teuthology.orchestra.run.trial086.stdout: "blocked_by": [], 2026-02-26T03:17:40.086 INFO:teuthology.orchestra.run.trial086.stdout: "up_primary": -1, 2026-02-26T03:17:40.086 INFO:teuthology.orchestra.run.trial086.stdout: "acting_primary": -1, 2026-02-26T03:17:40.086 INFO:teuthology.orchestra.run.trial086.stdout: "purged_snaps": [] 2026-02-26T03:17:40.086 INFO:teuthology.orchestra.run.trial086.stdout: }, 2026-02-26T03:17:40.086 INFO:teuthology.orchestra.run.trial086.stdout: "empty": 1, 2026-02-26T03:17:40.087 INFO:teuthology.orchestra.run.trial086.stdout: "dne": 1, 2026-02-26T03:17:40.087 INFO:teuthology.orchestra.run.trial086.stdout: "incomplete": 0, 2026-02-26T03:17:40.087 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_started": 0, 2026-02-26T03:17:40.087 INFO:teuthology.orchestra.run.trial086.stdout: "hit_set_history": { 2026-02-26T03:17:40.087 INFO:teuthology.orchestra.run.trial086.stdout: "current_last_update": "0'0", 2026-02-26T03:17:40.087 INFO:teuthology.orchestra.run.trial086.stdout: "history": [] 2026-02-26T03:17:40.087 INFO:teuthology.orchestra.run.trial086.stdout: } 2026-02-26T03:17:40.087 INFO:teuthology.orchestra.run.trial086.stdout:} 2026-02-26T03:17:41.572 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:17:41.572 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:17:41.572 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:17:41.572 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:17:41.572 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:17:41.572 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:17:41.603 DEBUG:teuthology.orchestra.run.trial086:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-3 --device-type SSD --op info --pgid 3.2 2026-02-26T03:17:41.745 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:41,742 seastar - Reactor backend: linux-aio 2026-02-26T03:17:41.755 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:41,753 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:17:41.755 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:41,753 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:17:41.758 INFO:teuthology.orchestra.run.trial086.stderr:==46231==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:17:42.193 INFO:teuthology.orchestra.run.trial086.stdout:object name is empty, use pgmeta oid 2026-02-26T03:17:42.193 INFO:teuthology.orchestra.run.trial086.stdout:{ 2026-02-26T03:17:42.193 INFO:teuthology.orchestra.run.trial086.stdout: "pgid": "3.2", 2026-02-26T03:17:42.193 INFO:teuthology.orchestra.run.trial086.stdout: "shard": "255", 2026-02-26T03:17:42.193 INFO:teuthology.orchestra.run.trial086.stdout: "last_update": "0'0", 2026-02-26T03:17:42.193 INFO:teuthology.orchestra.run.trial086.stdout: "last_complete": "0'0", 2026-02-26T03:17:42.193 INFO:teuthology.orchestra.run.trial086.stdout: "log_tail": "0'0", 2026-02-26T03:17:42.193 INFO:teuthology.orchestra.run.trial086.stdout: "last_user_version": 0, 2026-02-26T03:17:42.193 INFO:teuthology.orchestra.run.trial086.stdout: "last_backfill": "MAX", 2026-02-26T03:17:42.193 INFO:teuthology.orchestra.run.trial086.stdout: "partial_writes_last_complete": [], 2026-02-26T03:17:42.194 INFO:teuthology.orchestra.run.trial086.stdout: "partial_writes_last_complete_epoch": "0", 2026-02-26T03:17:42.194 INFO:teuthology.orchestra.run.trial086.stdout: "purged_snaps": [], 2026-02-26T03:17:42.194 INFO:teuthology.orchestra.run.trial086.stdout: "history": { 2026-02-26T03:17:42.194 INFO:teuthology.orchestra.run.trial086.stdout: "epoch_created": 0, 2026-02-26T03:17:42.194 INFO:teuthology.orchestra.run.trial086.stdout: "epoch_pool_created": 0, 2026-02-26T03:17:42.194 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_started": 0, 2026-02-26T03:17:42.194 INFO:teuthology.orchestra.run.trial086.stdout: "last_interval_started": 0, 2026-02-26T03:17:42.194 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_clean": 0, 2026-02-26T03:17:42.194 INFO:teuthology.orchestra.run.trial086.stdout: "last_interval_clean": 0, 2026-02-26T03:17:42.194 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_split": 0, 2026-02-26T03:17:42.194 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_marked_full": 0, 2026-02-26T03:17:42.194 INFO:teuthology.orchestra.run.trial086.stdout: "same_up_since": 0, 2026-02-26T03:17:42.194 INFO:teuthology.orchestra.run.trial086.stdout: "same_interval_since": 0, 2026-02-26T03:17:42.194 INFO:teuthology.orchestra.run.trial086.stdout: "same_primary_since": 0, 2026-02-26T03:17:42.194 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub": "0'0", 2026-02-26T03:17:42.194 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub_stamp": "0.000000", 2026-02-26T03:17:42.194 INFO:teuthology.orchestra.run.trial086.stdout: "last_deep_scrub": "0'0", 2026-02-26T03:17:42.194 INFO:teuthology.orchestra.run.trial086.stdout: "last_deep_scrub_stamp": "0.000000", 2026-02-26T03:17:42.194 INFO:teuthology.orchestra.run.trial086.stdout: "last_clean_scrub_stamp": "0.000000", 2026-02-26T03:17:42.194 INFO:teuthology.orchestra.run.trial086.stdout: "prior_readable_until_ub": 0 2026-02-26T03:17:42.194 INFO:teuthology.orchestra.run.trial086.stdout: }, 2026-02-26T03:17:42.194 INFO:teuthology.orchestra.run.trial086.stdout: "stats": { 2026-02-26T03:17:42.194 INFO:teuthology.orchestra.run.trial086.stdout: "version": "0'0", 2026-02-26T03:17:42.194 INFO:teuthology.orchestra.run.trial086.stdout: "reported_seq": 0, 2026-02-26T03:17:42.194 INFO:teuthology.orchestra.run.trial086.stdout: "reported_epoch": 0, 2026-02-26T03:17:42.194 INFO:teuthology.orchestra.run.trial086.stdout: "state": "unknown", 2026-02-26T03:17:42.194 INFO:teuthology.orchestra.run.trial086.stdout: "last_fresh": "0.000000", 2026-02-26T03:17:42.194 INFO:teuthology.orchestra.run.trial086.stdout: "last_change": "0.000000", 2026-02-26T03:17:42.195 INFO:teuthology.orchestra.run.trial086.stdout: "last_active": "0.000000", 2026-02-26T03:17:42.195 INFO:teuthology.orchestra.run.trial086.stdout: "last_peered": "0.000000", 2026-02-26T03:17:42.195 INFO:teuthology.orchestra.run.trial086.stdout: "last_clean": "0.000000", 2026-02-26T03:17:42.195 INFO:teuthology.orchestra.run.trial086.stdout: "last_became_active": "0.000000", 2026-02-26T03:17:42.195 INFO:teuthology.orchestra.run.trial086.stdout: "last_became_peered": "0.000000", 2026-02-26T03:17:42.195 INFO:teuthology.orchestra.run.trial086.stdout: "last_unstale": "0.000000", 2026-02-26T03:17:42.195 INFO:teuthology.orchestra.run.trial086.stdout: "last_undegraded": "0.000000", 2026-02-26T03:17:42.195 INFO:teuthology.orchestra.run.trial086.stdout: "last_fullsized": "0.000000", 2026-02-26T03:17:42.195 INFO:teuthology.orchestra.run.trial086.stdout: "mapping_epoch": 0, 2026-02-26T03:17:42.195 INFO:teuthology.orchestra.run.trial086.stdout: "log_start": "0'0", 2026-02-26T03:17:42.195 INFO:teuthology.orchestra.run.trial086.stdout: "ondisk_log_start": "0'0", 2026-02-26T03:17:42.195 INFO:teuthology.orchestra.run.trial086.stdout: "created": 0, 2026-02-26T03:17:42.195 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_clean": 0, 2026-02-26T03:17:42.195 INFO:teuthology.orchestra.run.trial086.stdout: "parent": "0.0", 2026-02-26T03:17:42.195 INFO:teuthology.orchestra.run.trial086.stdout: "parent_split_bits": 0, 2026-02-26T03:17:42.195 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub": "0'0", 2026-02-26T03:17:42.195 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub_stamp": "0.000000", 2026-02-26T03:17:42.195 INFO:teuthology.orchestra.run.trial086.stdout: "last_deep_scrub": "0'0", 2026-02-26T03:17:42.195 INFO:teuthology.orchestra.run.trial086.stdout: "last_deep_scrub_stamp": "0.000000", 2026-02-26T03:17:42.195 INFO:teuthology.orchestra.run.trial086.stdout: "last_clean_scrub_stamp": "0.000000", 2026-02-26T03:17:42.195 INFO:teuthology.orchestra.run.trial086.stdout: "objects_scrubbed": 0, 2026-02-26T03:17:42.195 INFO:teuthology.orchestra.run.trial086.stdout: "log_size": 0, 2026-02-26T03:17:42.195 INFO:teuthology.orchestra.run.trial086.stdout: "log_dups_size": 0, 2026-02-26T03:17:42.195 INFO:teuthology.orchestra.run.trial086.stdout: "ondisk_log_size": 0, 2026-02-26T03:17:42.195 INFO:teuthology.orchestra.run.trial086.stdout: "stats_invalid": false, 2026-02-26T03:17:42.195 INFO:teuthology.orchestra.run.trial086.stdout: "dirty_stats_invalid": false, 2026-02-26T03:17:42.195 INFO:teuthology.orchestra.run.trial086.stdout: "omap_stats_invalid": false, 2026-02-26T03:17:42.195 INFO:teuthology.orchestra.run.trial086.stdout: "hitset_stats_invalid": false, 2026-02-26T03:17:42.195 INFO:teuthology.orchestra.run.trial086.stdout: "hitset_bytes_stats_invalid": false, 2026-02-26T03:17:42.196 INFO:teuthology.orchestra.run.trial086.stdout: "pin_stats_invalid": false, 2026-02-26T03:17:42.196 INFO:teuthology.orchestra.run.trial086.stdout: "manifest_stats_invalid": false, 2026-02-26T03:17:42.196 INFO:teuthology.orchestra.run.trial086.stdout: "snaptrimq_len": 0, 2026-02-26T03:17:42.196 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub_duration": 0, 2026-02-26T03:17:42.196 INFO:teuthology.orchestra.run.trial086.stdout: "scrub_schedule": "--", 2026-02-26T03:17:42.196 INFO:teuthology.orchestra.run.trial086.stdout: "scrub_duration": 0, 2026-02-26T03:17:42.196 INFO:teuthology.orchestra.run.trial086.stdout: "objects_trimmed": 0, 2026-02-26T03:17:42.196 INFO:teuthology.orchestra.run.trial086.stdout: "snaptrim_duration": 0, 2026-02-26T03:17:42.196 INFO:teuthology.orchestra.run.trial086.stdout: "stat_sum": { 2026-02-26T03:17:42.196 INFO:teuthology.orchestra.run.trial086.stdout: "num_bytes": 0, 2026-02-26T03:17:42.196 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects": 0, 2026-02-26T03:17:42.196 INFO:teuthology.orchestra.run.trial086.stdout: "num_object_clones": 0, 2026-02-26T03:17:42.196 INFO:teuthology.orchestra.run.trial086.stdout: "num_object_copies": 0, 2026-02-26T03:17:42.196 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_missing_on_primary": 0, 2026-02-26T03:17:42.196 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_missing": 0, 2026-02-26T03:17:42.196 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_degraded": 0, 2026-02-26T03:17:42.196 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_misplaced": 0, 2026-02-26T03:17:42.196 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_unfound": 0, 2026-02-26T03:17:42.196 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_dirty": 0, 2026-02-26T03:17:42.196 INFO:teuthology.orchestra.run.trial086.stdout: "num_whiteouts": 0, 2026-02-26T03:17:42.196 INFO:teuthology.orchestra.run.trial086.stdout: "num_read": 0, 2026-02-26T03:17:42.196 INFO:teuthology.orchestra.run.trial086.stdout: "num_read_kb": 0, 2026-02-26T03:17:42.196 INFO:teuthology.orchestra.run.trial086.stdout: "num_write": 0, 2026-02-26T03:17:42.196 INFO:teuthology.orchestra.run.trial086.stdout: "num_write_kb": 0, 2026-02-26T03:17:42.196 INFO:teuthology.orchestra.run.trial086.stdout: "num_scrub_errors": 0, 2026-02-26T03:17:42.196 INFO:teuthology.orchestra.run.trial086.stdout: "num_shallow_scrub_errors": 0, 2026-02-26T03:17:42.196 INFO:teuthology.orchestra.run.trial086.stdout: "num_deep_scrub_errors": 0, 2026-02-26T03:17:42.196 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_recovered": 0, 2026-02-26T03:17:42.196 INFO:teuthology.orchestra.run.trial086.stdout: "num_bytes_recovered": 0, 2026-02-26T03:17:42.196 INFO:teuthology.orchestra.run.trial086.stdout: "num_keys_recovered": 0, 2026-02-26T03:17:42.197 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_omap": 0, 2026-02-26T03:17:42.197 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_hit_set_archive": 0, 2026-02-26T03:17:42.197 INFO:teuthology.orchestra.run.trial086.stdout: "num_bytes_hit_set_archive": 0, 2026-02-26T03:17:42.197 INFO:teuthology.orchestra.run.trial086.stdout: "num_flush": 0, 2026-02-26T03:17:42.197 INFO:teuthology.orchestra.run.trial086.stdout: "num_flush_kb": 0, 2026-02-26T03:17:42.197 INFO:teuthology.orchestra.run.trial086.stdout: "num_evict": 0, 2026-02-26T03:17:42.197 INFO:teuthology.orchestra.run.trial086.stdout: "num_evict_kb": 0, 2026-02-26T03:17:42.197 INFO:teuthology.orchestra.run.trial086.stdout: "num_promote": 0, 2026-02-26T03:17:42.197 INFO:teuthology.orchestra.run.trial086.stdout: "num_flush_mode_high": 0, 2026-02-26T03:17:42.197 INFO:teuthology.orchestra.run.trial086.stdout: "num_flush_mode_low": 0, 2026-02-26T03:17:42.197 INFO:teuthology.orchestra.run.trial086.stdout: "num_evict_mode_some": 0, 2026-02-26T03:17:42.197 INFO:teuthology.orchestra.run.trial086.stdout: "num_evict_mode_full": 0, 2026-02-26T03:17:42.197 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_pinned": 0, 2026-02-26T03:17:42.197 INFO:teuthology.orchestra.run.trial086.stdout: "num_legacy_snapsets": 0, 2026-02-26T03:17:42.197 INFO:teuthology.orchestra.run.trial086.stdout: "num_large_omap_objects": 0, 2026-02-26T03:17:42.197 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_manifest": 0, 2026-02-26T03:17:42.197 INFO:teuthology.orchestra.run.trial086.stdout: "num_omap_bytes": 0, 2026-02-26T03:17:42.197 INFO:teuthology.orchestra.run.trial086.stdout: "num_omap_keys": 0, 2026-02-26T03:17:42.197 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_repaired": 0 2026-02-26T03:17:42.197 INFO:teuthology.orchestra.run.trial086.stdout: }, 2026-02-26T03:17:42.197 INFO:teuthology.orchestra.run.trial086.stdout: "up": [], 2026-02-26T03:17:42.197 INFO:teuthology.orchestra.run.trial086.stdout: "acting": [], 2026-02-26T03:17:42.197 INFO:teuthology.orchestra.run.trial086.stdout: "avail_no_missing": [], 2026-02-26T03:17:42.197 INFO:teuthology.orchestra.run.trial086.stdout: "object_location_counts": [], 2026-02-26T03:17:42.197 INFO:teuthology.orchestra.run.trial086.stdout: "blocked_by": [], 2026-02-26T03:17:42.197 INFO:teuthology.orchestra.run.trial086.stdout: "up_primary": -1, 2026-02-26T03:17:42.197 INFO:teuthology.orchestra.run.trial086.stdout: "acting_primary": -1, 2026-02-26T03:17:42.197 INFO:teuthology.orchestra.run.trial086.stdout: "purged_snaps": [] 2026-02-26T03:17:42.198 INFO:teuthology.orchestra.run.trial086.stdout: }, 2026-02-26T03:17:42.198 INFO:teuthology.orchestra.run.trial086.stdout: "empty": 1, 2026-02-26T03:17:42.198 INFO:teuthology.orchestra.run.trial086.stdout: "dne": 1, 2026-02-26T03:17:42.198 INFO:teuthology.orchestra.run.trial086.stdout: "incomplete": 0, 2026-02-26T03:17:42.198 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_started": 0, 2026-02-26T03:17:42.198 INFO:teuthology.orchestra.run.trial086.stdout: "hit_set_history": { 2026-02-26T03:17:42.198 INFO:teuthology.orchestra.run.trial086.stdout: "current_last_update": "0'0", 2026-02-26T03:17:42.198 INFO:teuthology.orchestra.run.trial086.stdout: "history": [] 2026-02-26T03:17:42.198 INFO:teuthology.orchestra.run.trial086.stdout: } 2026-02-26T03:17:42.198 INFO:teuthology.orchestra.run.trial086.stdout:} 2026-02-26T03:17:43.704 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:17:43.704 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:17:43.704 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:17:43.704 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:17:43.704 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:17:43.705 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:17:43.731 DEBUG:teuthology.orchestra.run.trial086:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-3 --device-type SSD --op info --pgid 3.7 2026-02-26T03:17:43.883 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:43,881 seastar - Reactor backend: linux-aio 2026-02-26T03:17:43.895 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:43,893 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:17:43.895 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-26 03:17:43,893 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-26T03:17:43.898 INFO:teuthology.orchestra.run.trial086.stderr:==46262==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-26T03:17:44.315 INFO:teuthology.orchestra.run.trial086.stdout:object name is empty, use pgmeta oid 2026-02-26T03:17:44.315 INFO:teuthology.orchestra.run.trial086.stdout:{ 2026-02-26T03:17:44.315 INFO:teuthology.orchestra.run.trial086.stdout: "pgid": "3.7", 2026-02-26T03:17:44.315 INFO:teuthology.orchestra.run.trial086.stdout: "shard": "255", 2026-02-26T03:17:44.315 INFO:teuthology.orchestra.run.trial086.stdout: "last_update": "0'0", 2026-02-26T03:17:44.315 INFO:teuthology.orchestra.run.trial086.stdout: "last_complete": "0'0", 2026-02-26T03:17:44.315 INFO:teuthology.orchestra.run.trial086.stdout: "log_tail": "0'0", 2026-02-26T03:17:44.315 INFO:teuthology.orchestra.run.trial086.stdout: "last_user_version": 0, 2026-02-26T03:17:44.315 INFO:teuthology.orchestra.run.trial086.stdout: "last_backfill": "MAX", 2026-02-26T03:17:44.315 INFO:teuthology.orchestra.run.trial086.stdout: "partial_writes_last_complete": [], 2026-02-26T03:17:44.315 INFO:teuthology.orchestra.run.trial086.stdout: "partial_writes_last_complete_epoch": "0", 2026-02-26T03:17:44.316 INFO:teuthology.orchestra.run.trial086.stdout: "purged_snaps": [], 2026-02-26T03:17:44.316 INFO:teuthology.orchestra.run.trial086.stdout: "history": { 2026-02-26T03:17:44.316 INFO:teuthology.orchestra.run.trial086.stdout: "epoch_created": 0, 2026-02-26T03:17:44.316 INFO:teuthology.orchestra.run.trial086.stdout: "epoch_pool_created": 0, 2026-02-26T03:17:44.316 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_started": 0, 2026-02-26T03:17:44.316 INFO:teuthology.orchestra.run.trial086.stdout: "last_interval_started": 0, 2026-02-26T03:17:44.316 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_clean": 0, 2026-02-26T03:17:44.316 INFO:teuthology.orchestra.run.trial086.stdout: "last_interval_clean": 0, 2026-02-26T03:17:44.316 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_split": 0, 2026-02-26T03:17:44.316 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_marked_full": 0, 2026-02-26T03:17:44.316 INFO:teuthology.orchestra.run.trial086.stdout: "same_up_since": 0, 2026-02-26T03:17:44.316 INFO:teuthology.orchestra.run.trial086.stdout: "same_interval_since": 0, 2026-02-26T03:17:44.316 INFO:teuthology.orchestra.run.trial086.stdout: "same_primary_since": 0, 2026-02-26T03:17:44.316 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub": "0'0", 2026-02-26T03:17:44.316 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub_stamp": "0.000000", 2026-02-26T03:17:44.316 INFO:teuthology.orchestra.run.trial086.stdout: "last_deep_scrub": "0'0", 2026-02-26T03:17:44.316 INFO:teuthology.orchestra.run.trial086.stdout: "last_deep_scrub_stamp": "0.000000", 2026-02-26T03:17:44.316 INFO:teuthology.orchestra.run.trial086.stdout: "last_clean_scrub_stamp": "0.000000", 2026-02-26T03:17:44.316 INFO:teuthology.orchestra.run.trial086.stdout: "prior_readable_until_ub": 0 2026-02-26T03:17:44.316 INFO:teuthology.orchestra.run.trial086.stdout: }, 2026-02-26T03:17:44.316 INFO:teuthology.orchestra.run.trial086.stdout: "stats": { 2026-02-26T03:17:44.317 INFO:teuthology.orchestra.run.trial086.stdout: "version": "0'0", 2026-02-26T03:17:44.317 INFO:teuthology.orchestra.run.trial086.stdout: "reported_seq": 0, 2026-02-26T03:17:44.317 INFO:teuthology.orchestra.run.trial086.stdout: "reported_epoch": 0, 2026-02-26T03:17:44.317 INFO:teuthology.orchestra.run.trial086.stdout: "state": "unknown", 2026-02-26T03:17:44.317 INFO:teuthology.orchestra.run.trial086.stdout: "last_fresh": "0.000000", 2026-02-26T03:17:44.317 INFO:teuthology.orchestra.run.trial086.stdout: "last_change": "0.000000", 2026-02-26T03:17:44.317 INFO:teuthology.orchestra.run.trial086.stdout: "last_active": "0.000000", 2026-02-26T03:17:44.317 INFO:teuthology.orchestra.run.trial086.stdout: "last_peered": "0.000000", 2026-02-26T03:17:44.317 INFO:teuthology.orchestra.run.trial086.stdout: "last_clean": "0.000000", 2026-02-26T03:17:44.317 INFO:teuthology.orchestra.run.trial086.stdout: "last_became_active": "0.000000", 2026-02-26T03:17:44.317 INFO:teuthology.orchestra.run.trial086.stdout: "last_became_peered": "0.000000", 2026-02-26T03:17:44.317 INFO:teuthology.orchestra.run.trial086.stdout: "last_unstale": "0.000000", 2026-02-26T03:17:44.318 INFO:teuthology.orchestra.run.trial086.stdout: "last_undegraded": "0.000000", 2026-02-26T03:17:44.318 INFO:teuthology.orchestra.run.trial086.stdout: "last_fullsized": "0.000000", 2026-02-26T03:17:44.318 INFO:teuthology.orchestra.run.trial086.stdout: "mapping_epoch": 0, 2026-02-26T03:17:44.318 INFO:teuthology.orchestra.run.trial086.stdout: "log_start": "0'0", 2026-02-26T03:17:44.318 INFO:teuthology.orchestra.run.trial086.stdout: "ondisk_log_start": "0'0", 2026-02-26T03:17:44.318 INFO:teuthology.orchestra.run.trial086.stdout: "created": 0, 2026-02-26T03:17:44.318 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_clean": 0, 2026-02-26T03:17:44.318 INFO:teuthology.orchestra.run.trial086.stdout: "parent": "0.0", 2026-02-26T03:17:44.318 INFO:teuthology.orchestra.run.trial086.stdout: "parent_split_bits": 0, 2026-02-26T03:17:44.318 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub": "0'0", 2026-02-26T03:17:44.319 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub_stamp": "0.000000", 2026-02-26T03:17:44.319 INFO:teuthology.orchestra.run.trial086.stdout: "last_deep_scrub": "0'0", 2026-02-26T03:17:44.319 INFO:teuthology.orchestra.run.trial086.stdout: "last_deep_scrub_stamp": "0.000000", 2026-02-26T03:17:44.319 INFO:teuthology.orchestra.run.trial086.stdout: "last_clean_scrub_stamp": "0.000000", 2026-02-26T03:17:44.319 INFO:teuthology.orchestra.run.trial086.stdout: "objects_scrubbed": 0, 2026-02-26T03:17:44.319 INFO:teuthology.orchestra.run.trial086.stdout: "log_size": 0, 2026-02-26T03:17:44.319 INFO:teuthology.orchestra.run.trial086.stdout: "log_dups_size": 0, 2026-02-26T03:17:44.319 INFO:teuthology.orchestra.run.trial086.stdout: "ondisk_log_size": 0, 2026-02-26T03:17:44.319 INFO:teuthology.orchestra.run.trial086.stdout: "stats_invalid": false, 2026-02-26T03:17:44.319 INFO:teuthology.orchestra.run.trial086.stdout: "dirty_stats_invalid": false, 2026-02-26T03:17:44.319 INFO:teuthology.orchestra.run.trial086.stdout: "omap_stats_invalid": false, 2026-02-26T03:17:44.320 INFO:teuthology.orchestra.run.trial086.stdout: "hitset_stats_invalid": false, 2026-02-26T03:17:44.320 INFO:teuthology.orchestra.run.trial086.stdout: "hitset_bytes_stats_invalid": false, 2026-02-26T03:17:44.320 INFO:teuthology.orchestra.run.trial086.stdout: "pin_stats_invalid": false, 2026-02-26T03:17:44.320 INFO:teuthology.orchestra.run.trial086.stdout: "manifest_stats_invalid": false, 2026-02-26T03:17:44.320 INFO:teuthology.orchestra.run.trial086.stdout: "snaptrimq_len": 0, 2026-02-26T03:17:44.320 INFO:teuthology.orchestra.run.trial086.stdout: "last_scrub_duration": 0, 2026-02-26T03:17:44.320 INFO:teuthology.orchestra.run.trial086.stdout: "scrub_schedule": "--", 2026-02-26T03:17:44.320 INFO:teuthology.orchestra.run.trial086.stdout: "scrub_duration": 0, 2026-02-26T03:17:44.320 INFO:teuthology.orchestra.run.trial086.stdout: "objects_trimmed": 0, 2026-02-26T03:17:44.320 INFO:teuthology.orchestra.run.trial086.stdout: "snaptrim_duration": 0, 2026-02-26T03:17:44.320 INFO:teuthology.orchestra.run.trial086.stdout: "stat_sum": { 2026-02-26T03:17:44.320 INFO:teuthology.orchestra.run.trial086.stdout: "num_bytes": 0, 2026-02-26T03:17:44.321 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects": 0, 2026-02-26T03:17:44.321 INFO:teuthology.orchestra.run.trial086.stdout: "num_object_clones": 0, 2026-02-26T03:17:44.321 INFO:teuthology.orchestra.run.trial086.stdout: "num_object_copies": 0, 2026-02-26T03:17:44.321 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_missing_on_primary": 0, 2026-02-26T03:17:44.321 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_missing": 0, 2026-02-26T03:17:44.321 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_degraded": 0, 2026-02-26T03:17:44.321 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_misplaced": 0, 2026-02-26T03:17:44.321 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_unfound": 0, 2026-02-26T03:17:44.321 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_dirty": 0, 2026-02-26T03:17:44.321 INFO:teuthology.orchestra.run.trial086.stdout: "num_whiteouts": 0, 2026-02-26T03:17:44.321 INFO:teuthology.orchestra.run.trial086.stdout: "num_read": 0, 2026-02-26T03:17:44.321 INFO:teuthology.orchestra.run.trial086.stdout: "num_read_kb": 0, 2026-02-26T03:17:44.321 INFO:teuthology.orchestra.run.trial086.stdout: "num_write": 0, 2026-02-26T03:17:44.322 INFO:teuthology.orchestra.run.trial086.stdout: "num_write_kb": 0, 2026-02-26T03:17:44.322 INFO:teuthology.orchestra.run.trial086.stdout: "num_scrub_errors": 0, 2026-02-26T03:17:44.322 INFO:teuthology.orchestra.run.trial086.stdout: "num_shallow_scrub_errors": 0, 2026-02-26T03:17:44.322 INFO:teuthology.orchestra.run.trial086.stdout: "num_deep_scrub_errors": 0, 2026-02-26T03:17:44.322 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_recovered": 0, 2026-02-26T03:17:44.322 INFO:teuthology.orchestra.run.trial086.stdout: "num_bytes_recovered": 0, 2026-02-26T03:17:44.322 INFO:teuthology.orchestra.run.trial086.stdout: "num_keys_recovered": 0, 2026-02-26T03:17:44.322 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_omap": 0, 2026-02-26T03:17:44.322 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_hit_set_archive": 0, 2026-02-26T03:17:44.322 INFO:teuthology.orchestra.run.trial086.stdout: "num_bytes_hit_set_archive": 0, 2026-02-26T03:17:44.322 INFO:teuthology.orchestra.run.trial086.stdout: "num_flush": 0, 2026-02-26T03:17:44.322 INFO:teuthology.orchestra.run.trial086.stdout: "num_flush_kb": 0, 2026-02-26T03:17:44.323 INFO:teuthology.orchestra.run.trial086.stdout: "num_evict": 0, 2026-02-26T03:17:44.323 INFO:teuthology.orchestra.run.trial086.stdout: "num_evict_kb": 0, 2026-02-26T03:17:44.323 INFO:teuthology.orchestra.run.trial086.stdout: "num_promote": 0, 2026-02-26T03:17:44.323 INFO:teuthology.orchestra.run.trial086.stdout: "num_flush_mode_high": 0, 2026-02-26T03:17:44.323 INFO:teuthology.orchestra.run.trial086.stdout: "num_flush_mode_low": 0, 2026-02-26T03:17:44.323 INFO:teuthology.orchestra.run.trial086.stdout: "num_evict_mode_some": 0, 2026-02-26T03:17:44.323 INFO:teuthology.orchestra.run.trial086.stdout: "num_evict_mode_full": 0, 2026-02-26T03:17:44.323 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_pinned": 0, 2026-02-26T03:17:44.323 INFO:teuthology.orchestra.run.trial086.stdout: "num_legacy_snapsets": 0, 2026-02-26T03:17:44.323 INFO:teuthology.orchestra.run.trial086.stdout: "num_large_omap_objects": 0, 2026-02-26T03:17:44.323 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_manifest": 0, 2026-02-26T03:17:44.323 INFO:teuthology.orchestra.run.trial086.stdout: "num_omap_bytes": 0, 2026-02-26T03:17:44.323 INFO:teuthology.orchestra.run.trial086.stdout: "num_omap_keys": 0, 2026-02-26T03:17:44.323 INFO:teuthology.orchestra.run.trial086.stdout: "num_objects_repaired": 0 2026-02-26T03:17:44.324 INFO:teuthology.orchestra.run.trial086.stdout: }, 2026-02-26T03:17:44.324 INFO:teuthology.orchestra.run.trial086.stdout: "up": [], 2026-02-26T03:17:44.324 INFO:teuthology.orchestra.run.trial086.stdout: "acting": [], 2026-02-26T03:17:44.324 INFO:teuthology.orchestra.run.trial086.stdout: "avail_no_missing": [], 2026-02-26T03:17:44.324 INFO:teuthology.orchestra.run.trial086.stdout: "object_location_counts": [], 2026-02-26T03:17:44.324 INFO:teuthology.orchestra.run.trial086.stdout: "blocked_by": [], 2026-02-26T03:17:44.324 INFO:teuthology.orchestra.run.trial086.stdout: "up_primary": -1, 2026-02-26T03:17:44.324 INFO:teuthology.orchestra.run.trial086.stdout: "acting_primary": -1, 2026-02-26T03:17:44.324 INFO:teuthology.orchestra.run.trial086.stdout: "purged_snaps": [] 2026-02-26T03:17:44.324 INFO:teuthology.orchestra.run.trial086.stdout: }, 2026-02-26T03:17:44.324 INFO:teuthology.orchestra.run.trial086.stdout: "empty": 1, 2026-02-26T03:17:44.324 INFO:teuthology.orchestra.run.trial086.stdout: "dne": 1, 2026-02-26T03:17:44.325 INFO:teuthology.orchestra.run.trial086.stdout: "incomplete": 0, 2026-02-26T03:17:44.325 INFO:teuthology.orchestra.run.trial086.stdout: "last_epoch_started": 0, 2026-02-26T03:17:44.325 INFO:teuthology.orchestra.run.trial086.stdout: "hit_set_history": { 2026-02-26T03:17:44.325 INFO:teuthology.orchestra.run.trial086.stdout: "current_last_update": "0'0", 2026-02-26T03:17:44.325 INFO:teuthology.orchestra.run.trial086.stdout: "history": [] 2026-02-26T03:17:44.325 INFO:teuthology.orchestra.run.trial086.stdout: } 2026-02-26T03:17:44.325 INFO:teuthology.orchestra.run.trial086.stdout:} 2026-02-26T03:17:45.816 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:17:45.816 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-26T03:17:45.816 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-26T03:17:45.816 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-26T03:17:45.816 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-26T03:17:45.817 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:17:45.847 INFO:tasks.ceph_objectstore_tool:SKIPPING: test_pg_logging - PG logging not implemented 2026-02-26T03:17:45.847 INFO:tasks.ceph_objectstore_tool:SKIPPING: test_pg_export - PG export not implemented 2026-02-26T03:17:45.847 INFO:tasks.ceph_objectstore_tool:SKIPPING: test_pg_removal - PG removal not implemented 2026-02-26T03:17:45.848 INFO:tasks.ceph_objectstore_tool:SKIPPING: test_pg_import - PG import not implemented 2026-02-26T03:17:45.848 INFO:tasks.ceph_objectstore_tool:Restarting OSDs.... 2026-02-26T03:17:45.848 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2026-02-26T03:17:45.925 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:17:45.919+0000 7ff7eab0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:17:45.927 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:17:45.924+0000 7ff7eab0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:17:46.038 INFO:teuthology.orchestra.run.trial086.stdout:epoch 22 2026-02-26T03:17:46.038 INFO:teuthology.orchestra.run.trial086.stdout:fsid a3320112-ec0c-4bb6-bf8e-5331f894afbc 2026-02-26T03:17:46.038 INFO:teuthology.orchestra.run.trial086.stdout:created 2026-02-26T03:15:31.523265+0000 2026-02-26T03:17:46.038 INFO:teuthology.orchestra.run.trial086.stdout:modified 2026-02-26T03:16:01.107560+0000 2026-02-26T03:17:46.038 INFO:teuthology.orchestra.run.trial086.stdout:flags nodown,noout,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2026-02-26T03:17:46.038 INFO:teuthology.orchestra.run.trial086.stdout:crush_version 5 2026-02-26T03:17:46.038 INFO:teuthology.orchestra.run.trial086.stdout:full_ratio 0.95 2026-02-26T03:17:46.038 INFO:teuthology.orchestra.run.trial086.stdout:backfillfull_ratio 0.9 2026-02-26T03:17:46.038 INFO:teuthology.orchestra.run.trial086.stdout:nearfull_ratio 0.85 2026-02-26T03:17:46.038 INFO:teuthology.orchestra.run.trial086.stdout:require_min_compat_client luminous 2026-02-26T03:17:46.038 INFO:teuthology.orchestra.run.trial086.stdout:min_compat_client jewel 2026-02-26T03:17:46.038 INFO:teuthology.orchestra.run.trial086.stdout:require_osd_release tentacle 2026-02-26T03:17:46.038 INFO:teuthology.orchestra.run.trial086.stdout:stretch_mode_enabled false 2026-02-26T03:17:46.038 INFO:teuthology.orchestra.run.trial086.stdout:allow_crimson=true 2026-02-26T03:17:46.038 INFO:teuthology.orchestra.run.trial086.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 14 flags hashpspool,crimson stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 4.00 2026-02-26T03:17:46.038 INFO:teuthology.orchestra.run.trial086.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 17 flags hashpspool,selfmanaged_snaps,crimson stripe_width 0 application rbd read_balance_score 2.50 2026-02-26T03:17:46.038 INFO:teuthology.orchestra.run.trial086.stdout: removed_snaps_queue [2~1] 2026-02-26T03:17:46.038 INFO:teuthology.orchestra.run.trial086.stdout:pool 3 'rep_pool' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 22 flags hashpspool,crimson stripe_width 0 read_balance_score 1.50 2026-02-26T03:17:46.038 INFO:teuthology.orchestra.run.trial086.stdout:max_osd 4 2026-02-26T03:17:46.038 INFO:teuthology.orchestra.run.trial086.stdout:osd.0 up in weight 1 up_from 11 up_thru 20 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6809/1229323153 v2:10.20.193.86:6810/1229323153 exists,up b692f9c9-579d-4a92-b02c-beefe594ff12 2026-02-26T03:17:46.038 INFO:teuthology.orchestra.run.trial086.stdout:osd.1 up in weight 1 up_from 10 up_thru 20 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6803/2744027137 v2:10.20.193.86:6802/2744027137 exists,up 1935ef84-dee5-4745-8c38-6435b71c819c 2026-02-26T03:17:46.038 INFO:teuthology.orchestra.run.trial086.stdout:osd.2 up in weight 1 up_from 10 up_thru 20 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6805/3653919688 v2:10.20.193.86:6804/3653919688 exists,up bf958cf8-549c-42c6-9510-269812a65fb6 2026-02-26T03:17:46.038 INFO:teuthology.orchestra.run.trial086.stdout:osd.3 up in weight 1 up_from 11 up_thru 20 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6806/2128187350 v2:10.20.193.86:6807/2128187350 exists,up cf449d79-9ec0-4e20-a163-3ce8ac17c2cb 2026-02-26T03:17:46.047 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 11 up_thru 20 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6809/1229323153 v2:10.20.193.86:6810/1229323153 exists,up b692f9c9-579d-4a92-b02c-beefe594ff12', 'osd.1 up in weight 1 up_from 10 up_thru 20 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6803/2744027137 v2:10.20.193.86:6802/2744027137 exists,up 1935ef84-dee5-4745-8c38-6435b71c819c', 'osd.2 up in weight 1 up_from 10 up_thru 20 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6805/3653919688 v2:10.20.193.86:6804/3653919688 exists,up bf958cf8-549c-42c6-9510-269812a65fb6', 'osd.3 up in weight 1 up_from 11 up_thru 20 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6806/2128187350 v2:10.20.193.86:6807/2128187350 exists,up cf449d79-9ec0-4e20-a163-3ce8ac17c2cb'] 2026-02-26T03:17:46.048 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-26T03:17:46.048 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2026-02-26T03:17:46.051 INFO:tasks.ceph.osd.0:Started 2026-02-26T03:17:46.051 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2026-02-26T03:17:46.122 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-26T03:17:46.125 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-26T03:17:46.125 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2026-02-26T03:17:51.126 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2026-02-26T03:17:51.642 INFO:teuthology.orchestra.run.trial086.stdout:{ 2026-02-26T03:17:51.643 INFO:teuthology.orchestra.run.trial086.stdout: "ops_in_flight": [] 2026-02-26T03:17:51.643 INFO:teuthology.orchestra.run.trial086.stdout:} 2026-02-26T03:17:51.649 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-26T03:17:51.650 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2026-02-26T03:17:51.651 INFO:tasks.ceph.osd.1:Started 2026-02-26T03:17:51.651 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2026-02-26T03:17:51.725 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-26T03:17:51.728 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-26T03:17:51.728 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2026-02-26T03:17:56.729 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2026-02-26T03:17:57.654 INFO:teuthology.orchestra.run.trial086.stdout:{ 2026-02-26T03:17:57.654 INFO:teuthology.orchestra.run.trial086.stdout: "ops_in_flight": [] 2026-02-26T03:17:57.654 INFO:teuthology.orchestra.run.trial086.stdout:} 2026-02-26T03:17:57.664 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-26T03:17:57.664 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2026-02-26T03:17:57.667 INFO:tasks.ceph.osd.2:Started 2026-02-26T03:17:57.667 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-26T03:17:57.740 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-26T03:17:57.743 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-26T03:17:57.743 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-26T03:18:02.745 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-26T03:18:03.673 INFO:teuthology.orchestra.run.trial086.stdout:{ 2026-02-26T03:18:03.673 INFO:teuthology.orchestra.run.trial086.stdout: "ops_in_flight": [] 2026-02-26T03:18:03.673 INFO:teuthology.orchestra.run.trial086.stdout:} 2026-02-26T03:18:03.682 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-26T03:18:03.682 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2026-02-26T03:18:03.685 INFO:tasks.ceph.osd.3:Started 2026-02-26T03:18:03.685 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-26T03:18:03.761 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-26T03:18:03.763 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-26T03:18:03.764 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-26T03:18:08.766 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-26T03:18:09.683 INFO:teuthology.orchestra.run.trial086.stdout:{ 2026-02-26T03:18:09.683 INFO:teuthology.orchestra.run.trial086.stdout: "ops_in_flight": [] 2026-02-26T03:18:09.683 INFO:teuthology.orchestra.run.trial086.stdout:} 2026-02-26T03:18:14.694 INFO:tasks.ceph_objectstore_tool:Verify replicated import data 2026-02-26T03:18:14.694 INFO:tasks.util.rados:rados -p rep_pool get REPobject1 /home/ubuntu/cephtest/ceph.data/gettest 2026-02-26T03:18:14.694 DEBUG:teuthology.orchestra.run.trial086:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p rep_pool get REPobject1 /home/ubuntu/cephtest/ceph.data/gettest 2026-02-26T03:18:14.732 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:18:14.729+0000 7f6022295ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:18:14.735 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:18:14.732+0000 7f6022295ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:18:14.736 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:18:14.732+0000 7f6022295ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:18:14.751 DEBUG:teuthology.orchestra.run.trial086:> diff -q /home/ubuntu/cephtest/ceph.data/gettest /home/ubuntu/cephtest/ceph.data/REPobject1 2026-02-26T03:18:14.807 INFO:tasks.util.rados:rados -p rep_pool get REPobject2 /home/ubuntu/cephtest/ceph.data/gettest 2026-02-26T03:18:14.807 DEBUG:teuthology.orchestra.run.trial086:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p rep_pool get REPobject2 /home/ubuntu/cephtest/ceph.data/gettest 2026-02-26T03:18:14.886 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:18:14.883+0000 7f6d16236ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:18:14.890 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:18:14.886+0000 7f6d16236ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:18:14.890 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:18:14.886+0000 7f6d16236ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:18:14.906 DEBUG:teuthology.orchestra.run.trial086:> diff -q /home/ubuntu/cephtest/ceph.data/gettest /home/ubuntu/cephtest/ceph.data/REPobject2 2026-02-26T03:18:14.963 INFO:tasks.util.rados:rados -p rep_pool get REPobject3 /home/ubuntu/cephtest/ceph.data/gettest 2026-02-26T03:18:14.963 DEBUG:teuthology.orchestra.run.trial086:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p rep_pool get REPobject3 /home/ubuntu/cephtest/ceph.data/gettest 2026-02-26T03:18:15.042 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:18:15.038+0000 7f688e238ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:18:15.045 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:18:15.041+0000 7f688e238ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:18:15.045 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:18:15.041+0000 7f688e238ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:18:15.059 DEBUG:teuthology.orchestra.run.trial086:> diff -q /home/ubuntu/cephtest/ceph.data/gettest /home/ubuntu/cephtest/ceph.data/REPobject3 2026-02-26T03:18:15.116 INFO:tasks.util.rados:rados -p rep_pool get REPobject4 /home/ubuntu/cephtest/ceph.data/gettest 2026-02-26T03:18:15.117 DEBUG:teuthology.orchestra.run.trial086:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p rep_pool get REPobject4 /home/ubuntu/cephtest/ceph.data/gettest 2026-02-26T03:18:15.195 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:18:15.191+0000 7ff33128cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:18:15.198 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:18:15.195+0000 7ff33128cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:18:15.198 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:18:15.195+0000 7ff33128cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:18:15.214 DEBUG:teuthology.orchestra.run.trial086:> diff -q /home/ubuntu/cephtest/ceph.data/gettest /home/ubuntu/cephtest/ceph.data/REPobject4 2026-02-26T03:18:15.270 INFO:tasks.util.rados:rados -p rep_pool get REPobject5 /home/ubuntu/cephtest/ceph.data/gettest 2026-02-26T03:18:15.270 DEBUG:teuthology.orchestra.run.trial086:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p rep_pool get REPobject5 /home/ubuntu/cephtest/ceph.data/gettest 2026-02-26T03:18:15.347 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:18:15.344+0000 7f6f674a2ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:18:15.351 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:18:15.347+0000 7f6f674a2ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:18:15.351 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:18:15.347+0000 7f6f674a2ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:18:15.367 DEBUG:teuthology.orchestra.run.trial086:> diff -q /home/ubuntu/cephtest/ceph.data/gettest /home/ubuntu/cephtest/ceph.data/REPobject5 2026-02-26T03:18:15.424 INFO:tasks.ceph_objectstore_tool:SKIPPING EC pool tests for crimson-objectstore-tool 2026-02-26T03:18:15.424 INFO:tasks.ceph_objectstore_tool:TEST PASSED 2026-02-26T03:18:15.424 DEBUG:teuthology.run_tasks:Unwinding manager ceph_objectstore_tool 2026-02-26T03:18:15.439 INFO:tasks.ceph_objectstore_tool:Ending ceph_objectstore_tool 2026-02-26T03:18:15.439 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-26T03:18:15.454 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-26T03:18:15.454 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-26T03:18:15.538 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:18:15.532+0000 7fb9eaf93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:18:15.540 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:18:15.537+0000 7fb9eaf93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:18:15.651 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:18:15.652 INFO:teuthology.orchestra.run.trial086.stderr:dumped all 2026-02-26T03:18:15.661 INFO:teuthology.orchestra.run.trial086.stdout:{"pg_ready":true,"pg_map":{"version":105,"stamp":"2026-02-26T03:18:13.964757+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2190387,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":110,"num_write_kb":2683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":84,"ondisk_log_size":84,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":7928,"kb_used_data":7928,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209182984,"statfs":{"total":214211493888,"available":214203375616,"internally_reserved":0,"allocated":8118272,"data_stored":8118272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":320000,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001135"},"pg_stats":[{"pgid":"1.0","version":"13'52","reported_seq":107,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.680296+0000","last_change":"2026-02-26T03:17:58.671739+0000","last_active":"2026-02-26T03:18:10.680296+0000","last_peered":"2026-02-26T03:18:10.680296+0000","last_clean":"2026-02-26T03:18:10.680296+0000","last_became_active":"2026-02-26T03:17:58.664633+0000","last_became_peered":"2026-02-26T03:17:58.664633+0000","last_unstale":"2026-02-26T03:18:10.680296+0000","last_undegraded":"2026-02-26T03:18:10.680296+0000","last_fullsized":"2026-02-26T03:18:10.680296+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:46.067961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:46.067961+0000","last_clean_scrub_stamp":"2026-02-26T03:15:46.067961+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.731241+0000","last_change":"2026-02-26T03:18:10.731727+0000","last_active":"2026-02-26T03:18:10.731241+0000","last_peered":"2026-02-26T03:18:10.731241+0000","last_clean":"2026-02-26T03:15:49.131531+0000","last_became_active":"2026-02-26T03:18:10.710606+0000","last_became_peered":"2026-02-26T03:18:10.710606+0000","last_unstale":"2026-02-26T03:18:10.731241+0000","last_undegraded":"2026-02-26T03:18:10.731241+0000","last_fullsized":"2026-02-26T03:18:10.731241+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"22'6","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.725567+0000","last_change":"2026-02-26T03:18:10.726105+0000","last_active":"2026-02-26T03:18:10.725567+0000","last_peered":"2026-02-26T03:18:10.725567+0000","last_clean":"2026-02-26T03:16:01.156958+0000","last_became_active":"2026-02-26T03:18:10.708174+0000","last_became_peered":"2026-02-26T03:18:10.708174+0000","last_unstale":"2026-02-26T03:18:10.725567+0000","last_undegraded":"2026-02-26T03:18:10.725567+0000","last_fullsized":"2026-02-26T03:18:10.725567+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320000,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.719545+0000","last_change":"2026-02-26T03:18:10.720150+0000","last_active":"2026-02-26T03:18:10.719545+0000","last_peered":"2026-02-26T03:18:10.719545+0000","last_clean":"2026-02-26T03:15:49.134101+0000","last_became_active":"2026-02-26T03:18:10.703268+0000","last_became_peered":"2026-02-26T03:18:10.703268+0000","last_unstale":"2026-02-26T03:18:10.719545+0000","last_undegraded":"2026-02-26T03:18:10.719545+0000","last_fullsized":"2026-02-26T03:18:10.719545+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-26T03:18:09.674267+0000","last_change":"2026-02-26T03:18:04.686774+0000","last_active":"2026-02-26T03:18:09.674267+0000","last_peered":"2026-02-26T03:18:09.674267+0000","last_clean":"2026-02-26T03:18:09.674267+0000","last_became_active":"2026-02-26T03:18:04.681796+0000","last_became_peered":"2026-02-26T03:18:04.681796+0000","last_unstale":"2026-02-26T03:18:09.674267+0000","last_undegraded":"2026-02-26T03:18:09.674267+0000","last_fullsized":"2026-02-26T03:18:09.674267+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.734379+0000","last_change":"2026-02-26T03:18:10.734966+0000","last_active":"2026-02-26T03:18:10.734379+0000","last_peered":"2026-02-26T03:18:10.734379+0000","last_clean":"2026-02-26T03:15:49.136068+0000","last_became_active":"2026-02-26T03:18:10.723788+0000","last_became_peered":"2026-02-26T03:18:10.723788+0000","last_unstale":"2026-02-26T03:18:10.734379+0000","last_undegraded":"2026-02-26T03:18:10.734379+0000","last_fullsized":"2026-02-26T03:18:10.734379+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.681312+0000","last_change":"2026-02-26T03:18:04.686600+0000","last_active":"2026-02-26T03:18:10.681312+0000","last_peered":"2026-02-26T03:18:10.681312+0000","last_clean":"2026-02-26T03:18:10.681312+0000","last_became_active":"2026-02-26T03:18:04.680310+0000","last_became_peered":"2026-02-26T03:18:04.680310+0000","last_unstale":"2026-02-26T03:18:10.681312+0000","last_undegraded":"2026-02-26T03:18:10.681312+0000","last_fullsized":"2026-02-26T03:18:10.681312+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.725511+0000","last_change":"2026-02-26T03:18:10.725791+0000","last_active":"2026-02-26T03:18:10.725511+0000","last_peered":"2026-02-26T03:18:10.725511+0000","last_clean":"2026-02-26T03:15:51.100441+0000","last_became_active":"2026-02-26T03:18:10.713355+0000","last_became_peered":"2026-02-26T03:18:10.713355+0000","last_unstale":"2026-02-26T03:18:10.725511+0000","last_undegraded":"2026-02-26T03:18:10.725511+0000","last_fullsized":"2026-02-26T03:18:10.725511+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-26T03:18:09.673684+0000","last_change":"2026-02-26T03:18:04.686779+0000","last_active":"2026-02-26T03:18:09.673684+0000","last_peered":"2026-02-26T03:18:09.673684+0000","last_clean":"2026-02-26T03:18:09.673684+0000","last_became_active":"2026-02-26T03:18:04.677987+0000","last_became_peered":"2026-02-26T03:18:04.677987+0000","last_unstale":"2026-02-26T03:18:09.673684+0000","last_undegraded":"2026-02-26T03:18:09.673684+0000","last_fullsized":"2026-02-26T03:18:09.673684+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"22'10","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.725224+0000","last_change":"2026-02-26T03:18:10.725525+0000","last_active":"2026-02-26T03:18:10.725224+0000","last_peered":"2026-02-26T03:18:10.725224+0000","last_clean":"2026-02-26T03:16:02.926645+0000","last_became_active":"2026-02-26T03:18:10.720584+0000","last_became_peered":"2026-02-26T03:18:10.720584+0000","last_unstale":"2026-02-26T03:18:10.725224+0000","last_undegraded":"2026-02-26T03:18:10.725224+0000","last_fullsized":"2026-02-26T03:18:10.725224+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320000,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.681325+0000","last_change":"2026-02-26T03:18:01.658129+0000","last_active":"2026-02-26T03:18:10.681325+0000","last_peered":"2026-02-26T03:18:10.681325+0000","last_clean":"2026-02-26T03:18:10.681325+0000","last_became_active":"2026-02-26T03:17:58.668374+0000","last_became_peered":"2026-02-26T03:17:58.668374+0000","last_unstale":"2026-02-26T03:18:10.681325+0000","last_undegraded":"2026-02-26T03:18:10.681325+0000","last_fullsized":"2026-02-26T03:18:10.681325+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"21'5","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.680861+0000","last_change":"2026-02-26T03:18:04.682579+0000","last_active":"2026-02-26T03:18:10.680861+0000","last_peered":"2026-02-26T03:18:10.680861+0000","last_clean":"2026-02-26T03:18:10.680861+0000","last_became_active":"2026-02-26T03:18:04.674002+0000","last_became_peered":"2026-02-26T03:18:04.674002+0000","last_unstale":"2026-02-26T03:18:10.680861+0000","last_undegraded":"2026-02-26T03:18:10.680861+0000","last_fullsized":"2026-02-26T03:18:10.680861+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":640000,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.711106+0000","last_change":"2026-02-26T03:18:10.711390+0000","last_active":"2026-02-26T03:18:10.711106+0000","last_peered":"2026-02-26T03:18:10.711106+0000","last_clean":"2026-02-26T03:15:49.143434+0000","last_became_active":"2026-02-26T03:18:10.703541+0000","last_became_peered":"2026-02-26T03:18:10.703541+0000","last_unstale":"2026-02-26T03:18:10.711106+0000","last_undegraded":"2026-02-26T03:18:10.711106+0000","last_fullsized":"2026-02-26T03:18:10.711106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.719628+0000","last_change":"2026-02-26T03:18:10.720198+0000","last_active":"2026-02-26T03:18:10.719628+0000","last_peered":"2026-02-26T03:18:10.719628+0000","last_clean":"2026-02-26T03:16:00.149150+0000","last_became_active":"2026-02-26T03:18:10.706057+0000","last_became_peered":"2026-02-26T03:18:10.706057+0000","last_unstale":"2026-02-26T03:18:10.719628+0000","last_undegraded":"2026-02-26T03:18:10.719628+0000","last_fullsized":"2026-02-26T03:18:10.719628+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.681896+0000","last_change":"2026-02-26T03:18:01.658102+0000","last_active":"2026-02-26T03:18:10.681896+0000","last_peered":"2026-02-26T03:18:10.681896+0000","last_clean":"2026-02-26T03:18:10.681896+0000","last_became_active":"2026-02-26T03:17:58.669338+0000","last_became_peered":"2026-02-26T03:17:58.669338+0000","last_unstale":"2026-02-26T03:18:10.681896+0000","last_undegraded":"2026-02-26T03:18:10.681896+0000","last_fullsized":"2026-02-26T03:18:10.681896+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"22'8","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-26T03:18:09.675065+0000","last_change":"2026-02-26T03:17:58.679001+0000","last_active":"2026-02-26T03:18:09.675065+0000","last_peered":"2026-02-26T03:18:09.675065+0000","last_clean":"2026-02-26T03:18:09.675065+0000","last_became_active":"2026-02-26T03:17:58.671210+0000","last_became_peered":"2026-02-26T03:17:58.671210+0000","last_unstale":"2026-02-26T03:18:09.675065+0000","last_undegraded":"2026-02-26T03:18:09.675065+0000","last_fullsized":"2026-02-26T03:18:09.675065+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320000,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.721725+0000","last_change":"2026-02-26T03:18:10.722036+0000","last_active":"2026-02-26T03:18:10.721725+0000","last_peered":"2026-02-26T03:18:10.721725+0000","last_clean":"2026-02-26T03:15:49.144710+0000","last_became_active":"2026-02-26T03:18:10.707778+0000","last_became_peered":"2026-02-26T03:18:10.707778+0000","last_unstale":"2026-02-26T03:18:10.721725+0000","last_undegraded":"2026-02-26T03:18:10.721725+0000","last_fullsized":"2026-02-26T03:18:10.721725+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":1600000,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":1575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214203351040,"internally_reserved":0,"allocated":8142848,"data_stored":8142848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160658620416,"available":160652242944,"internally_reserved":0,"allocated":6377472,"data_stored":6377472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":33,"seq":141733920777,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2228,"kb_used_data":2228,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295500,"statfs":{"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":29,"seq":124554051598,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2512,"kb_used_data":2512,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295216,"statfs":{"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":37,"seq":158913789956,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1488,"kb_used_data":1488,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296240,"statfs":{"total":53552873472,"available":53551349760,"internally_reserved":0,"allocated":1523712,"data_stored":1523712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":25,"seq":107374182418,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1700,"kb_used_data":1700,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296028,"statfs":{"total":53552873472,"available":53551132672,"internally_reserved":0,"allocated":1740800,"data_stored":1740800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551349760,"internally_reserved":0,"allocated":1523712,"data_stored":1523712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53551108096,"internally_reserved":0,"allocated":1765376,"data_stored":1765376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":53551349760,"internally_reserved":0,"allocated":1523712,"data_stored":1523712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-26T03:18:15.663 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-26T03:18:15.737 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:18:15.732+0000 7fa13ca11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:18:15.740 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:18:15.736+0000 7fa13ca11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:18:15.851 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:18:15.851 INFO:teuthology.orchestra.run.trial086.stderr:dumped all 2026-02-26T03:18:15.859 INFO:teuthology.orchestra.run.trial086.stdout:{"pg_ready":true,"pg_map":{"version":105,"stamp":"2026-02-26T03:18:13.964757+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2190387,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":110,"num_write_kb":2683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":84,"ondisk_log_size":84,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":7928,"kb_used_data":7928,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209182984,"statfs":{"total":214211493888,"available":214203375616,"internally_reserved":0,"allocated":8118272,"data_stored":8118272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":320000,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001135"},"pg_stats":[{"pgid":"1.0","version":"13'52","reported_seq":107,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.680296+0000","last_change":"2026-02-26T03:17:58.671739+0000","last_active":"2026-02-26T03:18:10.680296+0000","last_peered":"2026-02-26T03:18:10.680296+0000","last_clean":"2026-02-26T03:18:10.680296+0000","last_became_active":"2026-02-26T03:17:58.664633+0000","last_became_peered":"2026-02-26T03:17:58.664633+0000","last_unstale":"2026-02-26T03:18:10.680296+0000","last_undegraded":"2026-02-26T03:18:10.680296+0000","last_fullsized":"2026-02-26T03:18:10.680296+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:46.067961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:46.067961+0000","last_clean_scrub_stamp":"2026-02-26T03:15:46.067961+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.731241+0000","last_change":"2026-02-26T03:18:10.731727+0000","last_active":"2026-02-26T03:18:10.731241+0000","last_peered":"2026-02-26T03:18:10.731241+0000","last_clean":"2026-02-26T03:15:49.131531+0000","last_became_active":"2026-02-26T03:18:10.710606+0000","last_became_peered":"2026-02-26T03:18:10.710606+0000","last_unstale":"2026-02-26T03:18:10.731241+0000","last_undegraded":"2026-02-26T03:18:10.731241+0000","last_fullsized":"2026-02-26T03:18:10.731241+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"22'6","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.725567+0000","last_change":"2026-02-26T03:18:10.726105+0000","last_active":"2026-02-26T03:18:10.725567+0000","last_peered":"2026-02-26T03:18:10.725567+0000","last_clean":"2026-02-26T03:16:01.156958+0000","last_became_active":"2026-02-26T03:18:10.708174+0000","last_became_peered":"2026-02-26T03:18:10.708174+0000","last_unstale":"2026-02-26T03:18:10.725567+0000","last_undegraded":"2026-02-26T03:18:10.725567+0000","last_fullsized":"2026-02-26T03:18:10.725567+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320000,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.719545+0000","last_change":"2026-02-26T03:18:10.720150+0000","last_active":"2026-02-26T03:18:10.719545+0000","last_peered":"2026-02-26T03:18:10.719545+0000","last_clean":"2026-02-26T03:15:49.134101+0000","last_became_active":"2026-02-26T03:18:10.703268+0000","last_became_peered":"2026-02-26T03:18:10.703268+0000","last_unstale":"2026-02-26T03:18:10.719545+0000","last_undegraded":"2026-02-26T03:18:10.719545+0000","last_fullsized":"2026-02-26T03:18:10.719545+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-26T03:18:09.674267+0000","last_change":"2026-02-26T03:18:04.686774+0000","last_active":"2026-02-26T03:18:09.674267+0000","last_peered":"2026-02-26T03:18:09.674267+0000","last_clean":"2026-02-26T03:18:09.674267+0000","last_became_active":"2026-02-26T03:18:04.681796+0000","last_became_peered":"2026-02-26T03:18:04.681796+0000","last_unstale":"2026-02-26T03:18:09.674267+0000","last_undegraded":"2026-02-26T03:18:09.674267+0000","last_fullsized":"2026-02-26T03:18:09.674267+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.734379+0000","last_change":"2026-02-26T03:18:10.734966+0000","last_active":"2026-02-26T03:18:10.734379+0000","last_peered":"2026-02-26T03:18:10.734379+0000","last_clean":"2026-02-26T03:15:49.136068+0000","last_became_active":"2026-02-26T03:18:10.723788+0000","last_became_peered":"2026-02-26T03:18:10.723788+0000","last_unstale":"2026-02-26T03:18:10.734379+0000","last_undegraded":"2026-02-26T03:18:10.734379+0000","last_fullsized":"2026-02-26T03:18:10.734379+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.681312+0000","last_change":"2026-02-26T03:18:04.686600+0000","last_active":"2026-02-26T03:18:10.681312+0000","last_peered":"2026-02-26T03:18:10.681312+0000","last_clean":"2026-02-26T03:18:10.681312+0000","last_became_active":"2026-02-26T03:18:04.680310+0000","last_became_peered":"2026-02-26T03:18:04.680310+0000","last_unstale":"2026-02-26T03:18:10.681312+0000","last_undegraded":"2026-02-26T03:18:10.681312+0000","last_fullsized":"2026-02-26T03:18:10.681312+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.725511+0000","last_change":"2026-02-26T03:18:10.725791+0000","last_active":"2026-02-26T03:18:10.725511+0000","last_peered":"2026-02-26T03:18:10.725511+0000","last_clean":"2026-02-26T03:15:51.100441+0000","last_became_active":"2026-02-26T03:18:10.713355+0000","last_became_peered":"2026-02-26T03:18:10.713355+0000","last_unstale":"2026-02-26T03:18:10.725511+0000","last_undegraded":"2026-02-26T03:18:10.725511+0000","last_fullsized":"2026-02-26T03:18:10.725511+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-26T03:18:09.673684+0000","last_change":"2026-02-26T03:18:04.686779+0000","last_active":"2026-02-26T03:18:09.673684+0000","last_peered":"2026-02-26T03:18:09.673684+0000","last_clean":"2026-02-26T03:18:09.673684+0000","last_became_active":"2026-02-26T03:18:04.677987+0000","last_became_peered":"2026-02-26T03:18:04.677987+0000","last_unstale":"2026-02-26T03:18:09.673684+0000","last_undegraded":"2026-02-26T03:18:09.673684+0000","last_fullsized":"2026-02-26T03:18:09.673684+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"22'10","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.725224+0000","last_change":"2026-02-26T03:18:10.725525+0000","last_active":"2026-02-26T03:18:10.725224+0000","last_peered":"2026-02-26T03:18:10.725224+0000","last_clean":"2026-02-26T03:16:02.926645+0000","last_became_active":"2026-02-26T03:18:10.720584+0000","last_became_peered":"2026-02-26T03:18:10.720584+0000","last_unstale":"2026-02-26T03:18:10.725224+0000","last_undegraded":"2026-02-26T03:18:10.725224+0000","last_fullsized":"2026-02-26T03:18:10.725224+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320000,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.681325+0000","last_change":"2026-02-26T03:18:01.658129+0000","last_active":"2026-02-26T03:18:10.681325+0000","last_peered":"2026-02-26T03:18:10.681325+0000","last_clean":"2026-02-26T03:18:10.681325+0000","last_became_active":"2026-02-26T03:17:58.668374+0000","last_became_peered":"2026-02-26T03:17:58.668374+0000","last_unstale":"2026-02-26T03:18:10.681325+0000","last_undegraded":"2026-02-26T03:18:10.681325+0000","last_fullsized":"2026-02-26T03:18:10.681325+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"21'5","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.680861+0000","last_change":"2026-02-26T03:18:04.682579+0000","last_active":"2026-02-26T03:18:10.680861+0000","last_peered":"2026-02-26T03:18:10.680861+0000","last_clean":"2026-02-26T03:18:10.680861+0000","last_became_active":"2026-02-26T03:18:04.674002+0000","last_became_peered":"2026-02-26T03:18:04.674002+0000","last_unstale":"2026-02-26T03:18:10.680861+0000","last_undegraded":"2026-02-26T03:18:10.680861+0000","last_fullsized":"2026-02-26T03:18:10.680861+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":640000,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.711106+0000","last_change":"2026-02-26T03:18:10.711390+0000","last_active":"2026-02-26T03:18:10.711106+0000","last_peered":"2026-02-26T03:18:10.711106+0000","last_clean":"2026-02-26T03:15:49.143434+0000","last_became_active":"2026-02-26T03:18:10.703541+0000","last_became_peered":"2026-02-26T03:18:10.703541+0000","last_unstale":"2026-02-26T03:18:10.711106+0000","last_undegraded":"2026-02-26T03:18:10.711106+0000","last_fullsized":"2026-02-26T03:18:10.711106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.719628+0000","last_change":"2026-02-26T03:18:10.720198+0000","last_active":"2026-02-26T03:18:10.719628+0000","last_peered":"2026-02-26T03:18:10.719628+0000","last_clean":"2026-02-26T03:16:00.149150+0000","last_became_active":"2026-02-26T03:18:10.706057+0000","last_became_peered":"2026-02-26T03:18:10.706057+0000","last_unstale":"2026-02-26T03:18:10.719628+0000","last_undegraded":"2026-02-26T03:18:10.719628+0000","last_fullsized":"2026-02-26T03:18:10.719628+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.681896+0000","last_change":"2026-02-26T03:18:01.658102+0000","last_active":"2026-02-26T03:18:10.681896+0000","last_peered":"2026-02-26T03:18:10.681896+0000","last_clean":"2026-02-26T03:18:10.681896+0000","last_became_active":"2026-02-26T03:17:58.669338+0000","last_became_peered":"2026-02-26T03:17:58.669338+0000","last_unstale":"2026-02-26T03:18:10.681896+0000","last_undegraded":"2026-02-26T03:18:10.681896+0000","last_fullsized":"2026-02-26T03:18:10.681896+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"22'8","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-26T03:18:09.675065+0000","last_change":"2026-02-26T03:17:58.679001+0000","last_active":"2026-02-26T03:18:09.675065+0000","last_peered":"2026-02-26T03:18:09.675065+0000","last_clean":"2026-02-26T03:18:09.675065+0000","last_became_active":"2026-02-26T03:17:58.671210+0000","last_became_peered":"2026-02-26T03:17:58.671210+0000","last_unstale":"2026-02-26T03:18:09.675065+0000","last_undegraded":"2026-02-26T03:18:09.675065+0000","last_fullsized":"2026-02-26T03:18:09.675065+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320000,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.721725+0000","last_change":"2026-02-26T03:18:10.722036+0000","last_active":"2026-02-26T03:18:10.721725+0000","last_peered":"2026-02-26T03:18:10.721725+0000","last_clean":"2026-02-26T03:15:49.144710+0000","last_became_active":"2026-02-26T03:18:10.707778+0000","last_became_peered":"2026-02-26T03:18:10.707778+0000","last_unstale":"2026-02-26T03:18:10.721725+0000","last_undegraded":"2026-02-26T03:18:10.721725+0000","last_fullsized":"2026-02-26T03:18:10.721725+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":1600000,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":1575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214203351040,"internally_reserved":0,"allocated":8142848,"data_stored":8142848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160658620416,"available":160652242944,"internally_reserved":0,"allocated":6377472,"data_stored":6377472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":33,"seq":141733920777,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2228,"kb_used_data":2228,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295500,"statfs":{"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":29,"seq":124554051598,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2512,"kb_used_data":2512,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295216,"statfs":{"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":37,"seq":158913789956,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1488,"kb_used_data":1488,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296240,"statfs":{"total":53552873472,"available":53551349760,"internally_reserved":0,"allocated":1523712,"data_stored":1523712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":25,"seq":107374182418,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1700,"kb_used_data":1700,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296028,"statfs":{"total":53552873472,"available":53551132672,"internally_reserved":0,"allocated":1740800,"data_stored":1740800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551349760,"internally_reserved":0,"allocated":1523712,"data_stored":1523712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53551108096,"internally_reserved":0,"allocated":1765376,"data_stored":1765376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":53551349760,"internally_reserved":0,"allocated":1523712,"data_stored":1523712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-26T03:18:15.861 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-26T03:18:15.861 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-26T03:18:15.938 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:18:15.931+0000 7f38f6e1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:18:15.940 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:18:15.936+0000 7f38f6e1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:18:16.049 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:18:16.049 INFO:teuthology.orchestra.run.trial086.stderr:dumped all 2026-02-26T03:18:16.058 INFO:teuthology.orchestra.run.trial086.stdout:{"pg_ready":true,"pg_map":{"version":106,"stamp":"2026-02-26T03:18:15.965131+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2190387,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":359,"num_write":110,"num_write_kb":2683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":84,"ondisk_log_size":84,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":7960,"kb_used_data":7960,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209182952,"statfs":{"total":214211493888,"available":214203342848,"internally_reserved":0,"allocated":8151040,"data_stored":8151040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":320000,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":313,"num_write":6,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.305901"},"pg_stats":[{"pgid":"1.0","version":"13'52","reported_seq":107,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.680296+0000","last_change":"2026-02-26T03:17:58.671739+0000","last_active":"2026-02-26T03:18:10.680296+0000","last_peered":"2026-02-26T03:18:10.680296+0000","last_clean":"2026-02-26T03:18:10.680296+0000","last_became_active":"2026-02-26T03:17:58.664633+0000","last_became_peered":"2026-02-26T03:17:58.664633+0000","last_unstale":"2026-02-26T03:18:10.680296+0000","last_undegraded":"2026-02-26T03:18:10.680296+0000","last_fullsized":"2026-02-26T03:18:10.680296+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:46.067961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:46.067961+0000","last_clean_scrub_stamp":"2026-02-26T03:15:46.067961+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.731241+0000","last_change":"2026-02-26T03:18:10.731727+0000","last_active":"2026-02-26T03:18:10.731241+0000","last_peered":"2026-02-26T03:18:10.731241+0000","last_clean":"2026-02-26T03:15:49.131531+0000","last_became_active":"2026-02-26T03:18:10.710606+0000","last_became_peered":"2026-02-26T03:18:10.710606+0000","last_unstale":"2026-02-26T03:18:10.731241+0000","last_undegraded":"2026-02-26T03:18:10.731241+0000","last_fullsized":"2026-02-26T03:18:10.731241+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"22'6","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.725567+0000","last_change":"2026-02-26T03:18:10.726105+0000","last_active":"2026-02-26T03:18:10.725567+0000","last_peered":"2026-02-26T03:18:10.725567+0000","last_clean":"2026-02-26T03:16:01.156958+0000","last_became_active":"2026-02-26T03:18:10.708174+0000","last_became_peered":"2026-02-26T03:18:10.708174+0000","last_unstale":"2026-02-26T03:18:10.725567+0000","last_undegraded":"2026-02-26T03:18:10.725567+0000","last_fullsized":"2026-02-26T03:18:10.725567+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320000,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.719545+0000","last_change":"2026-02-26T03:18:10.720150+0000","last_active":"2026-02-26T03:18:10.719545+0000","last_peered":"2026-02-26T03:18:10.719545+0000","last_clean":"2026-02-26T03:15:49.134101+0000","last_became_active":"2026-02-26T03:18:10.703268+0000","last_became_peered":"2026-02-26T03:18:10.703268+0000","last_unstale":"2026-02-26T03:18:10.719545+0000","last_undegraded":"2026-02-26T03:18:10.719545+0000","last_fullsized":"2026-02-26T03:18:10.719545+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.681689+0000","last_change":"2026-02-26T03:18:04.686774+0000","last_active":"2026-02-26T03:18:10.681689+0000","last_peered":"2026-02-26T03:18:10.681689+0000","last_clean":"2026-02-26T03:18:10.681689+0000","last_became_active":"2026-02-26T03:18:04.681796+0000","last_became_peered":"2026-02-26T03:18:04.681796+0000","last_unstale":"2026-02-26T03:18:10.681689+0000","last_undegraded":"2026-02-26T03:18:10.681689+0000","last_fullsized":"2026-02-26T03:18:10.681689+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.734379+0000","last_change":"2026-02-26T03:18:10.734966+0000","last_active":"2026-02-26T03:18:10.734379+0000","last_peered":"2026-02-26T03:18:10.734379+0000","last_clean":"2026-02-26T03:15:49.136068+0000","last_became_active":"2026-02-26T03:18:10.723788+0000","last_became_peered":"2026-02-26T03:18:10.723788+0000","last_unstale":"2026-02-26T03:18:10.734379+0000","last_undegraded":"2026-02-26T03:18:10.734379+0000","last_fullsized":"2026-02-26T03:18:10.734379+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.681312+0000","last_change":"2026-02-26T03:18:04.686600+0000","last_active":"2026-02-26T03:18:10.681312+0000","last_peered":"2026-02-26T03:18:10.681312+0000","last_clean":"2026-02-26T03:18:10.681312+0000","last_became_active":"2026-02-26T03:18:04.680310+0000","last_became_peered":"2026-02-26T03:18:04.680310+0000","last_unstale":"2026-02-26T03:18:10.681312+0000","last_undegraded":"2026-02-26T03:18:10.681312+0000","last_fullsized":"2026-02-26T03:18:10.681312+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.725511+0000","last_change":"2026-02-26T03:18:10.725791+0000","last_active":"2026-02-26T03:18:10.725511+0000","last_peered":"2026-02-26T03:18:10.725511+0000","last_clean":"2026-02-26T03:15:51.100441+0000","last_became_active":"2026-02-26T03:18:10.713355+0000","last_became_peered":"2026-02-26T03:18:10.713355+0000","last_unstale":"2026-02-26T03:18:10.725511+0000","last_undegraded":"2026-02-26T03:18:10.725511+0000","last_fullsized":"2026-02-26T03:18:10.725511+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.680750+0000","last_change":"2026-02-26T03:18:04.686779+0000","last_active":"2026-02-26T03:18:10.680750+0000","last_peered":"2026-02-26T03:18:10.680750+0000","last_clean":"2026-02-26T03:18:10.680750+0000","last_became_active":"2026-02-26T03:18:04.677987+0000","last_became_peered":"2026-02-26T03:18:04.677987+0000","last_unstale":"2026-02-26T03:18:10.680750+0000","last_undegraded":"2026-02-26T03:18:10.680750+0000","last_fullsized":"2026-02-26T03:18:10.680750+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"22'10","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.725224+0000","last_change":"2026-02-26T03:18:10.725525+0000","last_active":"2026-02-26T03:18:10.725224+0000","last_peered":"2026-02-26T03:18:10.725224+0000","last_clean":"2026-02-26T03:16:02.926645+0000","last_became_active":"2026-02-26T03:18:10.720584+0000","last_became_peered":"2026-02-26T03:18:10.720584+0000","last_unstale":"2026-02-26T03:18:10.725224+0000","last_undegraded":"2026-02-26T03:18:10.725224+0000","last_fullsized":"2026-02-26T03:18:10.725224+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320000,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.681325+0000","last_change":"2026-02-26T03:18:01.658129+0000","last_active":"2026-02-26T03:18:10.681325+0000","last_peered":"2026-02-26T03:18:10.681325+0000","last_clean":"2026-02-26T03:18:10.681325+0000","last_became_active":"2026-02-26T03:17:58.668374+0000","last_became_peered":"2026-02-26T03:17:58.668374+0000","last_unstale":"2026-02-26T03:18:10.681325+0000","last_undegraded":"2026-02-26T03:18:10.681325+0000","last_fullsized":"2026-02-26T03:18:10.681325+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"21'5","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.680861+0000","last_change":"2026-02-26T03:18:04.682579+0000","last_active":"2026-02-26T03:18:10.680861+0000","last_peered":"2026-02-26T03:18:10.680861+0000","last_clean":"2026-02-26T03:18:10.680861+0000","last_became_active":"2026-02-26T03:18:04.674002+0000","last_became_peered":"2026-02-26T03:18:04.674002+0000","last_unstale":"2026-02-26T03:18:10.680861+0000","last_undegraded":"2026-02-26T03:18:10.680861+0000","last_fullsized":"2026-02-26T03:18:10.680861+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":640000,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.711106+0000","last_change":"2026-02-26T03:18:10.711390+0000","last_active":"2026-02-26T03:18:10.711106+0000","last_peered":"2026-02-26T03:18:10.711106+0000","last_clean":"2026-02-26T03:15:49.143434+0000","last_became_active":"2026-02-26T03:18:10.703541+0000","last_became_peered":"2026-02-26T03:18:10.703541+0000","last_unstale":"2026-02-26T03:18:10.711106+0000","last_undegraded":"2026-02-26T03:18:10.711106+0000","last_fullsized":"2026-02-26T03:18:10.711106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.719628+0000","last_change":"2026-02-26T03:18:10.720198+0000","last_active":"2026-02-26T03:18:10.719628+0000","last_peered":"2026-02-26T03:18:10.719628+0000","last_clean":"2026-02-26T03:16:00.149150+0000","last_became_active":"2026-02-26T03:18:10.706057+0000","last_became_peered":"2026-02-26T03:18:10.706057+0000","last_unstale":"2026-02-26T03:18:10.719628+0000","last_undegraded":"2026-02-26T03:18:10.719628+0000","last_fullsized":"2026-02-26T03:18:10.719628+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.681896+0000","last_change":"2026-02-26T03:18:01.658102+0000","last_active":"2026-02-26T03:18:10.681896+0000","last_peered":"2026-02-26T03:18:10.681896+0000","last_clean":"2026-02-26T03:18:10.681896+0000","last_became_active":"2026-02-26T03:17:58.669338+0000","last_became_peered":"2026-02-26T03:17:58.669338+0000","last_unstale":"2026-02-26T03:18:10.681896+0000","last_undegraded":"2026-02-26T03:18:10.681896+0000","last_fullsized":"2026-02-26T03:18:10.681896+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"22'8","reported_seq":56,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.682317+0000","last_change":"2026-02-26T03:17:58.679001+0000","last_active":"2026-02-26T03:18:10.682317+0000","last_peered":"2026-02-26T03:18:10.682317+0000","last_clean":"2026-02-26T03:18:10.682317+0000","last_became_active":"2026-02-26T03:17:58.671210+0000","last_became_peered":"2026-02-26T03:17:58.671210+0000","last_unstale":"2026-02-26T03:18:10.682317+0000","last_undegraded":"2026-02-26T03:18:10.682317+0000","last_fullsized":"2026-02-26T03:18:10.682317+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320000,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":313,"num_write":8,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.721725+0000","last_change":"2026-02-26T03:18:10.722036+0000","last_active":"2026-02-26T03:18:10.721725+0000","last_peered":"2026-02-26T03:18:10.721725+0000","last_clean":"2026-02-26T03:15:49.144710+0000","last_became_active":"2026-02-26T03:18:10.707778+0000","last_became_peered":"2026-02-26T03:18:10.707778+0000","last_unstale":"2026-02-26T03:18:10.721725+0000","last_undegraded":"2026-02-26T03:18:10.721725+0000","last_fullsized":"2026-02-26T03:18:10.721725+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":1600000,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":313,"num_write":29,"num_write_kb":1575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214203342848,"internally_reserved":0,"allocated":8151040,"data_stored":8151040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160658620416,"available":160652242944,"internally_reserved":0,"allocated":6377472,"data_stored":6377472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":33,"seq":141733920777,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2228,"kb_used_data":2228,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295500,"statfs":{"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":29,"seq":124554051598,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2512,"kb_used_data":2512,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295216,"statfs":{"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":37,"seq":158913789956,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1488,"kb_used_data":1488,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296240,"statfs":{"total":53552873472,"available":53551349760,"internally_reserved":0,"allocated":1523712,"data_stored":1523712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":25,"seq":107374182423,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1732,"kb_used_data":1732,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295996,"statfs":{"total":53552873472,"available":53551099904,"internally_reserved":0,"allocated":1773568,"data_stored":1773568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551349760,"internally_reserved":0,"allocated":1523712,"data_stored":1523712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53551099904,"internally_reserved":0,"allocated":1773568,"data_stored":1773568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":53551349760,"internally_reserved":0,"allocated":1523712,"data_stored":1523712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-26T03:18:16.060 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-26T03:18:16.135 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:18:16.129+0000 7ffbaf8cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:18:16.137 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:18:16.134+0000 7ffbaf8cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:18:16.249 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:18:16.249 INFO:teuthology.orchestra.run.trial086.stdout:{"epoch":38,"fsid":"a3320112-ec0c-4bb6-bf8e-5331f894afbc","created":"2026-02-26T03:15:31.523265+0000","modified":"2026-02-26T03:18:10.667906+0000","last_up_change":"2026-02-26T03:18:09.659038+0000","last_in_change":"2026-02-26T03:15:33.471683+0000","flags":"nodown,noout,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5800128,"flags_set":["nodown","noout","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":9,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-26T03:15:45.957480+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-26T03:15:47.799106+0000","flags":270337,"flags_names":"hashpspool,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"rep_pool","create_time":"2026-02-26T03:15:58.484444+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b692f9c9-579d-4a92-b02c-beefe594ff12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":11,"last_clean_end":22,"up_from":25,"up_thru":36,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6803","nonce":2460553476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6804","nonce":2460553476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6808","nonce":2460553476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6809","nonce":2460553476}]},"public_addr":"10.20.193.86:6803/2460553476","cluster_addr":"10.20.193.86:6804/2460553476","heartbeat_back_addr":"10.20.193.86:6808/2460553476","heartbeat_front_addr":"10.20.193.86:6809/2460553476","state":["exists","up"]},{"osd":1,"uuid":"1935ef84-dee5-4745-8c38-6435b71c819c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":22,"up_from":29,"up_thru":36,"down_at":28,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6806","nonce":3646660580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6805","nonce":3646660580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6807","nonce":3646660580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6802","nonce":3646660580}]},"public_addr":"10.20.193.86:6806/3646660580","cluster_addr":"10.20.193.86:6805/3646660580","heartbeat_back_addr":"10.20.193.86:6807/3646660580","heartbeat_front_addr":"10.20.193.86:6802/3646660580","state":["exists","up"]},{"osd":2,"uuid":"bf958cf8-549c-42c6-9510-269812a65fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":22,"up_from":33,"up_thru":37,"down_at":32,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6810","nonce":3576541978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6811","nonce":3576541978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6813","nonce":3576541978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6812","nonce":3576541978}]},"public_addr":"10.20.193.86:6810/3576541978","cluster_addr":"10.20.193.86:6811/3576541978","heartbeat_back_addr":"10.20.193.86:6813/3576541978","heartbeat_front_addr":"10.20.193.86:6812/3576541978","state":["exists","up"]},{"osd":3,"uuid":"cf449d79-9ec0-4e20-a163-3ce8ac17c2cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":11,"last_clean_end":22,"up_from":37,"up_thru":37,"down_at":36,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6815","nonce":781725649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6814","nonce":781725649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6817","nonce":781725649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6816","nonce":781725649}]},"public_addr":"10.20.193.86:6815/781725649","cluster_addr":"10.20.193.86:6814/781725649","heartbeat_back_addr":"10.20.193.86:6817/781725649","heartbeat_front_addr":"10.20.193.86:6816/781725649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"2026-02-26T03:17:50.619747+0000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"2026-02-26T03:17:56.631609+0000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"2026-02-26T03:18:02.644016+0000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"2026-02-26T03:18:08.656741+0000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-26T03:18:17.260 INFO:tasks.ceph:Scrubbing osd.0 2026-02-26T03:18:17.260 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-26T03:18:17.337 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:18:17.329+0000 7fa2820cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:18:17.339 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:18:17.336+0000 7fa2820cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:18:17.349 INFO:teuthology.orchestra.run.trial086.stdout:{ 2026-02-26T03:18:17.349 INFO:teuthology.orchestra.run.trial086.stdout: "success": "" 2026-02-26T03:18:17.349 INFO:teuthology.orchestra.run.trial086.stdout:} 2026-02-26T03:18:17.358 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-26T03:18:17.434 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:18:17.427+0000 7fef108cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:18:17.436 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:18:17.433+0000 7fef108cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:18:17.549 INFO:teuthology.orchestra.run.trial086.stderr:instructed osd(s) 0 to deep-scrub 2026-02-26T03:18:17.560 INFO:tasks.ceph:Scrubbing osd.1 2026-02-26T03:18:17.561 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-26T03:18:17.640 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:18:17.631+0000 7fe3564cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:18:17.642 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:18:17.639+0000 7fe3564cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:18:17.651 INFO:teuthology.orchestra.run.trial086.stdout:{ 2026-02-26T03:18:17.651 INFO:teuthology.orchestra.run.trial086.stdout: "success": "" 2026-02-26T03:18:17.651 INFO:teuthology.orchestra.run.trial086.stdout:} 2026-02-26T03:18:17.659 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-26T03:18:17.736 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:18:17.729+0000 7fe2a82c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:18:17.738 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:18:17.734+0000 7fe2a82c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:18:17.849 INFO:teuthology.orchestra.run.trial086.stderr:instructed osd(s) 1 to deep-scrub 2026-02-26T03:18:17.860 INFO:tasks.ceph:Scrubbing osd.2 2026-02-26T03:18:17.860 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-26T03:18:17.942 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:18:17.934+0000 7f2697bd3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:18:17.945 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:18:17.941+0000 7f2697bd3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:18:17.956 INFO:teuthology.orchestra.run.trial086.stdout:{ 2026-02-26T03:18:17.956 INFO:teuthology.orchestra.run.trial086.stdout: "success": "" 2026-02-26T03:18:17.956 INFO:teuthology.orchestra.run.trial086.stdout:} 2026-02-26T03:18:17.963 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-26T03:18:18.039 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:18:18.033+0000 7f8efa1f5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:18:18.041 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:18:18.038+0000 7f8efa1f5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:18:18.152 INFO:teuthology.orchestra.run.trial086.stderr:instructed osd(s) 2 to deep-scrub 2026-02-26T03:18:18.162 INFO:tasks.ceph:Scrubbing osd.3 2026-02-26T03:18:18.162 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2026-02-26T03:18:18.240 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:18:18.232+0000 7fb36585a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:18:18.243 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:18:18.239+0000 7fb36585a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:18:18.252 INFO:teuthology.orchestra.run.trial086.stdout:{ 2026-02-26T03:18:18.252 INFO:teuthology.orchestra.run.trial086.stdout: "success": "" 2026-02-26T03:18:18.252 INFO:teuthology.orchestra.run.trial086.stdout:} 2026-02-26T03:18:18.259 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2026-02-26T03:18:18.334 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:18:18.328+0000 7f7dc885a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:18:18.336 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:18:18.332+0000 7f7dc885a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:18:18.447 INFO:teuthology.orchestra.run.trial086.stderr:instructed osd(s) 3 to deep-scrub 2026-02-26T03:18:18.457 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-26T03:18:18.532 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:18:18.526+0000 7fb8e9bf5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:18:18.534 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:18:18.530+0000 7fb8e9bf5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:18:18.644 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:18:18.644 INFO:teuthology.orchestra.run.trial086.stderr:dumped all 2026-02-26T03:18:18.653 INFO:teuthology.orchestra.run.trial086.stdout:{"pg_ready":true,"pg_map":{"version":107,"stamp":"2026-02-26T03:18:17.965385+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2190387,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":1298,"num_write":110,"num_write_kb":2683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":84,"ondisk_log_size":84,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":7960,"kb_used_data":7960,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209182952,"statfs":{"total":214211493888,"available":214203342848,"internally_reserved":0,"allocated":8151040,"data_stored":8151040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":320000,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1252,"num_write":6,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.305233"},"pg_stats":[{"pgid":"1.0","version":"13'52","reported_seq":107,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.680296+0000","last_change":"2026-02-26T03:17:58.671739+0000","last_active":"2026-02-26T03:18:10.680296+0000","last_peered":"2026-02-26T03:18:10.680296+0000","last_clean":"2026-02-26T03:18:10.680296+0000","last_became_active":"2026-02-26T03:17:58.664633+0000","last_became_peered":"2026-02-26T03:17:58.664633+0000","last_unstale":"2026-02-26T03:18:10.680296+0000","last_undegraded":"2026-02-26T03:18:10.680296+0000","last_fullsized":"2026-02-26T03:18:10.680296+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:46.067961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:46.067961+0000","last_clean_scrub_stamp":"2026-02-26T03:15:46.067961+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.731241+0000","last_change":"2026-02-26T03:18:10.731727+0000","last_active":"2026-02-26T03:18:10.731241+0000","last_peered":"2026-02-26T03:18:10.731241+0000","last_clean":"2026-02-26T03:15:49.131531+0000","last_became_active":"2026-02-26T03:18:10.710606+0000","last_became_peered":"2026-02-26T03:18:10.710606+0000","last_unstale":"2026-02-26T03:18:10.731241+0000","last_undegraded":"2026-02-26T03:18:10.731241+0000","last_fullsized":"2026-02-26T03:18:10.731241+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"22'6","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.725567+0000","last_change":"2026-02-26T03:18:10.726105+0000","last_active":"2026-02-26T03:18:10.725567+0000","last_peered":"2026-02-26T03:18:10.725567+0000","last_clean":"2026-02-26T03:16:01.156958+0000","last_became_active":"2026-02-26T03:18:10.708174+0000","last_became_peered":"2026-02-26T03:18:10.708174+0000","last_unstale":"2026-02-26T03:18:10.725567+0000","last_undegraded":"2026-02-26T03:18:10.725567+0000","last_fullsized":"2026-02-26T03:18:10.725567+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320000,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.719545+0000","last_change":"2026-02-26T03:18:10.720150+0000","last_active":"2026-02-26T03:18:10.719545+0000","last_peered":"2026-02-26T03:18:10.719545+0000","last_clean":"2026-02-26T03:15:49.134101+0000","last_became_active":"2026-02-26T03:18:10.703268+0000","last_became_peered":"2026-02-26T03:18:10.703268+0000","last_unstale":"2026-02-26T03:18:10.719545+0000","last_undegraded":"2026-02-26T03:18:10.719545+0000","last_fullsized":"2026-02-26T03:18:10.719545+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.681689+0000","last_change":"2026-02-26T03:18:04.686774+0000","last_active":"2026-02-26T03:18:10.681689+0000","last_peered":"2026-02-26T03:18:10.681689+0000","last_clean":"2026-02-26T03:18:10.681689+0000","last_became_active":"2026-02-26T03:18:04.681796+0000","last_became_peered":"2026-02-26T03:18:04.681796+0000","last_unstale":"2026-02-26T03:18:10.681689+0000","last_undegraded":"2026-02-26T03:18:10.681689+0000","last_fullsized":"2026-02-26T03:18:10.681689+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.734379+0000","last_change":"2026-02-26T03:18:10.734966+0000","last_active":"2026-02-26T03:18:10.734379+0000","last_peered":"2026-02-26T03:18:10.734379+0000","last_clean":"2026-02-26T03:15:49.136068+0000","last_became_active":"2026-02-26T03:18:10.723788+0000","last_became_peered":"2026-02-26T03:18:10.723788+0000","last_unstale":"2026-02-26T03:18:10.734379+0000","last_undegraded":"2026-02-26T03:18:10.734379+0000","last_fullsized":"2026-02-26T03:18:10.734379+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.681312+0000","last_change":"2026-02-26T03:18:04.686600+0000","last_active":"2026-02-26T03:18:10.681312+0000","last_peered":"2026-02-26T03:18:10.681312+0000","last_clean":"2026-02-26T03:18:10.681312+0000","last_became_active":"2026-02-26T03:18:04.680310+0000","last_became_peered":"2026-02-26T03:18:04.680310+0000","last_unstale":"2026-02-26T03:18:10.681312+0000","last_undegraded":"2026-02-26T03:18:10.681312+0000","last_fullsized":"2026-02-26T03:18:10.681312+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.725511+0000","last_change":"2026-02-26T03:18:10.725791+0000","last_active":"2026-02-26T03:18:10.725511+0000","last_peered":"2026-02-26T03:18:10.725511+0000","last_clean":"2026-02-26T03:15:51.100441+0000","last_became_active":"2026-02-26T03:18:10.713355+0000","last_became_peered":"2026-02-26T03:18:10.713355+0000","last_unstale":"2026-02-26T03:18:10.725511+0000","last_undegraded":"2026-02-26T03:18:10.725511+0000","last_fullsized":"2026-02-26T03:18:10.725511+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.680750+0000","last_change":"2026-02-26T03:18:04.686779+0000","last_active":"2026-02-26T03:18:10.680750+0000","last_peered":"2026-02-26T03:18:10.680750+0000","last_clean":"2026-02-26T03:18:10.680750+0000","last_became_active":"2026-02-26T03:18:04.677987+0000","last_became_peered":"2026-02-26T03:18:04.677987+0000","last_unstale":"2026-02-26T03:18:10.680750+0000","last_undegraded":"2026-02-26T03:18:10.680750+0000","last_fullsized":"2026-02-26T03:18:10.680750+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"22'10","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.725525+0000","last_change":"2026-02-26T03:18:10.725525+0000","last_active":"2026-02-26T03:18:10.725525+0000","last_peered":"2026-02-26T03:18:10.725525+0000","last_clean":"2026-02-26T03:18:10.725525+0000","last_became_active":"2026-02-26T03:18:10.720584+0000","last_became_peered":"2026-02-26T03:18:10.720584+0000","last_unstale":"2026-02-26T03:18:10.725525+0000","last_undegraded":"2026-02-26T03:18:10.725525+0000","last_fullsized":"2026-02-26T03:18:10.725525+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320000,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":313,"num_write":10,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.681325+0000","last_change":"2026-02-26T03:18:01.658129+0000","last_active":"2026-02-26T03:18:10.681325+0000","last_peered":"2026-02-26T03:18:10.681325+0000","last_clean":"2026-02-26T03:18:10.681325+0000","last_became_active":"2026-02-26T03:17:58.668374+0000","last_became_peered":"2026-02-26T03:17:58.668374+0000","last_unstale":"2026-02-26T03:18:10.681325+0000","last_undegraded":"2026-02-26T03:18:10.681325+0000","last_fullsized":"2026-02-26T03:18:10.681325+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"21'5","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:14.745599+0000","last_change":"2026-02-26T03:18:04.682579+0000","last_active":"2026-02-26T03:18:14.745599+0000","last_peered":"2026-02-26T03:18:14.745599+0000","last_clean":"2026-02-26T03:18:14.745599+0000","last_became_active":"2026-02-26T03:18:04.674002+0000","last_became_peered":"2026-02-26T03:18:04.674002+0000","last_unstale":"2026-02-26T03:18:14.745599+0000","last_undegraded":"2026-02-26T03:18:14.745599+0000","last_fullsized":"2026-02-26T03:18:14.745599+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":640000,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":626,"num_write":5,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.711106+0000","last_change":"2026-02-26T03:18:10.711390+0000","last_active":"2026-02-26T03:18:10.711106+0000","last_peered":"2026-02-26T03:18:10.711106+0000","last_clean":"2026-02-26T03:15:49.143434+0000","last_became_active":"2026-02-26T03:18:10.703541+0000","last_became_peered":"2026-02-26T03:18:10.703541+0000","last_unstale":"2026-02-26T03:18:10.711106+0000","last_undegraded":"2026-02-26T03:18:10.711106+0000","last_fullsized":"2026-02-26T03:18:10.711106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.719628+0000","last_change":"2026-02-26T03:18:10.720198+0000","last_active":"2026-02-26T03:18:10.719628+0000","last_peered":"2026-02-26T03:18:10.719628+0000","last_clean":"2026-02-26T03:16:00.149150+0000","last_became_active":"2026-02-26T03:18:10.706057+0000","last_became_peered":"2026-02-26T03:18:10.706057+0000","last_unstale":"2026-02-26T03:18:10.719628+0000","last_undegraded":"2026-02-26T03:18:10.719628+0000","last_fullsized":"2026-02-26T03:18:10.719628+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.681896+0000","last_change":"2026-02-26T03:18:01.658102+0000","last_active":"2026-02-26T03:18:10.681896+0000","last_peered":"2026-02-26T03:18:10.681896+0000","last_clean":"2026-02-26T03:18:10.681896+0000","last_became_active":"2026-02-26T03:17:58.669338+0000","last_became_peered":"2026-02-26T03:17:58.669338+0000","last_unstale":"2026-02-26T03:18:10.681896+0000","last_undegraded":"2026-02-26T03:18:10.681896+0000","last_fullsized":"2026-02-26T03:18:10.681896+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"22'8","reported_seq":56,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.682317+0000","last_change":"2026-02-26T03:17:58.679001+0000","last_active":"2026-02-26T03:18:10.682317+0000","last_peered":"2026-02-26T03:18:10.682317+0000","last_clean":"2026-02-26T03:18:10.682317+0000","last_became_active":"2026-02-26T03:17:58.671210+0000","last_became_peered":"2026-02-26T03:17:58.671210+0000","last_unstale":"2026-02-26T03:18:10.682317+0000","last_undegraded":"2026-02-26T03:18:10.682317+0000","last_fullsized":"2026-02-26T03:18:10.682317+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:59.102428+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320000,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":313,"num_write":8,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:10.721725+0000","last_change":"2026-02-26T03:18:10.722036+0000","last_active":"2026-02-26T03:18:10.721725+0000","last_peered":"2026-02-26T03:18:10.721725+0000","last_clean":"2026-02-26T03:15:49.144710+0000","last_became_active":"2026-02-26T03:18:10.707778+0000","last_became_peered":"2026-02-26T03:18:10.707778+0000","last_unstale":"2026-02-26T03:18:10.721725+0000","last_undegraded":"2026-02-26T03:18:10.721725+0000","last_fullsized":"2026-02-26T03:18:10.721725+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:15:48.075234+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":1600000,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1252,"num_write":29,"num_write_kb":1575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214203342848,"internally_reserved":0,"allocated":8151040,"data_stored":8151040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160658620416,"available":160652242944,"internally_reserved":0,"allocated":6377472,"data_stored":6377472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":33,"seq":141733920782,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2228,"kb_used_data":2228,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295500,"statfs":{"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":29,"seq":124554051603,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2512,"kb_used_data":2512,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295216,"statfs":{"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":37,"seq":158913789956,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1488,"kb_used_data":1488,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296240,"statfs":{"total":53552873472,"available":53551349760,"internally_reserved":0,"allocated":1523712,"data_stored":1523712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":25,"seq":107374182423,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1732,"kb_used_data":1732,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295996,"statfs":{"total":53552873472,"available":53551099904,"internally_reserved":0,"allocated":1773568,"data_stored":1773568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551349760,"internally_reserved":0,"allocated":1523712,"data_stored":1523712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53551099904,"internally_reserved":0,"allocated":1773568,"data_stored":1773568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":53551349760,"internally_reserved":0,"allocated":1523712,"data_stored":1523712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-26T03:18:18.659 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-26T03:15:46.067961+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=3, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=3, tm_min=18, tm_sec=16, tm_wday=3, tm_yday=57, tm_isdst=0) 2026-02-26T03:18:18.660 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2026-02-26T03:15:48.075234+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=3, tm_min=15, tm_sec=48, tm_wday=3, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=3, tm_min=18, tm_sec=16, tm_wday=3, tm_yday=57, tm_isdst=0) 2026-02-26T03:18:18.660 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2026-02-26T03:15:59.102428+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=3, tm_min=15, tm_sec=59, tm_wday=3, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=3, tm_min=18, tm_sec=16, tm_wday=3, tm_yday=57, tm_isdst=0) 2026-02-26T03:18:18.660 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2026-02-26T03:15:48.075234+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=3, tm_min=15, tm_sec=48, tm_wday=3, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=3, tm_min=18, tm_sec=16, tm_wday=3, tm_yday=57, tm_isdst=0) 2026-02-26T03:18:18.660 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2026-02-26T03:15:59.102428+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=3, tm_min=15, tm_sec=59, tm_wday=3, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=3, tm_min=18, tm_sec=16, tm_wday=3, tm_yday=57, tm_isdst=0) 2026-02-26T03:18:18.660 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2026-02-26T03:15:48.075234+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=3, tm_min=15, tm_sec=48, tm_wday=3, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=3, tm_min=18, tm_sec=16, tm_wday=3, tm_yday=57, tm_isdst=0) 2026-02-26T03:18:18.661 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2026-02-26T03:15:59.102428+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=3, tm_min=15, tm_sec=59, tm_wday=3, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=3, tm_min=18, tm_sec=16, tm_wday=3, tm_yday=57, tm_isdst=0) 2026-02-26T03:18:18.661 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2026-02-26T03:15:48.075234+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=3, tm_min=15, tm_sec=48, tm_wday=3, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=3, tm_min=18, tm_sec=16, tm_wday=3, tm_yday=57, tm_isdst=0) 2026-02-26T03:18:18.661 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2026-02-26T03:15:59.102428+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=3, tm_min=15, tm_sec=59, tm_wday=3, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=3, tm_min=18, tm_sec=16, tm_wday=3, tm_yday=57, tm_isdst=0) 2026-02-26T03:18:18.661 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2026-02-26T03:15:59.102428+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=3, tm_min=15, tm_sec=59, tm_wday=3, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=3, tm_min=18, tm_sec=16, tm_wday=3, tm_yday=57, tm_isdst=0) 2026-02-26T03:18:18.661 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2026-02-26T03:15:48.075234+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=3, tm_min=15, tm_sec=48, tm_wday=3, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=3, tm_min=18, tm_sec=16, tm_wday=3, tm_yday=57, tm_isdst=0) 2026-02-26T03:18:18.661 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2026-02-26T03:15:59.102428+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=3, tm_min=15, tm_sec=59, tm_wday=3, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=3, tm_min=18, tm_sec=16, tm_wday=3, tm_yday=57, tm_isdst=0) 2026-02-26T03:18:18.661 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2026-02-26T03:15:48.075234+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=3, tm_min=15, tm_sec=48, tm_wday=3, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=3, tm_min=18, tm_sec=16, tm_wday=3, tm_yday=57, tm_isdst=0) 2026-02-26T03:18:18.662 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2026-02-26T03:15:59.102428+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=3, tm_min=15, tm_sec=59, tm_wday=3, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=3, tm_min=18, tm_sec=16, tm_wday=3, tm_yday=57, tm_isdst=0) 2026-02-26T03:18:18.662 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2026-02-26T03:15:48.075234+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=3, tm_min=15, tm_sec=48, tm_wday=3, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=3, tm_min=18, tm_sec=16, tm_wday=3, tm_yday=57, tm_isdst=0) 2026-02-26T03:18:18.662 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2026-02-26T03:15:59.102428+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=3, tm_min=15, tm_sec=59, tm_wday=3, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=3, tm_min=18, tm_sec=16, tm_wday=3, tm_yday=57, tm_isdst=0) 2026-02-26T03:18:18.662 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2026-02-26T03:15:48.075234+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=3, tm_min=15, tm_sec=48, tm_wday=3, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=3, tm_min=18, tm_sec=16, tm_wday=3, tm_yday=57, tm_isdst=0) 2026-02-26T03:18:18.662 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-26T03:18:38.663 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-26T03:18:38.739 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:18:38.733+0000 7f637c61a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:18:38.741 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:18:38.738+0000 7f637c61a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:18:38.855 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-26T03:18:38.855 INFO:teuthology.orchestra.run.trial086.stderr:dumped all 2026-02-26T03:18:38.864 INFO:teuthology.orchestra.run.trial086.stdout:{"pg_ready":true,"pg_map":{"version":117,"stamp":"2026-02-26T03:18:37.969489+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2190387,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":1611,"num_write":110,"num_write_kb":2683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":84,"ondisk_log_size":84,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":7960,"kb_used_data":7960,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209182952,"statfs":{"total":214211493888,"available":214203342848,"internally_reserved":0,"allocated":8151040,"data_stored":8151040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002526"},"pg_stats":[{"pgid":"1.0","version":"13'52","reported_seq":109,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:17.847747+0000","last_change":"2026-02-26T03:18:17.888562+0000","last_active":"2026-02-26T03:18:17.847747+0000","last_peered":"2026-02-26T03:18:17.847747+0000","last_clean":"2026-02-26T03:18:17.847747+0000","last_became_active":"2026-02-26T03:17:58.664633+0000","last_became_peered":"2026-02-26T03:17:58.664633+0000","last_unstale":"2026-02-26T03:18:17.847747+0000","last_undegraded":"2026-02-26T03:18:17.847747+0000","last_fullsized":"2026-02-26T03:18:17.847747+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"13'52","last_scrub_stamp":"2026-02-26T03:18:17.888501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:18:17.888501+0000","last_clean_scrub_stamp":"2026-02-26T03:15:46.067961+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":19,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:18.447795+0000","last_change":"2026-02-26T03:18:18.471184+0000","last_active":"2026-02-26T03:18:18.447795+0000","last_peered":"2026-02-26T03:18:18.447795+0000","last_clean":"2026-02-26T03:18:18.447795+0000","last_became_active":"2026-02-26T03:18:10.710606+0000","last_became_peered":"2026-02-26T03:18:10.710606+0000","last_unstale":"2026-02-26T03:18:18.447795+0000","last_undegraded":"2026-02-26T03:18:18.447795+0000","last_fullsized":"2026-02-26T03:18:18.447795+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'1","last_scrub_stamp":"2026-02-26T03:18:18.471111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:18:18.471111+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"22'6","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:18.448857+0000","last_change":"2026-02-26T03:18:18.472648+0000","last_active":"2026-02-26T03:18:18.448857+0000","last_peered":"2026-02-26T03:18:18.448857+0000","last_clean":"2026-02-26T03:18:18.448857+0000","last_became_active":"2026-02-26T03:18:10.708174+0000","last_became_peered":"2026-02-26T03:18:10.708174+0000","last_unstale":"2026-02-26T03:18:18.448857+0000","last_undegraded":"2026-02-26T03:18:18.448857+0000","last_fullsized":"2026-02-26T03:18:18.448857+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'6","last_scrub_stamp":"2026-02-26T03:18:18.472584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:18:18.472584+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320000,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":313,"num_write":6,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:18.446659+0000","last_change":"2026-02-26T03:18:18.462832+0000","last_active":"2026-02-26T03:18:18.446659+0000","last_peered":"2026-02-26T03:18:18.446659+0000","last_clean":"2026-02-26T03:18:18.446659+0000","last_became_active":"2026-02-26T03:18:10.703268+0000","last_became_peered":"2026-02-26T03:18:10.703268+0000","last_unstale":"2026-02-26T03:18:18.446659+0000","last_undegraded":"2026-02-26T03:18:18.446659+0000","last_fullsized":"2026-02-26T03:18:18.446659+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:18:18.462771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:18:18.462771+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:17.547999+0000","last_change":"2026-02-26T03:18:17.556026+0000","last_active":"2026-02-26T03:18:17.547999+0000","last_peered":"2026-02-26T03:18:17.547999+0000","last_clean":"2026-02-26T03:18:17.547999+0000","last_became_active":"2026-02-26T03:18:04.681796+0000","last_became_peered":"2026-02-26T03:18:04.681796+0000","last_unstale":"2026-02-26T03:18:17.547999+0000","last_undegraded":"2026-02-26T03:18:17.547999+0000","last_fullsized":"2026-02-26T03:18:17.547999+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:18:17.555942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:18:17.555942+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:18.151000+0000","last_change":"2026-02-26T03:18:18.159253+0000","last_active":"2026-02-26T03:18:18.151000+0000","last_peered":"2026-02-26T03:18:18.151000+0000","last_clean":"2026-02-26T03:18:18.151000+0000","last_became_active":"2026-02-26T03:18:10.723788+0000","last_became_peered":"2026-02-26T03:18:10.723788+0000","last_unstale":"2026-02-26T03:18:18.151000+0000","last_undegraded":"2026-02-26T03:18:18.151000+0000","last_fullsized":"2026-02-26T03:18:18.151000+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:18:18.159186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:18:18.159186+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:17.849894+0000","last_change":"2026-02-26T03:18:17.862480+0000","last_active":"2026-02-26T03:18:17.849894+0000","last_peered":"2026-02-26T03:18:17.849894+0000","last_clean":"2026-02-26T03:18:17.849894+0000","last_became_active":"2026-02-26T03:18:04.680310+0000","last_became_peered":"2026-02-26T03:18:04.680310+0000","last_unstale":"2026-02-26T03:18:17.849894+0000","last_undegraded":"2026-02-26T03:18:17.849894+0000","last_fullsized":"2026-02-26T03:18:17.849894+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:18:17.862392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:18:17.862392+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":26,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:18.447203+0000","last_change":"2026-02-26T03:18:18.463201+0000","last_active":"2026-02-26T03:18:18.447203+0000","last_peered":"2026-02-26T03:18:18.447203+0000","last_clean":"2026-02-26T03:18:18.447203+0000","last_became_active":"2026-02-26T03:18:10.713355+0000","last_became_peered":"2026-02-26T03:18:10.713355+0000","last_unstale":"2026-02-26T03:18:18.447203+0000","last_undegraded":"2026-02-26T03:18:18.447203+0000","last_fullsized":"2026-02-26T03:18:18.447203+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"17'2","last_scrub_stamp":"2026-02-26T03:18:18.463124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:18:18.463124+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:17.547975+0000","last_change":"2026-02-26T03:18:17.555229+0000","last_active":"2026-02-26T03:18:17.547975+0000","last_peered":"2026-02-26T03:18:17.547975+0000","last_clean":"2026-02-26T03:18:17.547975+0000","last_became_active":"2026-02-26T03:18:04.677987+0000","last_became_peered":"2026-02-26T03:18:04.677987+0000","last_unstale":"2026-02-26T03:18:17.547975+0000","last_undegraded":"2026-02-26T03:18:17.547975+0000","last_fullsized":"2026-02-26T03:18:17.547975+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:18:17.555154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:18:17.555154+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"22'10","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:18.151837+0000","last_change":"2026-02-26T03:18:18.163766+0000","last_active":"2026-02-26T03:18:18.151837+0000","last_peered":"2026-02-26T03:18:18.151837+0000","last_clean":"2026-02-26T03:18:18.151837+0000","last_became_active":"2026-02-26T03:18:10.720584+0000","last_became_peered":"2026-02-26T03:18:10.720584+0000","last_unstale":"2026-02-26T03:18:18.151837+0000","last_undegraded":"2026-02-26T03:18:18.151837+0000","last_fullsized":"2026-02-26T03:18:18.151837+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'10","last_scrub_stamp":"2026-02-26T03:18:18.163681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:18:18.163681+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320000,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":313,"num_write":10,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:17.848169+0000","last_change":"2026-02-26T03:18:17.857577+0000","last_active":"2026-02-26T03:18:17.848169+0000","last_peered":"2026-02-26T03:18:17.848169+0000","last_clean":"2026-02-26T03:18:17.848169+0000","last_became_active":"2026-02-26T03:17:58.668374+0000","last_became_peered":"2026-02-26T03:17:58.668374+0000","last_unstale":"2026-02-26T03:18:17.848169+0000","last_undegraded":"2026-02-26T03:18:17.848169+0000","last_fullsized":"2026-02-26T03:18:17.848169+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:18:17.857500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:18:17.857500+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"21'5","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:17.849144+0000","last_change":"2026-02-26T03:18:17.879548+0000","last_active":"2026-02-26T03:18:17.849144+0000","last_peered":"2026-02-26T03:18:17.849144+0000","last_clean":"2026-02-26T03:18:17.849144+0000","last_became_active":"2026-02-26T03:18:04.674002+0000","last_became_peered":"2026-02-26T03:18:04.674002+0000","last_unstale":"2026-02-26T03:18:17.849144+0000","last_undegraded":"2026-02-26T03:18:17.849144+0000","last_fullsized":"2026-02-26T03:18:17.849144+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'5","last_scrub_stamp":"2026-02-26T03:18:17.879484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:18:17.879484+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":640000,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":626,"num_write":5,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:18.447856+0000","last_change":"2026-02-26T03:18:18.459980+0000","last_active":"2026-02-26T03:18:18.447856+0000","last_peered":"2026-02-26T03:18:18.447856+0000","last_clean":"2026-02-26T03:18:18.447856+0000","last_became_active":"2026-02-26T03:18:10.703541+0000","last_became_peered":"2026-02-26T03:18:10.703541+0000","last_unstale":"2026-02-26T03:18:18.447856+0000","last_undegraded":"2026-02-26T03:18:18.447856+0000","last_fullsized":"2026-02-26T03:18:18.447856+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:18:18.459908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:18:18.459908+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:18.449697+0000","last_change":"2026-02-26T03:18:18.460948+0000","last_active":"2026-02-26T03:18:18.449697+0000","last_peered":"2026-02-26T03:18:18.449697+0000","last_clean":"2026-02-26T03:18:18.449697+0000","last_became_active":"2026-02-26T03:18:10.706057+0000","last_became_peered":"2026-02-26T03:18:10.706057+0000","last_unstale":"2026-02-26T03:18:18.449697+0000","last_undegraded":"2026-02-26T03:18:18.449697+0000","last_fullsized":"2026-02-26T03:18:18.449697+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:18:18.460889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:18:18.460889+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:17.849303+0000","last_change":"2026-02-26T03:18:17.860549+0000","last_active":"2026-02-26T03:18:17.849303+0000","last_peered":"2026-02-26T03:18:17.849303+0000","last_clean":"2026-02-26T03:18:17.849303+0000","last_became_active":"2026-02-26T03:17:58.669338+0000","last_became_peered":"2026-02-26T03:17:58.669338+0000","last_unstale":"2026-02-26T03:18:17.849303+0000","last_undegraded":"2026-02-26T03:18:17.849303+0000","last_fullsized":"2026-02-26T03:18:17.849303+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:18:17.860443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:18:17.860443+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"22'8","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:17.548618+0000","last_change":"2026-02-26T03:18:17.562641+0000","last_active":"2026-02-26T03:18:17.548618+0000","last_peered":"2026-02-26T03:18:17.548618+0000","last_clean":"2026-02-26T03:18:17.548618+0000","last_became_active":"2026-02-26T03:17:58.671210+0000","last_became_peered":"2026-02-26T03:17:58.671210+0000","last_unstale":"2026-02-26T03:18:17.548618+0000","last_undegraded":"2026-02-26T03:18:17.548618+0000","last_fullsized":"2026-02-26T03:18:17.548618+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'8","last_scrub_stamp":"2026-02-26T03:18:17.562520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:18:17.562520+0000","last_clean_scrub_stamp":"2026-02-26T03:15:59.102428+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320000,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":313,"num_write":8,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-26T03:18:18.448516+0000","last_change":"2026-02-26T03:18:18.461294+0000","last_active":"2026-02-26T03:18:18.448516+0000","last_peered":"2026-02-26T03:18:18.448516+0000","last_clean":"2026-02-26T03:18:18.448516+0000","last_became_active":"2026-02-26T03:18:10.707778+0000","last_became_peered":"2026-02-26T03:18:10.707778+0000","last_unstale":"2026-02-26T03:18:18.448516+0000","last_undegraded":"2026-02-26T03:18:18.448516+0000","last_fullsized":"2026-02-26T03:18:18.448516+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T03:18:18.461235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T03:18:18.461235+0000","last_clean_scrub_stamp":"2026-02-26T03:15:48.075234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":1600000,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1565,"num_write":29,"num_write_kb":1575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214203342848,"internally_reserved":0,"allocated":8151040,"data_stored":8151040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160658620416,"available":160652242944,"internally_reserved":0,"allocated":6377472,"data_stored":6377472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":2,"up_from":33,"seq":141733920801,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2228,"kb_used_data":2228,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295500,"statfs":{"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":29,"seq":124554051622,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2512,"kb_used_data":2512,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295216,"statfs":{"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":37,"seq":158913789976,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1488,"kb_used_data":1488,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296240,"statfs":{"total":53552873472,"available":53551349760,"internally_reserved":0,"allocated":1523712,"data_stored":1523712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":25,"seq":107374182443,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1732,"kb_used_data":1732,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295996,"statfs":{"total":53552873472,"available":53551099904,"internally_reserved":0,"allocated":1773568,"data_stored":1773568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551349760,"internally_reserved":0,"allocated":1523712,"data_stored":1523712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53551099904,"internally_reserved":0,"allocated":1773568,"data_stored":1773568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":53551349760,"internally_reserved":0,"allocated":1523712,"data_stored":1523712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-26T03:18:38.865 DEBUG:teuthology.orchestra.run.trial086:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-26T03:18:38.940 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:18:38.933+0000 7f13d7d0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:18:38.942 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-26T03:18:38.939+0000 7f13d7d0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-26T03:18:39.067 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-26T03:18:39.068 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-26T03:18:39.068 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-26T03:18:39.068 INFO:teuthology.orchestra.run:waiting for 300 2026-02-26T03:18:39.132 INFO:tasks.ceph.osd.0:Stopped 2026-02-26T03:18:39.133 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-26T03:18:39.133 INFO:teuthology.orchestra.run:waiting for 300 2026-02-26T03:18:39.201 INFO:tasks.ceph.osd.1:Stopped 2026-02-26T03:18:39.201 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-26T03:18:39.201 INFO:teuthology.orchestra.run:waiting for 300 2026-02-26T03:18:39.263 INFO:tasks.ceph.osd.2:Stopped 2026-02-26T03:18:39.263 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-26T03:18:39.263 INFO:teuthology.orchestra.run:waiting for 300 2026-02-26T03:18:39.327 INFO:tasks.ceph.osd.3:Stopped 2026-02-26T03:18:39.327 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-26T03:18:39.327 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-26T03:18:39.327 INFO:teuthology.orchestra.run:waiting for 300 2026-02-26T03:18:39.360 INFO:tasks.ceph.mgr.x:Stopped 2026-02-26T03:18:39.360 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-26T03:18:39.360 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-26T03:18:39.360 INFO:teuthology.orchestra.run:waiting for 300 2026-02-26T03:18:39.410 INFO:tasks.ceph.mon.a:Stopped 2026-02-26T03:18:39.410 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-26T03:18:39.410 DEBUG:teuthology.orchestra.run.trial086:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v '\(POOL_APP_NOT_ENABLED\)' | grep -E -v 'but it is still running' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSDMAP_FLAGS\)' | grep -E -v '\(OSD_' | grep -E -v '\(PG_' | grep -E -v '\(OBJECT_' | grep -E -v 'for optimal performance' | head -n 1 2026-02-26T03:18:39.475 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial086.front.sepia.ceph.com 2026-02-26T03:18:39.475 DEBUG:teuthology.orchestra.run.trial086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-26T03:18:39.545 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial086.front.sepia.ceph.com 2026-02-26T03:18:39.545 DEBUG:teuthology.orchestra.run.trial086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-26T03:18:39.613 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial086.front.sepia.ceph.com 2026-02-26T03:18:39.613 DEBUG:teuthology.orchestra.run.trial086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-26T03:18:39.687 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial086.front.sepia.ceph.com 2026-02-26T03:18:39.687 DEBUG:teuthology.orchestra.run.trial086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-26T03:18:39.756 INFO:tasks.ceph:Archiving mon data... 2026-02-26T03:18:39.758 DEBUG:teuthology.misc:Transferring archived files from trial086:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-26_02:22:56-crimson-rados-main-distro-debug-trial/71141/data/mon.a.tgz 2026-02-26T03:18:39.758 DEBUG:teuthology.orchestra.run.trial086:> mktemp 2026-02-26T03:18:39.812 INFO:teuthology.orchestra.run.trial086.stdout:/tmp/tmp.guwZqGXloa 2026-02-26T03:18:39.812 DEBUG:teuthology.orchestra.run.trial086:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.guwZqGXloa 2026-02-26T03:18:39.900 DEBUG:teuthology.orchestra.run.trial086:> sudo chmod 0666 /tmp/tmp.guwZqGXloa 2026-02-26T03:18:39.982 DEBUG:teuthology.orchestra.remote:trial086:/tmp/tmp.guwZqGXloa is 216KB 2026-02-26T03:18:40.074 DEBUG:teuthology.orchestra.run.trial086:> rm -fr /tmp/tmp.guwZqGXloa 2026-02-26T03:18:40.090 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-26T03:18:40.091 DEBUG:teuthology.orchestra.run.trial086:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-26T03:18:40.212 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-26T03:18:40.212 INFO:tasks.ceph:Archiving crash dumps... 2026-02-26T03:18:40.215 DEBUG:teuthology.misc:Transferring archived files from trial086:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-26_02:22:56-crimson-rados-main-distro-debug-trial/71141/remote/trial086/crash 2026-02-26T03:18:40.216 DEBUG:teuthology.orchestra.run.trial086:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-26T03:18:40.277 INFO:tasks.ceph:Compressing logs... 2026-02-26T03:18:40.277 DEBUG:teuthology.orchestra.run.trial086:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-26T03:18:40.341 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46815.log 2026-02-26T03:18:40.342 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44173.log 2026-02-26T03:18:40.342 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.46815.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-26T03:18:40.342 INFO:teuthology.orchestra.run.trial086.stderr: 66.4% -- replaced with /var/log/ceph/ceph-client.admin.46815.log.gz 2026-02-26T03:18:40.342 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.44173.log: 66.7% -- replaced with /var/log/ceph/ceph-client.admin.44173.log.gz 2026-02-26T03:18:40.342 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43957.log 2026-02-26T03:18:40.342 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40764.log 2026-02-26T03:18:40.342 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.43957.log: 66.1% -- replaced with /var/log/ceph/ceph-client.admin.43957.log.gz 2026-02-26T03:18:40.342 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-26T03:18:40.343 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43569.log 2026-02-26T03:18:40.343 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.40764.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40764.log.gz 2026-02-26T03:18:40.343 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42789.log 2026-02-26T03:18:40.343 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.43569.log: 66.7% -- replaced with /var/log/ceph/ceph-client.admin.43569.log.gz 2026-02-26T03:18:40.343 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47091.log 2026-02-26T03:18:40.343 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.42789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43482.log 2026-02-26T03:18:40.343 INFO:teuthology.orchestra.run.trial086.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.42789.log.gz 2026-02-26T03:18:40.343 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.47091.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47091.log.gz 2026-02-26T03:18:40.343 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47581.log 2026-02-26T03:18:40.344 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.43482.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-26T03:18:40.344 INFO:teuthology.orchestra.run.trial086.stderr: 66.4% -- replaced with /var/log/ceph/ceph-client.admin.43482.log.gz 2026-02-26T03:18:40.344 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.47581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47726.log 2026-02-26T03:18:40.344 INFO:teuthology.orchestra.run.trial086.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.47581.log.gz 2026-02-26T03:18:40.344 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46949.log 2026-02-26T03:18:40.344 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.47726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43871.log 2026-02-26T03:18:40.344 INFO:teuthology.orchestra.run.trial086.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47726.log.gz 2026-02-26T03:18:40.345 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.46949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43741.log 2026-02-26T03:18:40.345 INFO:teuthology.orchestra.run.trial086.stderr: 66.4% -- replaced with /var/log/ceph/ceph-client.admin.46949.log.gz 2026-02-26T03:18:40.345 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42446.log 2026-02-26T03:18:40.345 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.43871.log: 66.1% -- replaced with /var/log/ceph/ceph-client.admin.43871.log.gz 2026-02-26T03:18:40.345 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.43741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44388.log 2026-02-26T03:18:40.345 INFO:teuthology.orchestra.run.trial086.stderr: 66.4% -- replaced with /var/log/ceph/ceph-client.admin.43741.log.gz 2026-02-26T03:18:40.345 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.42446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41649.log 2026-02-26T03:18:40.346 INFO:teuthology.orchestra.run.trial086.stderr: 48.4% -- replaced with /var/log/ceph/ceph-client.admin.42446.log.gz 2026-02-26T03:18:40.346 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.44388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42397.log 2026-02-26T03:18:40.346 INFO:teuthology.orchestra.run.trial086.stderr: 66.7% -- replaced with /var/log/ceph/ceph-client.admin.44388.log.gz 2026-02-26T03:18:40.346 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-26T03:18:40.346 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.41649.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41649.log.gz 2026-02-26T03:18:40.346 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.42397.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42397.log.gz 2026-02-26T03:18:40.346 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42084.log 2026-02-26T03:18:40.346 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41020.log 2026-02-26T03:18:40.347 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.42084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47189.log 2026-02-26T03:18:40.347 INFO:teuthology.orchestra.run.trial086.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42084.log.gz 2026-02-26T03:18:40.347 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.41020.log: 50.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.41020.log.gz -5 2026-02-26T03:18:40.347 INFO:teuthology.orchestra.run.trial086.stderr: --verbose -- /var/log/ceph/ceph-client.admin.41744.log 2026-02-26T03:18:40.347 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.47189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43309.log 2026-02-26T03:18:40.347 INFO:teuthology.orchestra.run.trial086.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47189.log.gz 2026-02-26T03:18:40.347 INFO:teuthology.orchestra.run.trial086.stderr:gzip/var/log/ceph/ceph-client.admin.41744.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.47385.log 2026-02-26T03:18:40.348 INFO:teuthology.orchestra.run.trial086.stderr: 66.7% -- replaced with /var/log/ceph/ceph-client.admin.41744.log.gz 2026-02-26T03:18:40.348 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.43309.log: 66.7% -- replaced with /var/log/ceph/ceph-client.admin.43309.log.gz 2026-02-26T03:18:40.348 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41956.log 2026-02-26T03:18:40.348 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.47385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41858.log 2026-02-26T03:18:40.348 INFO:teuthology.orchestra.run.trial086.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47385.log.gz 2026-02-26T03:18:40.348 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.41956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40668.log 2026-02-26T03:18:40.348 INFO:teuthology.orchestra.run.trial086.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41956.log.gz 2026-02-26T03:18:40.349 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.41858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44000.log 2026-02-26T03:18:40.349 INFO:teuthology.orchestra.run.trial086.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41858.log.gz 2026-02-26T03:18:40.349 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.40668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43526.log 2026-02-26T03:18:40.349 INFO:teuthology.orchestra.run.trial086.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.40668.log.gz 2026-02-26T03:18:40.349 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.44000.log: 66.7% -- replaced with /var/log/ceph/ceph-client.admin.44000.log.gz 2026-02-26T03:18:40.349 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42961.log 2026-02-26T03:18:40.349 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.43526.log: 66.7% -- replaced with /var/log/ceph/ceph-client.admin.43526.log.gz 2026-02-26T03:18:40.349 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47483.log 2026-02-26T03:18:40.350 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.42961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41120.log 2026-02-26T03:18:40.350 INFO:teuthology.orchestra.run.trial086.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42961.log.gz 2026-02-26T03:18:40.350 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.47483.log: 50.8% -- replaced with /var/log/ceph/ceph-client.admin.47483.log.gz 2026-02-26T03:18:40.350 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47287.log 2026-02-26T03:18:40.350 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.41120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44431.log 2026-02-26T03:18:40.350 INFO:teuthology.orchestra.run.trial086.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41120.log.gz 2026-02-26T03:18:40.350 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.47287.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47287.log.gz 2026-02-26T03:18:40.351 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40811.log 2026-02-26T03:18:40.351 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.44431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47336.log 2026-02-26T03:18:40.351 INFO:teuthology.orchestra.run.trial086.stderr: 66.4% -- replaced with /var/log/ceph/ceph-client.admin.44431.log.gz 2026-02-26T03:18:40.351 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.40811.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40811.log.gz 2026-02-26T03:18:40.351 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42838.log 2026-02-26T03:18:40.351 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.47336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43785.log 2026-02-26T03:18:40.351 INFO:teuthology.orchestra.run.trial086.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47336.log.gz 2026-02-26T03:18:40.352 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.42838.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42838.log.gz 2026-02-26T03:18:40.352 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47238.log 2026-02-26T03:18:40.352 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.43785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46748.log 2026-02-26T03:18:40.352 INFO:teuthology.orchestra.run.trial086.stderr: 65.6% -- replaced with /var/log/ceph/ceph-client.admin.43785.log.gz 2026-02-26T03:18:40.352 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.47238.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47238.log.gz 2026-02-26T03:18:40.352 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43265.log 2026-02-26T03:18:40.352 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.46748.log: 66.7% -- replaced with /var/log/ceph/ceph-client.admin.46748.log.gz 2026-02-26T03:18:40.352 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46295.log 2026-02-26T03:18:40.353 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.43265.log: 66.7% -- replaced with /var/log/ceph/ceph-client.admin.43265.log.gz 2026-02-26T03:18:40.353 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42593.log 2026-02-26T03:18:40.353 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.46295.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46295.log.gz 2026-02-26T03:18:40.353 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42544.log 2026-02-26T03:18:40.353 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.42593.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42593.log.gz 2026-02-26T03:18:40.353 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42691.log 2026-02-26T03:18:40.353 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.42544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42495.log 2026-02-26T03:18:40.354 INFO:teuthology.orchestra.run.trial086.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42544.log.gz 2026-02-26T03:18:40.354 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.42691.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42691.log.gz 2026-02-26T03:18:40.354 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44345.log 2026-02-26T03:18:40.354 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.42495.log: 47.6% -- replaced with /var/log/ceph/ceph-client.admin.42495.log.gz 2026-02-26T03:18:40.354 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44216.log 2026-02-26T03:18:40.354 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.44345.log: 66.7% -- replaced with /var/log/ceph/ceph-client.admin.44345.log.gz 2026-02-26T03:18:40.354 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42740.log 2026-02-26T03:18:40.355 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.44216.log: 66.4% -- replaced with /var/log/ceph/ceph-client.admin.44216.log.gz 2026-02-26T03:18:40.355 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42642.log 2026-02-26T03:18:40.355 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.42740.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42740.log.gz 2026-02-26T03:18:40.355 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43439.log 2026-02-26T03:18:40.355 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.42642.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42642.log.gz 2026-02-26T03:18:40.355 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42278.log 2026-02-26T03:18:40.355 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.43439.log: 66.7% -- replaced with /var/log/ceph/ceph-client.admin.43439.log.gz 2026-02-26T03:18:40.355 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47042.log 2026-02-26T03:18:40.356 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.42278.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.42278.log.gz 2026-02-26T03:18:40.356 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42086.log 2026-02-26T03:18:40.356 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.47042.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47042.log.gz 2026-02-26T03:18:40.356 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44130.log 2026-02-26T03:18:40.356 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.42086.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42086.log.gz 2026-02-26T03:18:40.356 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44086.log 2026-02-26T03:18:40.356 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.44130.log: 66.9% -- replaced with /var/log/ceph/ceph-client.admin.44130.log.gz 2026-02-26T03:18:40.356 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44474.log 2026-02-26T03:18:40.357 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.44086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43655.log 2026-02-26T03:18:40.357 INFO:teuthology.orchestra.run.trial086.stderr: 66.7% -- replaced with /var/log/ceph/ceph-client.admin.44086.log.gz 2026-02-26T03:18:40.357 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.44474.log: 66.7% -- replaced with /var/log/ceph/ceph-client.admin.44474.log.gz 2026-02-26T03:18:40.357 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41546.log 2026-02-26T03:18:40.357 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.43655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43698.log 2026-02-26T03:18:40.357 INFO:teuthology.orchestra.run.trial086.stderr: 66.7% -- replaced with /var/log/ceph/ceph-client.admin.43655.log.gz 2026-02-26T03:18:40.357 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.41546.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41546.log.gz 2026-02-26T03:18:40.358 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47630.log 2026-02-26T03:18:40.358 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.43698.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-26T03:18:40.358 INFO:teuthology.orchestra.run.trial086.stderr: 66.4% -- replaced with /var/log/ceph/ceph-client.admin.43698.log.gz 2026-02-26T03:18:40.358 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.47630.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47630.log.gz 2026-02-26T03:18:40.358 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43353.log 2026-02-26T03:18:40.358 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47679.log 2026-02-26T03:18:40.358 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.43353.log: 87.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-26T03:18:40.359 INFO:teuthology.orchestra.run.trial086.stderr: 66.7% -- replaced with /var/log/ceph/ceph-client.admin.43353.log.gz 2026-02-26T03:18:40.359 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41067.log 2026-02-26T03:18:40.359 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.47679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43396.log 2026-02-26T03:18:40.359 INFO:teuthology.orchestra.run.trial086.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47679.log.gz 2026-02-26T03:18:40.359 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.41067.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41067.log.gz 2026-02-26T03:18:40.359 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-26T03:18:40.359 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47434.log 2026-02-26T03:18:40.360 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.43396.log: 66.4% -- replaced with /var/log/ceph/ceph-client.admin.43396.log.gz 2026-02-26T03:18:40.360 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41498.log 2026-02-26T03:18:40.360 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.47434.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47434.log.gz 2026-02-26T03:18:40.360 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44592.log 2026-02-26T03:18:40.360 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.41498.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41498.log.gz 2026-02-26T03:18:40.360 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43914.log 2026-02-26T03:18:40.361 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.44592.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44592.log.gzgzip 2026-02-26T03:18:40.361 INFO:teuthology.orchestra.run.trial086.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43828.log 2026-02-26T03:18:40.361 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.43914.log: 66.4% -- replaced with /var/log/ceph/ceph-client.admin.43914.log.gz 2026-02-26T03:18:40.361 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44543.log 2026-02-26T03:18:40.361 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.43828.log: 66.7% -- replaced with /var/log/ceph/ceph-client.admin.43828.log.gz 2026-02-26T03:18:40.361 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40973.log 2026-02-26T03:18:40.361 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.44543.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44543.log.gz 2026-02-26T03:18:40.361 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44259.log 2026-02-26T03:18:40.362 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.40973.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40973.log.gz 2026-02-26T03:18:40.362 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42085.log 2026-02-26T03:18:40.362 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.44259.log: gzip 66.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.44259.log.gz --verbose 2026-02-26T03:18:40.362 INFO:teuthology.orchestra.run.trial086.stderr: -- /var/log/ceph/ceph-client.admin.42887.log 2026-02-26T03:18:40.362 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.42085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47532.log 2026-02-26T03:18:40.362 INFO:teuthology.orchestra.run.trial086.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42085.log.gz 2026-02-26T03:18:40.362 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.42887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42083.log 2026-02-26T03:18:40.363 INFO:teuthology.orchestra.run.trial086.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42887.log.gz 2026-02-26T03:18:40.363 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.47532.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.47532.log.gz 2026-02-26T03:18:40.363 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46681.log 2026-02-26T03:18:40.363 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.42083.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-26T03:18:40.363 INFO:teuthology.orchestra.run.trial086.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42083.log.gz 2026-02-26T03:18:40.363 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.46681.log: 66.4% -- replaced with /var/log/ceph/ceph-client.admin.46681.log.gz 2026-02-26T03:18:40.363 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46882.log 2026-02-26T03:18:40.363 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41719.log 2026-02-26T03:18:40.364 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.46882.log: 66.4% -- replaced with /var/log/ceph/ceph-client.admin.46882.log.gz 2026-02-26T03:18:40.364 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41809.log 2026-02-26T03:18:40.364 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.41719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42280.log 2026-02-26T03:18:40.364 INFO:teuthology.orchestra.run.trial086.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41719.log.gz 2026-02-26T03:18:40.364 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.41809.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41809.log.gz 2026-02-26T03:18:40.364 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44043.log 2026-02-26T03:18:40.364 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-26T03:18:40.365 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.42280.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42280.log.gz 2026-02-26T03:18:40.365 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.44043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44302.log 2026-02-26T03:18:40.365 INFO:teuthology.orchestra.run.trial086.stderr: 66.1% -- replaced with /var/log/ceph/ceph-client.admin.44043.log.gz 2026-02-26T03:18:40.365 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.39159.log 2026-02-26T03:18:40.365 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.44302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41387.log 2026-02-26T03:18:40.365 INFO:teuthology.orchestra.run.trial086.stderr: 86.7% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-26T03:18:40.365 INFO:teuthology.orchestra.run.trial086.stderr: 66.7% -- replaced with /var/log/ceph/ceph-client.admin.44302.log.gz 2026-02-26T03:18:40.365 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph.tmp-client.admin.39159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43012.log 2026-02-26T03:18:40.365 INFO:teuthology.orchestra.run.trial086.stderr: 67.7% -- replaced with /var/log/ceph/ceph.tmp-client.admin.39159.log.gz 2026-02-26T03:18:40.366 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.41387.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41387.log.gz 2026-02-26T03:18:40.366 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47140.log 2026-02-26T03:18:40.366 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.43012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41907.log 2026-02-26T03:18:40.366 INFO:teuthology.orchestra.run.trial086.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43012.log.gz 2026-02-26T03:18:40.366 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.47140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43612.log 2026-02-26T03:18:40.366 INFO:teuthology.orchestra.run.trial086.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47140.log.gz 2026-02-26T03:18:40.366 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.41907.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41907.log.gz 2026-02-26T03:18:40.366 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42282.log 2026-02-26T03:18:40.367 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.43612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42281.log 2026-02-26T03:18:40.367 INFO:teuthology.orchestra.run.trial086.stderr: 66.1% -- replaced with /var/log/ceph/ceph-client.admin.43612.log.gz 2026-02-26T03:18:40.367 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.42282.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42282.log.gz 2026-02-26T03:18:40.367 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.42281.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42281.log.gz 2026-02-26T03:18:40.377 INFO:teuthology.orchestra.run.trial086.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-26T03:18:40.399 INFO:teuthology.orchestra.run.trial086.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-26T03:18:41.157 INFO:teuthology.orchestra.run.trial086.stderr: 95.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-26T03:18:41.184 INFO:teuthology.orchestra.run.trial086.stderr: 95.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-26T03:18:41.216 INFO:teuthology.orchestra.run.trial086.stderr: 95.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-26T03:18:41.296 INFO:teuthology.orchestra.run.trial086.stderr: 95.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-26T03:18:41.297 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-26T03:18:41.297 INFO:teuthology.orchestra.run.trial086.stderr:real 0m0.965s 2026-02-26T03:18:41.297 INFO:teuthology.orchestra.run.trial086.stderr:user 0m3.336s 2026-02-26T03:18:41.297 INFO:teuthology.orchestra.run.trial086.stderr:sys 0m0.266s 2026-02-26T03:18:41.298 INFO:tasks.ceph:Archiving logs... 2026-02-26T03:18:41.298 DEBUG:teuthology.misc:Transferring archived files from trial086:/var/log/ceph to /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-26_02:22:56-crimson-rados-main-distro-debug-trial/71141/remote/trial086/log 2026-02-26T03:18:41.299 DEBUG:teuthology.orchestra.run.trial086:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-26T03:18:41.806 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-26T03:18:41.917 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-26T03:18:41.929 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-26T03:18:41.929 DEBUG:teuthology.orchestra.run.trial086:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-26T03:18:41.955 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-26T03:18:41.970 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-26T03:18:41.971 DEBUG:teuthology.orchestra.run.trial086:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-26T03:18:42.010 INFO:teuthology.orchestra.run.trial086.stderr:bash: line 1: ntpq: command not found 2026-02-26T03:18:42.026 INFO:teuthology.orchestra.run.trial086.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-26T03:18:42.026 INFO:teuthology.orchestra.run.trial086.stdout:=============================================================================== 2026-02-26T03:18:42.026 INFO:teuthology.orchestra.run.trial086.stdout:^* ntp1.glypnod.com 2 6 377 32 -3431us[-3246us] +/- 44ms 2026-02-26T03:18:42.026 INFO:teuthology.orchestra.run.trial086.stdout:^+ y.ns.gin.ntt.net 2 6 377 32 -2924us[-2739us] +/- 47ms 2026-02-26T03:18:42.026 INFO:teuthology.orchestra.run.trial086.stdout:^+ 172-234-37-140.ip.linode> 2 6 377 33 +13ms[ +13ms] +/- 80ms 2026-02-26T03:18:42.027 INFO:teuthology.orchestra.run.trial086.stdout:^+ 72-14-186-59.ip.linodeus> 2 6 377 31 -5211us[-5211us] +/- 90ms 2026-02-26T03:18:42.028 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-26T03:18:42.043 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-26T03:18:42.044 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-26T03:18:42.058 DEBUG:teuthology.orchestra.run.trial086:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-26T03:18:42.123 DEBUG:teuthology.orchestra.run.trial086:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-26T03:18:42.149 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-26T03:18:42.150 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-26T03:18:42.166 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-26T03:18:42.182 INFO:teuthology.task.internal:Duration was 912.116006 seconds 2026-02-26T03:18:42.182 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-26T03:18:42.199 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-26T03:18:42.199 DEBUG:teuthology.orchestra.run.trial086:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-26T03:18:42.235 INFO:teuthology.orchestra.run.trial086.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-26T03:18:42.393 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-26T03:18:42.393 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial086.front.sepia.ceph.com 2026-02-26T03:18:42.393 DEBUG:teuthology.orchestra.run.trial086:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-26T03:18:42.450 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-26T03:18:42.450 DEBUG:teuthology.orchestra.run.trial086:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-26T03:18:42.553 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-26T03:18:42.554 DEBUG:teuthology.orchestra.run.trial086:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-26T03:18:42.577 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-26T03:18:42.577 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-26T03:18:42.577 INFO:teuthology.orchestra.run.trial086.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-26T03:18:42.577 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-26T03:18:42.578 INFO:teuthology.orchestra.run.trial086.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-26T03:18:42.588 INFO:teuthology.orchestra.run.trial086.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 82.4% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-26T03:18:42.590 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-26T03:18:42.601 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-26T03:18:42.602 DEBUG:teuthology.orchestra.run.trial086:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-26T03:18:42.655 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-26T03:18:42.672 DEBUG:teuthology.orchestra.run.trial086:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-26T03:18:42.718 INFO:teuthology.orchestra.run.trial086.stdout:kernel.core_pattern = core 2026-02-26T03:18:42.736 DEBUG:teuthology.orchestra.run.trial086:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-26T03:18:42.792 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-26T03:18:42.792 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-26T03:18:42.805 INFO:teuthology.task.internal:Transferring archived files... 2026-02-26T03:18:42.805 DEBUG:teuthology.misc:Transferring archived files from trial086:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-26_02:22:56-crimson-rados-main-distro-debug-trial/71141/remote/trial086 2026-02-26T03:18:42.805 DEBUG:teuthology.orchestra.run.trial086:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-26T03:18:42.868 INFO:teuthology.task.internal:Removing archive directory... 2026-02-26T03:18:42.868 DEBUG:teuthology.orchestra.run.trial086:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-26T03:18:42.915 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-26T03:18:42.933 INFO:teuthology.task.internal:Not uploading archives. 2026-02-26T03:18:42.933 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-26T03:18:42.955 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-26T03:18:42.956 DEBUG:teuthology.orchestra.run.trial086:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-26T03:18:42.972 INFO:teuthology.orchestra.run.trial086.stdout: 920834 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 26 03:18 /home/ubuntu/cephtest 2026-02-26T03:18:42.973 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-26T03:18:42.988 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-26T03:18:43.015 INFO:teuthology.run:Summary data: description: crimson-rados/objectstore_tool/{0-crimson_install clusters/fixed-1-num-threads-3 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/seastore-segmented tasks/crimson_obejctstore_tool} duration: 912.1160061359406 flavor: debug owner: scheduled_shraddhaag@soko04.front.sepia.ceph.com success: true 2026-02-26T03:18:43.015 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-26T03:18:43.104 INFO:teuthology.run:pass