2026-02-17T04:14:06.392 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-17T04:14:06.407 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T04:14:06.486 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/skanta-2026-02-17_03:53:03-rados-wip-bharath18-testing-2026-02-13-0856-distro-default-trial/50828 branch: wip-bharath18-testing-2026-02-13-0856 description: rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{centos_latest}} email: skanta@redhat.com first_in_suite: false flavor: default job_id: '50828' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: skanta-2026-02-17_03:53:03-rados-wip-bharath18-testing-2026-02-13-0856-distro-default-trial no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-bharath18-testing-2026-02-13-0856 ceph: conf: global: mon election default strategy: 1 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 30 debug ms: 1 debug paxos: 20 mon scrub interval: 300 osd: bluestore zero block detection: true debug ms: 1 debug osd: 20 osd debug verify cached snaps: true osd debug verify missing on start: true osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd mclock skip benchmark: true osd op queue: debug_random osd op queue cut off: debug_random flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 325850157d309f65985eea9ec9bb9f1d56726fee ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 325850157d309f65985eea9ec9bb9f1d56726fee workunit: branch: wip-bharath18-testing-2026-02-13-0856 sha1: 325850157d309f65985eea9ec9bb9f1d56726fee owner: scheduled_skanta@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - osd.3 - osd.4 - osd.5 - osd.6 - osd.7 - osd.8 - osd.9 - client.0 seed: 7109 sha1: 325850157d309f65985eea9ec9bb9f1d56726fee sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-bharath18-testing-2026-02-13-0856 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_325850157d309f65985eea9ec9bb9f1d56726fee/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 325850157d309f65985eea9ec9bb9f1d56726fee targets: trial040.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHe+QgnyeQzkZM99X2e15xIrqi5GELipxRDlLUKl9zEWWjL6Q9bBZh/RbaP2rMAK9M4IuCk9xVSy2jC5Kkc3KAA= tasks: - install: null - ceph: conf: osd: osd max object name len: 400 osd max object namespace len: 64 log-ignorelist: - but it is still running - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_APP_NOT_ENABLED\) pre-mgr-commands: - sudo ceph config set mgr mgr_pool false --force - workunit: clients: all: - rados/test_health_warnings.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-17_03:53:03 tube: trial user: skanta verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682 2026-02-17T04:14:06.486 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_325850157d309f65985eea9ec9bb9f1d56726fee/qa; will attempt to use it 2026-02-17T04:14:06.486 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_325850157d309f65985eea9ec9bb9f1d56726fee/qa/tasks 2026-02-17T04:14:06.486 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-17T04:14:06.488 INFO:teuthology.task.internal:Checking packages... 2026-02-17T04:14:06.488 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '325850157d309f65985eea9ec9bb9f1d56726fee' 2026-02-17T04:14:06.488 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-17T04:14:06.488 INFO:teuthology.packaging:ref: None 2026-02-17T04:14:06.488 INFO:teuthology.packaging:tag: None 2026-02-17T04:14:06.488 INFO:teuthology.packaging:branch: wip-bharath18-testing-2026-02-13-0856 2026-02-17T04:14:06.488 INFO:teuthology.packaging:sha1: 325850157d309f65985eea9ec9bb9f1d56726fee 2026-02-17T04:14:06.488 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-bharath18-testing-2026-02-13-0856 2026-02-17T04:14:06.607 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5271.g32585015 2026-02-17T04:14:06.608 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-17T04:14:06.620 INFO:teuthology.task.internal:no buildpackages task found 2026-02-17T04:14:06.620 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-17T04:14:06.634 INFO:teuthology.task.internal:Saving configuration 2026-02-17T04:14:06.641 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-17T04:14:06.653 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-17T04:14:06.754 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial040.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_03:53:03-rados-wip-bharath18-testing-2026-02-13-0856-distro-default-trial/50828', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 04:10:39.900317', 'locked_by': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHe+QgnyeQzkZM99X2e15xIrqi5GELipxRDlLUKl9zEWWjL6Q9bBZh/RbaP2rMAK9M4IuCk9xVSy2jC5Kkc3KAA='} 2026-02-17T04:14:06.754 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-17T04:14:06.766 INFO:teuthology.task.internal:roles: ubuntu@trial040.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'osd.8', 'osd.9', 'client.0'] 2026-02-17T04:14:06.766 INFO:teuthology.run_tasks:Running task console_log... 2026-02-17T04:14:06.849 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7947ac2d3d80>, signals=[15]) 2026-02-17T04:14:06.849 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-17T04:14:06.863 INFO:teuthology.task.internal:Opening connections... 2026-02-17T04:14:06.863 DEBUG:teuthology.task.internal:connecting to ubuntu@trial040.front.sepia.ceph.com 2026-02-17T04:14:06.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T04:14:06.926 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-17T04:14:06.938 DEBUG:teuthology.orchestra.run.trial040:> uname -m 2026-02-17T04:14:07.002 INFO:teuthology.orchestra.run.trial040.stdout:x86_64 2026-02-17T04:14:07.002 DEBUG:teuthology.orchestra.run.trial040:> cat /etc/os-release 2026-02-17T04:14:07.057 INFO:teuthology.orchestra.run.trial040.stdout:NAME="CentOS Stream" 2026-02-17T04:14:07.057 INFO:teuthology.orchestra.run.trial040.stdout:VERSION="9" 2026-02-17T04:14:07.057 INFO:teuthology.orchestra.run.trial040.stdout:ID="centos" 2026-02-17T04:14:07.057 INFO:teuthology.orchestra.run.trial040.stdout:ID_LIKE="rhel fedora" 2026-02-17T04:14:07.058 INFO:teuthology.orchestra.run.trial040.stdout:VERSION_ID="9" 2026-02-17T04:14:07.058 INFO:teuthology.orchestra.run.trial040.stdout:PLATFORM_ID="platform:el9" 2026-02-17T04:14:07.058 INFO:teuthology.orchestra.run.trial040.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T04:14:07.058 INFO:teuthology.orchestra.run.trial040.stdout:ANSI_COLOR="0;31" 2026-02-17T04:14:07.058 INFO:teuthology.orchestra.run.trial040.stdout:LOGO="fedora-logo-icon" 2026-02-17T04:14:07.058 INFO:teuthology.orchestra.run.trial040.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T04:14:07.058 INFO:teuthology.orchestra.run.trial040.stdout:HOME_URL="https://centos.org/" 2026-02-17T04:14:07.058 INFO:teuthology.orchestra.run.trial040.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T04:14:07.058 INFO:teuthology.orchestra.run.trial040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T04:14:07.058 INFO:teuthology.orchestra.run.trial040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T04:14:07.059 INFO:teuthology.lock.ops:Updating trial040.front.sepia.ceph.com on lock server 2026-02-17T04:14:07.142 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-17T04:14:07.155 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-17T04:14:07.167 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-17T04:14:07.167 DEBUG:teuthology.orchestra.run.trial040:> test '!' -e /home/ubuntu/cephtest 2026-02-17T04:14:07.182 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-17T04:14:07.194 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-17T04:14:07.194 DEBUG:teuthology.orchestra.run.trial040:> test -z $(ls -A /var/lib/ceph) 2026-02-17T04:14:07.239 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-17T04:14:07.324 INFO:teuthology.run_tasks:Running task kernel... 2026-02-17T04:14:07.345 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-17T04:14:07.345 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-17T04:14:07.345 DEBUG:teuthology.orchestra.run.trial040:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T04:14:07.360 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T04:14:07.360 DEBUG:teuthology.orchestra.run.trial040:> uname -r 2026-02-17T04:14:07.415 INFO:teuthology.orchestra.run.trial040.stdout:5.14.0-645.el9.x86_64 2026-02-17T04:14:07.416 INFO:teuthology.task.kernel:Running kernel on trial040: 5.14.0-645.el9.x86_64 2026-02-17T04:14:07.416 DEBUG:teuthology.orchestra.run.trial040:> sudo yum install -y kernel 2026-02-17T04:14:16.651 INFO:teuthology.orchestra.run.trial040.stdout:CentOS Stream 9 - BaseOS 1.0 MB/s | 8.9 MB 00:08 2026-02-17T04:14:19.886 INFO:teuthology.orchestra.run.trial040.stdout:CentOS Stream 9 - AppStream 9.9 MB/s | 27 MB 00:02 2026-02-17T04:14:26.823 INFO:teuthology.orchestra.run.trial040.stdout:CentOS Stream 9 - CRB 1.7 MB/s | 7.8 MB 00:04 2026-02-17T04:14:27.645 INFO:teuthology.orchestra.run.trial040.stdout:CentOS Stream 9 - Extras packages 194 kB/s | 20 kB 00:00 2026-02-17T04:14:29.288 INFO:teuthology.orchestra.run.trial040.stdout:Extra Packages for Enterprise Linux 13 MB/s | 20 MB 00:01 2026-02-17T04:14:32.437 INFO:teuthology.orchestra.run.trial040.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-17T04:14:33.446 INFO:teuthology.orchestra.run.trial040.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-17T04:14:33.466 INFO:teuthology.orchestra.run.trial040.stdout:Dependencies resolved. 2026-02-17T04:14:33.467 INFO:teuthology.orchestra.run.trial040.stdout:================================================================================ 2026-02-17T04:14:33.467 INFO:teuthology.orchestra.run.trial040.stdout: Package Architecture Version Repository Size 2026-02-17T04:14:33.467 INFO:teuthology.orchestra.run.trial040.stdout:================================================================================ 2026-02-17T04:14:33.468 INFO:teuthology.orchestra.run.trial040.stdout:Installing: 2026-02-17T04:14:33.468 INFO:teuthology.orchestra.run.trial040.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-17T04:14:33.468 INFO:teuthology.orchestra.run.trial040.stdout:Installing dependencies: 2026-02-17T04:14:33.468 INFO:teuthology.orchestra.run.trial040.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-17T04:14:33.468 INFO:teuthology.orchestra.run.trial040.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-17T04:14:33.468 INFO:teuthology.orchestra.run.trial040.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-17T04:14:33.468 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:14:33.468 INFO:teuthology.orchestra.run.trial040.stdout:Transaction Summary 2026-02-17T04:14:33.468 INFO:teuthology.orchestra.run.trial040.stdout:================================================================================ 2026-02-17T04:14:33.468 INFO:teuthology.orchestra.run.trial040.stdout:Install 4 Packages 2026-02-17T04:14:33.468 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:14:33.469 INFO:teuthology.orchestra.run.trial040.stdout:Total download size: 88 M 2026-02-17T04:14:33.469 INFO:teuthology.orchestra.run.trial040.stdout:Installed size: 135 M 2026-02-17T04:14:33.469 INFO:teuthology.orchestra.run.trial040.stdout:Downloading Packages: 2026-02-17T04:14:33.936 INFO:teuthology.orchestra.run.trial040.stdout:(1/4): kernel-core-5.14.0-681.el9.x86_64.rpm 105 MB/s | 17 MB 00:00 2026-02-17T04:14:33.945 INFO:teuthology.orchestra.run.trial040.stdout:(2/4): kernel-5.14.0-681.el9.x86_64.rpm 4.5 MB/s | 803 kB 00:00 2026-02-17T04:14:34.112 INFO:teuthology.orchestra.run.trial040.stdout:(3/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 117 MB/s | 40 MB 00:00 2026-02-17T04:14:34.192 INFO:teuthology.orchestra.run.trial040.stdout:(4/4): kernel-modules-core-5.14.0-681.el9.x86_6 121 MB/s | 31 MB 00:00 2026-02-17T04:14:34.193 INFO:teuthology.orchestra.run.trial040.stdout:-------------------------------------------------------------------------------- 2026-02-17T04:14:34.194 INFO:teuthology.orchestra.run.trial040.stdout:Total 122 MB/s | 88 MB 00:00 2026-02-17T04:14:34.385 INFO:teuthology.orchestra.run.trial040.stdout:Running transaction check 2026-02-17T04:14:34.601 INFO:teuthology.orchestra.run.trial040.stdout:Transaction check succeeded. 2026-02-17T04:14:34.601 INFO:teuthology.orchestra.run.trial040.stdout:Running transaction test 2026-02-17T04:14:34.949 INFO:teuthology.orchestra.run.trial040.stdout:Transaction test succeeded. 2026-02-17T04:14:34.950 INFO:teuthology.orchestra.run.trial040.stdout:Running transaction 2026-02-17T04:14:36.040 INFO:teuthology.orchestra.run.trial040.stdout: Preparing : 1/1 2026-02-17T04:14:36.322 INFO:teuthology.orchestra.run.trial040.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-17T04:14:36.341 INFO:teuthology.orchestra.run.trial040.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T04:14:38.131 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T04:14:38.159 INFO:teuthology.orchestra.run.trial040.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T04:14:41.393 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T04:14:41.399 INFO:teuthology.orchestra.run.trial040.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T04:14:44.493 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T04:15:15.040 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T04:15:15.061 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-17T04:15:15.125 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T04:15:15.125 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-17T04:15:15.125 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T04:15:15.125 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T04:15:15.177 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T04:15:15.177 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:15:15.177 INFO:teuthology.orchestra.run.trial040.stdout:Installed: 2026-02-17T04:15:15.177 INFO:teuthology.orchestra.run.trial040.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-17T04:15:15.177 INFO:teuthology.orchestra.run.trial040.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-17T04:15:15.177 INFO:teuthology.orchestra.run.trial040.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-17T04:15:15.177 INFO:teuthology.orchestra.run.trial040.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-17T04:15:15.178 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:15:15.178 INFO:teuthology.orchestra.run.trial040.stdout:Complete! 2026-02-17T04:15:15.234 DEBUG:teuthology.orchestra.run.trial040:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T04:15:15.259 INFO:teuthology.orchestra.run.trial040.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T04:15:15.261 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T04:15:15.261 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-17T04:15:15.261 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T04:15:15.261 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T04:15:15.261 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-17T04:15:15.261 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial040.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T04:15:15.262 DEBUG:teuthology.orchestra.run.trial040:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T04:15:15.324 INFO:teuthology.orchestra.run.trial040.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T04:15:15.325 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T04:15:15.325 DEBUG:teuthology.orchestra.run.trial040:> sudo rpm -qi grub2-tools 2026-02-17T04:15:15.394 INFO:teuthology.orchestra.run.trial040.stdout:Name : grub2-tools 2026-02-17T04:15:15.395 INFO:teuthology.orchestra.run.trial040.stdout:Epoch : 1 2026-02-17T04:15:15.395 INFO:teuthology.orchestra.run.trial040.stdout:Version : 2.06 2026-02-17T04:15:15.395 INFO:teuthology.orchestra.run.trial040.stdout:Release : 118.el9 2026-02-17T04:15:15.395 INFO:teuthology.orchestra.run.trial040.stdout:Architecture: x86_64 2026-02-17T04:15:15.395 INFO:teuthology.orchestra.run.trial040.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-17T04:15:15.395 INFO:teuthology.orchestra.run.trial040.stdout:Group : Unspecified 2026-02-17T04:15:15.395 INFO:teuthology.orchestra.run.trial040.stdout:Size : 8393909 2026-02-17T04:15:15.395 INFO:teuthology.orchestra.run.trial040.stdout:License : GPLv3+ 2026-02-17T04:15:15.395 INFO:teuthology.orchestra.run.trial040.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-17T04:15:15.395 INFO:teuthology.orchestra.run.trial040.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-17T04:15:15.396 INFO:teuthology.orchestra.run.trial040.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-17T04:15:15.396 INFO:teuthology.orchestra.run.trial040.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-17T04:15:15.396 INFO:teuthology.orchestra.run.trial040.stdout:Packager : builder@centos.org 2026-02-17T04:15:15.396 INFO:teuthology.orchestra.run.trial040.stdout:Vendor : CentOS 2026-02-17T04:15:15.396 INFO:teuthology.orchestra.run.trial040.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-17T04:15:15.396 INFO:teuthology.orchestra.run.trial040.stdout:Summary : Support tools for GRUB. 2026-02-17T04:15:15.396 INFO:teuthology.orchestra.run.trial040.stdout:Description : 2026-02-17T04:15:15.396 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:15:15.396 INFO:teuthology.orchestra.run.trial040.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-17T04:15:15.396 INFO:teuthology.orchestra.run.trial040.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-17T04:15:15.396 INFO:teuthology.orchestra.run.trial040.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-17T04:15:15.396 INFO:teuthology.orchestra.run.trial040.stdout:hardware devices. 2026-02-17T04:15:15.397 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:15:15.397 INFO:teuthology.orchestra.run.trial040.stdout:This subpackage provides tools for support of all platforms. 2026-02-17T04:15:15.398 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-17T04:15:15.398 INFO:teuthology.task.kernel:Updating grub on trial040 to boot 5.14.0-681.el9.x86_64 2026-02-17T04:15:15.398 DEBUG:teuthology.orchestra.run.trial040:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-17T04:15:15.462 INFO:teuthology.orchestra.run.trial040.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T04:15:15.464 DEBUG:teuthology.orchestra.run.trial040:> sudo command -v grubby && echo yes || echo no 2026-02-17T04:15:15.527 INFO:teuthology.orchestra.run.trial040.stdout:/sbin/grubby 2026-02-17T04:15:15.528 INFO:teuthology.orchestra.run.trial040.stdout:yes 2026-02-17T04:15:15.529 DEBUG:teuthology.orchestra.run.trial040:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-17T04:15:15.592 INFO:teuthology.orchestra.run.trial040.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T04:15:15.594 DEBUG:teuthology.orchestra.run.trial040:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-17T04:15:15.665 DEBUG:teuthology.orchestra.run.trial040:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-17T04:15:15.874 INFO:teuthology.orchestra.run.trial040.stderr:Generating grub configuration file ... 2026-02-17T04:15:15.938 INFO:teuthology.orchestra.run.trial040.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-17T04:15:15.945 INFO:teuthology.orchestra.run.trial040.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-17T04:15:16.195 INFO:teuthology.orchestra.run.trial040.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-17T04:15:16.202 INFO:teuthology.orchestra.run.trial040.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-17T04:15:16.234 INFO:teuthology.orchestra.run.trial040.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-17T04:15:16.240 INFO:teuthology.orchestra.run.trial040.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-17T04:15:16.264 INFO:teuthology.orchestra.run.trial040.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-17T04:15:16.271 INFO:teuthology.orchestra.run.trial040.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-17T04:15:16.355 INFO:teuthology.orchestra.run.trial040.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T04:15:16.364 INFO:teuthology.orchestra.run.trial040.stderr:done 2026-02-17T04:15:16.366 DEBUG:teuthology.orchestra.run.trial040:> test -d /sys/firmware/efi 2026-02-17T04:15:16.383 DEBUG:teuthology.orchestra.run.trial040:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-17T04:15:16.447 INFO:teuthology.orchestra.run.trial040.stdout:/boot/efi/EFI/BOOT 2026-02-17T04:15:16.448 INFO:teuthology.orchestra.run.trial040.stdout:/boot/efi/EFI/centos 2026-02-17T04:15:16.449 DEBUG:teuthology.orchestra.run.trial040:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-17T04:15:16.516 INFO:teuthology.orchestra.run.trial040.stdout:no 2026-02-17T04:15:16.516 DEBUG:teuthology.orchestra.run.trial040:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-17T04:15:16.581 INFO:teuthology.orchestra.run.trial040.stdout:yes 2026-02-17T04:15:16.581 DEBUG:teuthology.orchestra.run.trial040:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-17T04:15:16.645 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial040 2026-02-17T04:15:16.645 DEBUG:teuthology.orchestra.run.trial040:> sudo bash -c ' 2026-02-17T04:15:16.645 DEBUG:teuthology.orchestra.run.trial040:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-17T04:15:16.645 DEBUG:teuthology.orchestra.run.trial040:> ' 2026-02-17T04:15:46.689 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-17T04:15:46.689 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial040.front.sepia.ceph.com' 2026-02-17T04:15:46.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T04:16:00.960 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.40 2026-02-17T04:16:09.968 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial040.front.sepia.ceph.com' 2026-02-17T04:16:09.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T04:16:46.079 DEBUG:teuthology.orchestra.run.trial040:> true 2026-02-17T04:16:46.231 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial040.front.sepia.ceph.com' 2026-02-17T04:16:46.232 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-681.el9.x86_64"... 2026-02-17T04:16:46.232 DEBUG:teuthology.orchestra.run.trial040:> uname -r 2026-02-17T04:16:46.290 INFO:teuthology.orchestra.run.trial040.stdout:5.14.0-681.el9.x86_64 2026-02-17T04:16:46.291 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-17T04:16:46.291 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T04:16:46.291 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-17T04:16:47.291 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-17T04:16:47.292 DEBUG:teuthology.orchestra.run.trial040:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T04:16:47.321 INFO:teuthology.orchestra.run.trial040.stdout:ttyS1 2026-02-17T04:16:47.346 DEBUG:teuthology.parallel:result is None 2026-02-17T04:16:47.346 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-17T04:16:47.359 INFO:teuthology.task.internal:Creating test directory... 2026-02-17T04:16:47.359 DEBUG:teuthology.orchestra.run.trial040:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T04:16:47.403 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-17T04:16:47.417 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-17T04:16:47.430 INFO:teuthology.task.internal:Creating archive directory... 2026-02-17T04:16:47.430 DEBUG:teuthology.orchestra.run.trial040:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T04:16:47.467 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-17T04:16:47.478 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-17T04:16:47.478 DEBUG:teuthology.orchestra.run.trial040:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T04:16:47.523 INFO:teuthology.orchestra.run.trial040.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:16:47.531 INFO:teuthology.orchestra.run.trial040.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:16:47.533 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-17T04:16:47.545 INFO:teuthology.task.internal:Configuring sudo... 2026-02-17T04:16:47.545 DEBUG:teuthology.orchestra.run.trial040:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T04:16:47.598 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-17T04:16:47.614 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-17T04:16:47.615 DEBUG:teuthology.orchestra.run.trial040:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T04:16:47.655 DEBUG:teuthology.orchestra.run.trial040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T04:16:47.814 DEBUG:teuthology.orchestra.run.trial040:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T04:16:47.840 DEBUG:teuthology.orchestra.run.trial040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T04:16:47.988 DEBUG:teuthology.orchestra.run.trial040:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T04:16:48.013 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T04:16:48.013 DEBUG:teuthology.orchestra.run.trial040:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T04:16:48.078 DEBUG:teuthology.orchestra.run.trial040:> sudo service rsyslog restart 2026-02-17T04:16:48.146 INFO:teuthology.orchestra.run.trial040.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T04:16:48.541 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-17T04:16:48.580 INFO:teuthology.task.internal:Starting timer... 2026-02-17T04:16:48.581 INFO:teuthology.run_tasks:Running task pcp... 2026-02-17T04:16:48.611 INFO:teuthology.run_tasks:Running task selinux... 2026-02-17T04:16:48.629 DEBUG:teuthology.orchestra.run.trial040:> sudo service auditd rotate 2026-02-17T04:16:48.659 INFO:teuthology.orchestra.run.trial040.stdout:Rotating logs: 2026-02-17T04:16:48.661 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-17T04:16:48.662 DEBUG:teuthology.orchestra.run.trial040:> /usr/sbin/getenforce 2026-02-17T04:16:48.718 INFO:teuthology.orchestra.run.trial040.stdout:Permissive 2026-02-17T04:16:48.718 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial040.front.sepia.ceph.com': 'permissive'} 2026-02-17T04:16:48.719 DEBUG:teuthology.orchestra.run.trial040:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-17T04:16:48.782 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T04:16:48.783 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-17T04:16:48.783 DEBUG:teuthology.orchestra.run.trial040:> sudo /usr/sbin/setenforce permissive 2026-02-17T04:16:48.846 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-17T04:16:48.866 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-17T04:16:48.877 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-17T04:16:48.879 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial040.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-17T04:19:32.603 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial040.front.sepia.ceph.com')] 2026-02-17T04:19:32.604 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial040.front.sepia.ceph.com' 2026-02-17T04:19:32.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T04:19:32.719 DEBUG:teuthology.orchestra.run.trial040:> true 2026-02-17T04:19:32.796 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial040.front.sepia.ceph.com' 2026-02-17T04:19:32.796 INFO:teuthology.run_tasks:Running task clock... 2026-02-17T04:19:32.808 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-17T04:19:32.808 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T04:19:32.808 DEBUG:teuthology.orchestra.run.trial040:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T04:19:32.864 INFO:teuthology.orchestra.run.trial040.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-17T04:19:32.877 INFO:teuthology.orchestra.run.trial040.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-17T04:19:32.898 INFO:teuthology.orchestra.run.trial040.stderr:sudo: ntpd: command not found 2026-02-17T04:19:32.908 INFO:teuthology.orchestra.run.trial040.stdout:506 Cannot talk to daemon 2026-02-17T04:19:32.920 INFO:teuthology.orchestra.run.trial040.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-17T04:19:32.932 INFO:teuthology.orchestra.run.trial040.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-17T04:19:32.983 INFO:teuthology.orchestra.run.trial040.stderr:bash: line 1: ntpq: command not found 2026-02-17T04:19:32.998 INFO:teuthology.orchestra.run.trial040.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T04:19:32.998 INFO:teuthology.orchestra.run.trial040.stdout:=============================================================================== 2026-02-17T04:19:32.998 INFO:teuthology.orchestra.run.trial040.stdout:^? 72-14-182-49.ip.linodeus> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T04:19:32.998 INFO:teuthology.orchestra.run.trial040.stdout:^? 199.101.96.52 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T04:19:32.998 INFO:teuthology.orchestra.run.trial040.stdout:^? li1210-167.members.linod> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T04:19:32.998 INFO:teuthology.orchestra.run.trial040.stdout:^? time.cloudflare.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T04:19:33.000 INFO:teuthology.run_tasks:Running task install... 2026-02-17T04:19:33.014 DEBUG:teuthology.task.install:project ceph 2026-02-17T04:19:33.014 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '325850157d309f65985eea9ec9bb9f1d56726fee'}} 2026-02-17T04:19:33.014 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '325850157d309f65985eea9ec9bb9f1d56726fee'} 2026-02-17T04:19:33.014 INFO:teuthology.task.install:Using flavor: default 2026-02-17T04:19:33.024 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-17T04:19:33.025 INFO:teuthology.task.install:extra packages: [] 2026-02-17T04:19:33.025 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '325850157d309f65985eea9ec9bb9f1d56726fee', 'tag': None, 'wait_for_package': False} 2026-02-17T04:19:33.026 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=325850157d309f65985eea9ec9bb9f1d56726fee 2026-02-17T04:19:33.190 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/centos/9/flavors/default/ 2026-02-17T04:19:33.190 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5271.g32585015 2026-02-17T04:19:33.313 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-17T04:19:33.313 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T04:19:33.313 DEBUG:teuthology.orchestra.run.trial040:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-17T04:19:33.338 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-17T04:19:33.338 DEBUG:teuthology.orchestra.run.trial040:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/325850157d309f65985eea9ec9bb9f1d56726fee/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-17T04:19:33.403 DEBUG:teuthology.orchestra.run.trial040:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-17T04:19:33.477 DEBUG:teuthology.orchestra.run.trial040:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-17T04:19:33.541 INFO:teuthology.orchestra.run.trial040.stdout:check_obsoletes = 1 2026-02-17T04:19:33.543 DEBUG:teuthology.orchestra.run.trial040:> sudo yum clean all 2026-02-17T04:19:33.694 INFO:teuthology.orchestra.run.trial040.stdout:41 files removed 2026-02-17T04:19:33.709 DEBUG:teuthology.orchestra.run.trial040:> sudo yum -y install ceph-radosgw 2026-02-17T04:19:33.984 INFO:teuthology.orchestra.run.trial040.stdout:ceph packages for x86_64 742 kB/s | 93 kB 00:00 2026-02-17T04:19:34.126 INFO:teuthology.orchestra.run.trial040.stdout:ceph noarch packages 210 kB/s | 24 kB 00:00 2026-02-17T04:19:34.262 INFO:teuthology.orchestra.run.trial040.stdout:ceph source packages 18 kB/s | 2.1 kB 00:00 2026-02-17T04:19:36.560 INFO:teuthology.orchestra.run.trial040.stdout:CentOS Stream 9 - BaseOS 3.9 MB/s | 8.9 MB 00:02 2026-02-17T04:19:37.420 INFO:teuthology.orchestra.run.trial040.stdout:CentOS Stream 9 - AppStream 80 MB/s | 27 MB 00:00 2026-02-17T04:19:48.951 INFO:teuthology.orchestra.run.trial040.stdout:CentOS Stream 9 - CRB 867 kB/s | 7.8 MB 00:09 2026-02-17T04:19:50.097 INFO:teuthology.orchestra.run.trial040.stdout:CentOS Stream 9 - Extras packages 47 kB/s | 20 kB 00:00 2026-02-17T04:19:50.629 INFO:teuthology.orchestra.run.trial040.stdout:Extra Packages for Enterprise Linux 43 MB/s | 20 MB 00:00 2026-02-17T04:19:53.768 INFO:teuthology.orchestra.run.trial040.stdout:lab-extras 2.8 MB/s | 50 kB 00:00 2026-02-17T04:19:54.998 INFO:teuthology.orchestra.run.trial040.stdout:Dependencies resolved. 2026-02-17T04:19:54.999 INFO:teuthology.orchestra.run.trial040.stdout:================================================================================ 2026-02-17T04:19:55.000 INFO:teuthology.orchestra.run.trial040.stdout: Package Arch Version Repository Size 2026-02-17T04:19:55.000 INFO:teuthology.orchestra.run.trial040.stdout:================================================================================ 2026-02-17T04:19:55.000 INFO:teuthology.orchestra.run.trial040.stdout:Installing: 2026-02-17T04:19:55.000 INFO:teuthology.orchestra.run.trial040.stdout: ceph-radosgw x86_64 2:20.3.0-5271.g32585015.el9 ceph 13 M 2026-02-17T04:19:55.000 INFO:teuthology.orchestra.run.trial040.stdout:Upgrading: 2026-02-17T04:19:55.000 INFO:teuthology.orchestra.run.trial040.stdout: librados2 x86_64 2:20.3.0-5271.g32585015.el9 ceph 3.5 M 2026-02-17T04:19:55.000 INFO:teuthology.orchestra.run.trial040.stdout: librbd1 x86_64 2:20.3.0-5271.g32585015.el9 ceph 2.8 M 2026-02-17T04:19:55.000 INFO:teuthology.orchestra.run.trial040.stdout:Installing dependencies: 2026-02-17T04:19:55.000 INFO:teuthology.orchestra.run.trial040.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-17T04:19:55.000 INFO:teuthology.orchestra.run.trial040.stdout: ceph-base x86_64 2:20.3.0-5271.g32585015.el9 ceph 5.2 M 2026-02-17T04:19:55.000 INFO:teuthology.orchestra.run.trial040.stdout: ceph-common x86_64 2:20.3.0-5271.g32585015.el9 ceph 24 M 2026-02-17T04:19:55.001 INFO:teuthology.orchestra.run.trial040.stdout: ceph-selinux x86_64 2:20.3.0-5271.g32585015.el9 ceph 25 k 2026-02-17T04:19:55.001 INFO:teuthology.orchestra.run.trial040.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-17T04:19:55.001 INFO:teuthology.orchestra.run.trial040.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-17T04:19:55.001 INFO:teuthology.orchestra.run.trial040.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-17T04:19:55.001 INFO:teuthology.orchestra.run.trial040.stdout: libcephfs2 x86_64 2:20.3.0-5271.g32585015.el9 ceph 909 k 2026-02-17T04:19:55.001 INFO:teuthology.orchestra.run.trial040.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-17T04:19:55.001 INFO:teuthology.orchestra.run.trial040.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-17T04:19:55.001 INFO:teuthology.orchestra.run.trial040.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-17T04:19:55.001 INFO:teuthology.orchestra.run.trial040.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-17T04:19:55.001 INFO:teuthology.orchestra.run.trial040.stdout: libradosstriper1 x86_64 2:20.3.0-5271.g32585015.el9 ceph 248 k 2026-02-17T04:19:55.001 INFO:teuthology.orchestra.run.trial040.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-17T04:19:55.001 INFO:teuthology.orchestra.run.trial040.stdout: librgw2 x86_64 2:20.3.0-5271.g32585015.el9 ceph 6.5 M 2026-02-17T04:19:55.002 INFO:teuthology.orchestra.run.trial040.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-17T04:19:55.002 INFO:teuthology.orchestra.run.trial040.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-17T04:19:55.002 INFO:teuthology.orchestra.run.trial040.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-17T04:19:55.002 INFO:teuthology.orchestra.run.trial040.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-17T04:19:55.002 INFO:teuthology.orchestra.run.trial040.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-17T04:19:55.002 INFO:teuthology.orchestra.run.trial040.stdout: python3-ceph-argparse x86_64 2:20.3.0-5271.g32585015.el9 ceph 45 k 2026-02-17T04:19:55.002 INFO:teuthology.orchestra.run.trial040.stdout: python3-ceph-common x86_64 2:20.3.0-5271.g32585015.el9 ceph 185 k 2026-02-17T04:19:55.002 INFO:teuthology.orchestra.run.trial040.stdout: python3-cephfs x86_64 2:20.3.0-5271.g32585015.el9 ceph 204 k 2026-02-17T04:19:55.002 INFO:teuthology.orchestra.run.trial040.stdout: python3-rados x86_64 2:20.3.0-5271.g32585015.el9 ceph 324 k 2026-02-17T04:19:55.002 INFO:teuthology.orchestra.run.trial040.stdout: python3-rbd x86_64 2:20.3.0-5271.g32585015.el9 ceph 306 k 2026-02-17T04:19:55.002 INFO:teuthology.orchestra.run.trial040.stdout: python3-rgw x86_64 2:20.3.0-5271.g32585015.el9 ceph 100 k 2026-02-17T04:19:55.002 INFO:teuthology.orchestra.run.trial040.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-17T04:19:55.002 INFO:teuthology.orchestra.run.trial040.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-17T04:19:55.003 INFO:teuthology.orchestra.run.trial040.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-17T04:19:55.003 INFO:teuthology.orchestra.run.trial040.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-17T04:19:55.003 INFO:teuthology.orchestra.run.trial040.stdout:Installing weak dependencies: 2026-02-17T04:19:55.003 INFO:teuthology.orchestra.run.trial040.stdout: libcephfs-daemon x86_64 2:20.3.0-5271.g32585015.el9 ceph 37 k 2026-02-17T04:19:55.003 INFO:teuthology.orchestra.run.trial040.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5271.g32585015.el9 ceph 25 k 2026-02-17T04:19:55.003 INFO:teuthology.orchestra.run.trial040.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-17T04:19:55.003 INFO:teuthology.orchestra.run.trial040.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-17T04:19:55.003 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:19:55.003 INFO:teuthology.orchestra.run.trial040.stdout:Transaction Summary 2026-02-17T04:19:55.003 INFO:teuthology.orchestra.run.trial040.stdout:================================================================================ 2026-02-17T04:19:55.003 INFO:teuthology.orchestra.run.trial040.stdout:Install 35 Packages 2026-02-17T04:19:55.003 INFO:teuthology.orchestra.run.trial040.stdout:Upgrade 2 Packages 2026-02-17T04:19:55.004 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:19:55.004 INFO:teuthology.orchestra.run.trial040.stdout:Total download size: 68 M 2026-02-17T04:19:55.004 INFO:teuthology.orchestra.run.trial040.stdout:Downloading Packages: 2026-02-17T04:19:56.558 INFO:teuthology.orchestra.run.trial040.stdout:(1/37): ceph-common-20.3.0-5271.g32585015.el9.x 18 MB/s | 24 MB 00:01 2026-02-17T04:19:56.577 INFO:teuthology.orchestra.run.trial040.stdout:(2/37): ceph-selinux-20.3.0-5271.g32585015.el9. 1.3 MB/s | 25 kB 00:00 2026-02-17T04:19:56.597 INFO:teuthology.orchestra.run.trial040.stdout:(3/37): libcephfs-daemon-20.3.0-5271.g32585015. 1.8 MB/s | 37 kB 00:00 2026-02-17T04:19:56.615 INFO:teuthology.orchestra.run.trial040.stdout:(4/37): ceph-radosgw-20.3.0-5271.g32585015.el9. 9.3 MB/s | 13 MB 00:01 2026-02-17T04:19:56.616 INFO:teuthology.orchestra.run.trial040.stdout:(5/37): libcephfs-proxy2-20.3.0-5271.g32585015. 1.3 MB/s | 25 kB 00:00 2026-02-17T04:19:56.636 INFO:teuthology.orchestra.run.trial040.stdout:(6/37): libradosstriper1-20.3.0-5271.g32585015. 12 MB/s | 248 kB 00:00 2026-02-17T04:19:56.693 INFO:teuthology.orchestra.run.trial040.stdout:(7/37): libcephfs2-20.3.0-5271.g32585015.el9.x8 11 MB/s | 909 kB 00:00 2026-02-17T04:19:56.725 INFO:teuthology.orchestra.run.trial040.stdout:(8/37): python3-ceph-argparse-20.3.0-5271.g3258 1.4 MB/s | 45 kB 00:00 2026-02-17T04:19:56.760 INFO:teuthology.orchestra.run.trial040.stdout:(9/37): python3-ceph-common-20.3.0-5271.g325850 5.2 MB/s | 185 kB 00:00 2026-02-17T04:19:56.795 INFO:teuthology.orchestra.run.trial040.stdout:(10/37): python3-cephfs-20.3.0-5271.g32585015.e 5.6 MB/s | 204 kB 00:00 2026-02-17T04:19:56.833 INFO:teuthology.orchestra.run.trial040.stdout:(11/37): python3-rados-20.3.0-5271.g32585015.el 8.2 MB/s | 324 kB 00:00 2026-02-17T04:19:56.872 INFO:teuthology.orchestra.run.trial040.stdout:(12/37): python3-rbd-20.3.0-5271.g32585015.el9. 7.8 MB/s | 306 kB 00:00 2026-02-17T04:19:56.907 INFO:teuthology.orchestra.run.trial040.stdout:(13/37): python3-rgw-20.3.0-5271.g32585015.el9. 2.8 MB/s | 100 kB 00:00 2026-02-17T04:19:56.917 INFO:teuthology.orchestra.run.trial040.stdout:(14/37): librgw2-20.3.0-5271.g32585015.el9.x86_ 23 MB/s | 6.5 MB 00:00 2026-02-17T04:19:57.043 INFO:teuthology.orchestra.run.trial040.stdout:(15/37): ceph-base-20.3.0-5271.g32585015.el9.x8 2.8 MB/s | 5.2 MB 00:01 2026-02-17T04:19:57.112 INFO:teuthology.orchestra.run.trial040.stdout:(16/37): nvme-cli-2.13-1.el9.x86_64.rpm 5.6 MB/s | 1.1 MB 00:00 2026-02-17T04:19:57.114 INFO:teuthology.orchestra.run.trial040.stdout:(17/37): mailcap-2.1.49-5.el9.noarch.rpm 160 kB/s | 33 kB 00:00 2026-02-17T04:19:57.128 INFO:teuthology.orchestra.run.trial040.stdout:(18/37): pciutils-3.7.0-7.el9.x86_64.rpm 1.1 MB/s | 93 kB 00:00 2026-02-17T04:19:57.810 INFO:teuthology.orchestra.run.trial040.stdout:(19/37): libnbd-1.20.3-4.el9.x86_64.rpm 236 kB/s | 164 kB 00:00 2026-02-17T04:19:57.827 INFO:teuthology.orchestra.run.trial040.stdout:(20/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 229 kB/s | 160 kB 00:00 2026-02-17T04:19:57.892 INFO:teuthology.orchestra.run.trial040.stdout:(21/37): boost-program-options-1.75.0-13.el9.x8 133 kB/s | 104 kB 00:00 2026-02-17T04:19:57.911 INFO:teuthology.orchestra.run.trial040.stdout:(22/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 445 kB/s | 45 kB 00:00 2026-02-17T04:19:58.256 INFO:teuthology.orchestra.run.trial040.stdout:(23/37): qatlib-25.08.0-2.el9.x86_64.rpm 696 kB/s | 240 kB 00:00 2026-02-17T04:19:58.357 INFO:teuthology.orchestra.run.trial040.stdout:(24/37): qatlib-service-25.08.0-2.el9.x86_64.rp 365 kB/s | 37 kB 00:00 2026-02-17T04:19:58.459 INFO:teuthology.orchestra.run.trial040.stdout:(25/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 651 kB/s | 66 kB 00:00 2026-02-17T04:19:58.666 INFO:teuthology.orchestra.run.trial040.stdout:(26/37): librdkafka-1.6.1-102.el9.x86_64.rpm 790 kB/s | 662 kB 00:00 2026-02-17T04:19:58.667 INFO:teuthology.orchestra.run.trial040.stdout:(27/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.4 MB/s | 308 kB 00:00 2026-02-17T04:19:58.702 INFO:teuthology.orchestra.run.trial040.stdout:(28/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 727 kB/s | 25 kB 00:00 2026-02-17T04:19:58.736 INFO:teuthology.orchestra.run.trial040.stdout:(29/37): liboath-2.6.12-1.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2026-02-17T04:19:58.770 INFO:teuthology.orchestra.run.trial040.stdout:(30/37): libunwind-1.6.2-1.el9.x86_64.rpm 1.9 MB/s | 67 kB 00:00 2026-02-17T04:19:58.838 INFO:teuthology.orchestra.run.trial040.stdout:(31/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 12 MB/s | 838 kB 00:00 2026-02-17T04:19:58.850 INFO:teuthology.orchestra.run.trial040.stdout:(32/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 305 kB/s | 292 kB 00:00 2026-02-17T04:19:58.876 INFO:teuthology.orchestra.run.trial040.stdout:(33/37): re2-20211101-20.el9.x86_64.rpm 5.0 MB/s | 191 kB 00:00 2026-02-17T04:19:59.031 INFO:teuthology.orchestra.run.trial040.stdout:(34/37): librados2-20.3.0-5271.g32585015.el9.x8 22 MB/s | 3.5 MB 00:00 2026-02-17T04:19:59.042 INFO:teuthology.orchestra.run.trial040.stdout:(35/37): libarrow-9.0.0-15.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2026-02-17T04:19:59.083 INFO:teuthology.orchestra.run.trial040.stdout:(36/37): thrift-0.15.0-4.el9.x86_64.rpm 6.8 MB/s | 1.6 MB 00:00 2026-02-17T04:19:59.086 INFO:teuthology.orchestra.run.trial040.stdout:(37/37): librbd1-20.3.0-5271.g32585015.el9.x86_ 51 MB/s | 2.8 MB 00:00 2026-02-17T04:19:59.088 INFO:teuthology.orchestra.run.trial040.stdout:-------------------------------------------------------------------------------- 2026-02-17T04:19:59.088 INFO:teuthology.orchestra.run.trial040.stdout:Total 17 MB/s | 68 MB 00:04 2026-02-17T04:19:59.187 INFO:teuthology.orchestra.run.trial040.stdout:Running transaction check 2026-02-17T04:19:59.206 INFO:teuthology.orchestra.run.trial040.stdout:Transaction check succeeded. 2026-02-17T04:19:59.207 INFO:teuthology.orchestra.run.trial040.stdout:Running transaction test 2026-02-17T04:19:59.459 INFO:teuthology.orchestra.run.trial040.stdout:Transaction test succeeded. 2026-02-17T04:19:59.459 INFO:teuthology.orchestra.run.trial040.stdout:Running transaction 2026-02-17T04:19:59.778 INFO:teuthology.orchestra.run.trial040.stdout: Preparing : 1/1 2026-02-17T04:19:59.933 INFO:teuthology.orchestra.run.trial040.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/39 2026-02-17T04:19:59.937 INFO:teuthology.orchestra.run.trial040.stdout: Upgrading : librados2-2:20.3.0-5271.g32585015.el9.x86_64 2/39 2026-02-17T04:19:59.990 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: librados2-2:20.3.0-5271.g32585015.el9.x86_64 2/39 2026-02-17T04:19:59.991 INFO:teuthology.orchestra.run.trial040.stdout: Installing : libcephfs2-2:20.3.0-5271.g32585015.el9.x86_64 3/39 2026-02-17T04:20:00.005 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: libcephfs2-2:20.3.0-5271.g32585015.el9.x86_64 3/39 2026-02-17T04:20:00.007 INFO:teuthology.orchestra.run.trial040.stdout: Installing : libcephfs-daemon-2:20.3.0-5271.g32585015.el9.x86_6 4/39 2026-02-17T04:20:00.008 INFO:teuthology.orchestra.run.trial040.stdout: Installing : libcephfs-proxy2-2:20.3.0-5271.g32585015.el9.x86_6 5/39 2026-02-17T04:20:00.037 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5271.g32585015.el9.x86_6 5/39 2026-02-17T04:20:00.039 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-rados-2:20.3.0-5271.g32585015.el9.x86_64 6/39 2026-02-17T04:20:00.048 INFO:teuthology.orchestra.run.trial040.stdout: Installing : liboath-2.6.12-1.el9.x86_64 7/39 2026-02-17T04:20:00.050 INFO:teuthology.orchestra.run.trial040.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/39 2026-02-17T04:20:00.053 INFO:teuthology.orchestra.run.trial040.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/39 2026-02-17T04:20:00.058 INFO:teuthology.orchestra.run.trial040.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/39 2026-02-17T04:20:00.068 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-ceph-argparse-2:20.3.0-5271.g32585015.el9. 11/39 2026-02-17T04:20:00.080 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-cephfs-2:20.3.0-5271.g32585015.el9.x86_64 12/39 2026-02-17T04:20:00.081 INFO:teuthology.orchestra.run.trial040.stdout: Installing : libradosstriper1-2:20.3.0-5271.g32585015.el9.x86_6 13/39 2026-02-17T04:20:00.102 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5271.g32585015.el9.x86_6 13/39 2026-02-17T04:20:00.105 INFO:teuthology.orchestra.run.trial040.stdout: Installing : thrift-0.15.0-4.el9.x86_64 14/39 2026-02-17T04:20:00.136 INFO:teuthology.orchestra.run.trial040.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-17T04:20:00.139 INFO:teuthology.orchestra.run.trial040.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-17T04:20:00.148 INFO:teuthology.orchestra.run.trial040.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-17T04:20:00.150 INFO:teuthology.orchestra.run.trial040.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-17T04:20:00.154 INFO:teuthology.orchestra.run.trial040.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-17T04:20:00.275 INFO:teuthology.orchestra.run.trial040.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-17T04:20:00.276 INFO:teuthology.orchestra.run.trial040.stdout: Upgrading : librbd1-2:20.3.0-5271.g32585015.el9.x86_64 21/39 2026-02-17T04:20:00.302 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: librbd1-2:20.3.0-5271.g32585015.el9.x86_64 21/39 2026-02-17T04:20:00.304 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-rbd-2:20.3.0-5271.g32585015.el9.x86_64 22/39 2026-02-17T04:20:00.310 INFO:teuthology.orchestra.run.trial040.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-17T04:20:00.594 INFO:teuthology.orchestra.run.trial040.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-17T04:20:00.595 INFO:teuthology.orchestra.run.trial040.stdout: Installing : librgw2-2:20.3.0-5271.g32585015.el9.x86_64 25/39 2026-02-17T04:20:00.612 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: librgw2-2:20.3.0-5271.g32585015.el9.x86_64 25/39 2026-02-17T04:20:00.616 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-rgw-2:20.3.0-5271.g32585015.el9.x86_64 26/39 2026-02-17T04:20:00.620 INFO:teuthology.orchestra.run.trial040.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-17T04:20:00.623 INFO:teuthology.orchestra.run.trial040.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-17T04:20:00.623 INFO:teuthology.orchestra.run.trial040.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-17T04:20:00.651 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-17T04:20:00.762 INFO:teuthology.orchestra.run.trial040.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-17T04:20:00.764 INFO:teuthology.orchestra.run.trial040.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-17T04:20:01.036 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-17T04:20:01.036 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T04:20:01.036 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:01.080 INFO:teuthology.orchestra.run.trial040.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-17T04:20:01.082 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-ceph-common-2:20.3.0-5271.g32585015.el9.x8 33/39 2026-02-17T04:20:02.172 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: ceph-common-2:20.3.0-5271.g32585015.el9.x86_64 34/39 2026-02-17T04:20:02.175 INFO:teuthology.orchestra.run.trial040.stdout: Installing : ceph-common-2:20.3.0-5271.g32585015.el9.x86_64 34/39 2026-02-17T04:20:02.437 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: ceph-common-2:20.3.0-5271.g32585015.el9.x86_64 34/39 2026-02-17T04:20:02.440 INFO:teuthology.orchestra.run.trial040.stdout: Installing : ceph-base-2:20.3.0-5271.g32585015.el9.x86_64 35/39 2026-02-17T04:20:02.481 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: ceph-base-2:20.3.0-5271.g32585015.el9.x86_64 35/39 2026-02-17T04:20:02.481 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-17T04:20:02.481 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-17T04:20:02.481 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:02.485 INFO:teuthology.orchestra.run.trial040.stdout: Installing : ceph-selinux-2:20.3.0-5271.g32585015.el9.x86_64 36/39 2026-02-17T04:20:07.027 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5271.g32585015.el9.x86_64 36/39 2026-02-17T04:20:07.028 INFO:teuthology.orchestra.run.trial040.stdout:skipping the directory /sys 2026-02-17T04:20:07.028 INFO:teuthology.orchestra.run.trial040.stdout:skipping the directory /proc 2026-02-17T04:20:07.028 INFO:teuthology.orchestra.run.trial040.stdout:skipping the directory /mnt 2026-02-17T04:20:07.028 INFO:teuthology.orchestra.run.trial040.stdout:skipping the directory /var/tmp 2026-02-17T04:20:07.028 INFO:teuthology.orchestra.run.trial040.stdout:skipping the directory /home 2026-02-17T04:20:07.028 INFO:teuthology.orchestra.run.trial040.stdout:skipping the directory /root 2026-02-17T04:20:07.028 INFO:teuthology.orchestra.run.trial040.stdout:skipping the directory /tmp 2026-02-17T04:20:07.028 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:07.612 INFO:teuthology.orchestra.run.trial040.stdout: Installing : ceph-radosgw-2:20.3.0-5271.g32585015.el9.x86_64 37/39 2026-02-17T04:20:07.636 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5271.g32585015.el9.x86_64 37/39 2026-02-17T04:20:07.636 INFO:teuthology.orchestra.run.trial040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T04:20:07.636 INFO:teuthology.orchestra.run.trial040.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-17T04:20:07.637 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T04:20:07.637 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T04:20:07.637 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:07.638 INFO:teuthology.orchestra.run.trial040.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-17T04:20:07.651 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-17T04:20:07.652 INFO:teuthology.orchestra.run.trial040.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-17T04:20:07.706 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-17T04:20:07.706 INFO:teuthology.orchestra.run.trial040.stdout:Creating group 'qat' with GID 992. 2026-02-17T04:20:07.706 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:07.989 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : ceph-base-2:20.3.0-5271.g32585015.el9.x86_64 1/39 2026-02-17T04:20:07.989 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : ceph-common-2:20.3.0-5271.g32585015.el9.x86_64 2/39 2026-02-17T04:20:07.989 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : ceph-radosgw-2:20.3.0-5271.g32585015.el9.x86_64 3/39 2026-02-17T04:20:07.989 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : ceph-selinux-2:20.3.0-5271.g32585015.el9.x86_64 4/39 2026-02-17T04:20:07.989 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : libcephfs-daemon-2:20.3.0-5271.g32585015.el9.x86_6 5/39 2026-02-17T04:20:07.989 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5271.g32585015.el9.x86_6 6/39 2026-02-17T04:20:07.989 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : libcephfs2-2:20.3.0-5271.g32585015.el9.x86_64 7/39 2026-02-17T04:20:07.989 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : libradosstriper1-2:20.3.0-5271.g32585015.el9.x86_6 8/39 2026-02-17T04:20:07.990 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : librgw2-2:20.3.0-5271.g32585015.el9.x86_64 9/39 2026-02-17T04:20:07.990 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5271.g32585015.el9. 10/39 2026-02-17T04:20:07.990 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-ceph-common-2:20.3.0-5271.g32585015.el9.x8 11/39 2026-02-17T04:20:07.990 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-cephfs-2:20.3.0-5271.g32585015.el9.x86_64 12/39 2026-02-17T04:20:07.990 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-rados-2:20.3.0-5271.g32585015.el9.x86_64 13/39 2026-02-17T04:20:07.990 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-rbd-2:20.3.0-5271.g32585015.el9.x86_64 14/39 2026-02-17T04:20:07.990 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-rgw-2:20.3.0-5271.g32585015.el9.x86_64 15/39 2026-02-17T04:20:07.990 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-17T04:20:07.990 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 17/39 2026-02-17T04:20:07.990 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-17T04:20:07.990 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-17T04:20:07.990 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-17T04:20:07.991 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-17T04:20:07.991 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-17T04:20:07.991 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-17T04:20:07.991 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-17T04:20:07.991 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-17T04:20:07.991 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-17T04:20:07.991 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-17T04:20:07.991 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-17T04:20:07.991 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-17T04:20:07.991 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-17T04:20:07.991 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-17T04:20:07.991 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-17T04:20:07.991 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-17T04:20:07.992 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-17T04:20:07.992 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-17T04:20:07.992 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : librados2-2:20.3.0-5271.g32585015.el9.x86_64 36/39 2026-02-17T04:20:07.992 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-17T04:20:07.992 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : librbd1-2:20.3.0-5271.g32585015.el9.x86_64 38/39 2026-02-17T04:20:08.050 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-17T04:20:08.050 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:08.050 INFO:teuthology.orchestra.run.trial040.stdout:Upgraded: 2026-02-17T04:20:08.050 INFO:teuthology.orchestra.run.trial040.stdout: librados2-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:20:08.050 INFO:teuthology.orchestra.run.trial040.stdout: librbd1-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:20:08.050 INFO:teuthology.orchestra.run.trial040.stdout:Installed: 2026-02-17T04:20:08.051 INFO:teuthology.orchestra.run.trial040.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-17T04:20:08.051 INFO:teuthology.orchestra.run.trial040.stdout: ceph-base-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:20:08.051 INFO:teuthology.orchestra.run.trial040.stdout: ceph-common-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:20:08.051 INFO:teuthology.orchestra.run.trial040.stdout: ceph-radosgw-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:20:08.051 INFO:teuthology.orchestra.run.trial040.stdout: ceph-selinux-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:20:08.051 INFO:teuthology.orchestra.run.trial040.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-17T04:20:08.051 INFO:teuthology.orchestra.run.trial040.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-17T04:20:08.051 INFO:teuthology.orchestra.run.trial040.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-17T04:20:08.051 INFO:teuthology.orchestra.run.trial040.stdout: libcephfs-daemon-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:20:08.051 INFO:teuthology.orchestra.run.trial040.stdout: libcephfs-proxy2-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:20:08.051 INFO:teuthology.orchestra.run.trial040.stdout: libcephfs2-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:20:08.051 INFO:teuthology.orchestra.run.trial040.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-17T04:20:08.052 INFO:teuthology.orchestra.run.trial040.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-17T04:20:08.052 INFO:teuthology.orchestra.run.trial040.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-17T04:20:08.052 INFO:teuthology.orchestra.run.trial040.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-17T04:20:08.052 INFO:teuthology.orchestra.run.trial040.stdout: libradosstriper1-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:20:08.052 INFO:teuthology.orchestra.run.trial040.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-17T04:20:08.052 INFO:teuthology.orchestra.run.trial040.stdout: librgw2-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:20:08.052 INFO:teuthology.orchestra.run.trial040.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-17T04:20:08.052 INFO:teuthology.orchestra.run.trial040.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-17T04:20:08.052 INFO:teuthology.orchestra.run.trial040.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-17T04:20:08.052 INFO:teuthology.orchestra.run.trial040.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-17T04:20:08.052 INFO:teuthology.orchestra.run.trial040.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-17T04:20:08.053 INFO:teuthology.orchestra.run.trial040.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-17T04:20:08.053 INFO:teuthology.orchestra.run.trial040.stdout: python3-ceph-argparse-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:20:08.053 INFO:teuthology.orchestra.run.trial040.stdout: python3-ceph-common-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:20:08.053 INFO:teuthology.orchestra.run.trial040.stdout: python3-cephfs-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:20:08.053 INFO:teuthology.orchestra.run.trial040.stdout: python3-rados-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:20:08.053 INFO:teuthology.orchestra.run.trial040.stdout: python3-rbd-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:20:08.053 INFO:teuthology.orchestra.run.trial040.stdout: python3-rgw-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:20:08.053 INFO:teuthology.orchestra.run.trial040.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-17T04:20:08.053 INFO:teuthology.orchestra.run.trial040.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-17T04:20:08.053 INFO:teuthology.orchestra.run.trial040.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-17T04:20:08.053 INFO:teuthology.orchestra.run.trial040.stdout: re2-1:20211101-20.el9.x86_64 2026-02-17T04:20:08.053 INFO:teuthology.orchestra.run.trial040.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-17T04:20:08.053 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:08.054 INFO:teuthology.orchestra.run.trial040.stdout:Complete! 2026-02-17T04:20:08.093 DEBUG:teuthology.orchestra.run.trial040:> sudo yum -y install ceph-test 2026-02-17T04:20:08.406 INFO:teuthology.orchestra.run.trial040.stdout:Last metadata expiration check: 0:00:15 ago on Tue 17 Feb 2026 04:19:53 AM UTC. 2026-02-17T04:20:08.489 INFO:teuthology.orchestra.run.trial040.stdout:Dependencies resolved. 2026-02-17T04:20:08.491 INFO:teuthology.orchestra.run.trial040.stdout:================================================================================ 2026-02-17T04:20:08.491 INFO:teuthology.orchestra.run.trial040.stdout: Package Arch Version Repository Size 2026-02-17T04:20:08.491 INFO:teuthology.orchestra.run.trial040.stdout:================================================================================ 2026-02-17T04:20:08.491 INFO:teuthology.orchestra.run.trial040.stdout:Installing: 2026-02-17T04:20:08.491 INFO:teuthology.orchestra.run.trial040.stdout: ceph-test x86_64 2:20.3.0-5271.g32585015.el9 ceph 78 M 2026-02-17T04:20:08.491 INFO:teuthology.orchestra.run.trial040.stdout:Installing dependencies: 2026-02-17T04:20:08.491 INFO:teuthology.orchestra.run.trial040.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-17T04:20:08.491 INFO:teuthology.orchestra.run.trial040.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-17T04:20:08.491 INFO:teuthology.orchestra.run.trial040.stdout: libcephsqlite x86_64 2:20.3.0-5271.g32585015.el9 ceph 159 k 2026-02-17T04:20:08.492 INFO:teuthology.orchestra.run.trial040.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-17T04:20:08.492 INFO:teuthology.orchestra.run.trial040.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-17T04:20:08.492 INFO:teuthology.orchestra.run.trial040.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-17T04:20:08.492 INFO:teuthology.orchestra.run.trial040.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-17T04:20:08.492 INFO:teuthology.orchestra.run.trial040.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-17T04:20:08.492 INFO:teuthology.orchestra.run.trial040.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-17T04:20:08.492 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:08.492 INFO:teuthology.orchestra.run.trial040.stdout:Transaction Summary 2026-02-17T04:20:08.492 INFO:teuthology.orchestra.run.trial040.stdout:================================================================================ 2026-02-17T04:20:08.492 INFO:teuthology.orchestra.run.trial040.stdout:Install 10 Packages 2026-02-17T04:20:08.493 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:08.493 INFO:teuthology.orchestra.run.trial040.stdout:Total download size: 82 M 2026-02-17T04:20:08.493 INFO:teuthology.orchestra.run.trial040.stdout:Installed size: 339 M 2026-02-17T04:20:08.493 INFO:teuthology.orchestra.run.trial040.stdout:Downloading Packages: 2026-02-17T04:20:08.760 INFO:teuthology.orchestra.run.trial040.stdout:(1/10): hwloc-libs-2.4.1-6.el9.x86_64.rpm 27 MB/s | 2.1 MB 00:00 2026-02-17T04:20:08.768 INFO:teuthology.orchestra.run.trial040.stdout:(2/10): libatomic-11.5.0-14.el9.x86_64.rpm 2.6 MB/s | 23 kB 00:00 2026-02-17T04:20:08.778 INFO:teuthology.orchestra.run.trial040.stdout:(3/10): lksctp-tools-1.0.19-2.el9.x86_64.rpm 9.8 MB/s | 94 kB 00:00 2026-02-17T04:20:09.084 INFO:teuthology.orchestra.run.trial040.stdout:(4/10): libcephsqlite-20.3.0-5271.g32585015.el9 394 kB/s | 159 kB 00:00 2026-02-17T04:20:09.554 INFO:teuthology.orchestra.run.trial040.stdout:(5/10): libxslt-1.1.34-12.el9.x86_64.rpm 300 kB/s | 233 kB 00:00 2026-02-17T04:20:09.980 INFO:teuthology.orchestra.run.trial040.stdout:(6/10): socat-1.7.4.1-8.el9.x86_64.rpm 713 kB/s | 303 kB 00:00 2026-02-17T04:20:10.081 INFO:teuthology.orchestra.run.trial040.stdout:(7/10): xmlstarlet-1.6.1-20.el9.x86_64.rpm 625 kB/s | 64 kB 00:00 2026-02-17T04:20:10.118 INFO:teuthology.orchestra.run.trial040.stdout:(8/10): yaml-cpp-0.6.3-5.el9.x86_64.rpm 3.3 MB/s | 122 kB 00:00 2026-02-17T04:20:10.647 INFO:teuthology.orchestra.run.trial040.stdout:(9/10): protobuf-3.14.0-17.el9.x86_64.rpm 658 kB/s | 1.0 MB 00:01 2026-02-17T04:20:15.636 INFO:teuthology.orchestra.run.trial040.stdout:(10/10): ceph-test-20.3.0-5271.g32585015.el9.x8 11 MB/s | 78 MB 00:06 2026-02-17T04:20:15.639 INFO:teuthology.orchestra.run.trial040.stdout:-------------------------------------------------------------------------------- 2026-02-17T04:20:15.639 INFO:teuthology.orchestra.run.trial040.stdout:Total 12 MB/s | 82 MB 00:07 2026-02-17T04:20:15.704 INFO:teuthology.orchestra.run.trial040.stdout:Running transaction check 2026-02-17T04:20:15.715 INFO:teuthology.orchestra.run.trial040.stdout:Transaction check succeeded. 2026-02-17T04:20:15.715 INFO:teuthology.orchestra.run.trial040.stdout:Running transaction test 2026-02-17T04:20:16.000 INFO:teuthology.orchestra.run.trial040.stdout:Transaction test succeeded. 2026-02-17T04:20:16.001 INFO:teuthology.orchestra.run.trial040.stdout:Running transaction 2026-02-17T04:20:16.311 INFO:teuthology.orchestra.run.trial040.stdout: Preparing : 1/1 2026-02-17T04:20:16.319 INFO:teuthology.orchestra.run.trial040.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/10 2026-02-17T04:20:16.328 INFO:teuthology.orchestra.run.trial040.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 2/10 2026-02-17T04:20:16.333 INFO:teuthology.orchestra.run.trial040.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/10 2026-02-17T04:20:16.337 INFO:teuthology.orchestra.run.trial040.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/10 2026-02-17T04:20:16.343 INFO:teuthology.orchestra.run.trial040.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 5/10 2026-02-17T04:20:16.344 INFO:teuthology.orchestra.run.trial040.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 6/10 2026-02-17T04:20:16.354 INFO:teuthology.orchestra.run.trial040.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 7/10 2026-02-17T04:20:16.362 INFO:teuthology.orchestra.run.trial040.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 8/10 2026-02-17T04:20:16.363 INFO:teuthology.orchestra.run.trial040.stdout: Installing : libcephsqlite-2:20.3.0-5271.g32585015.el9.x86_64 9/10 2026-02-17T04:20:19.817 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5271.g32585015.el9.x86_64 9/10 2026-02-17T04:20:19.836 INFO:teuthology.orchestra.run.trial040.stdout: Installing : ceph-test-2:20.3.0-5271.g32585015.el9.x86_64 10/10 2026-02-17T04:20:20.147 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: ceph-test-2:20.3.0-5271.g32585015.el9.x86_64 10/10 2026-02-17T04:20:20.147 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : ceph-test-2:20.3.0-5271.g32585015.el9.x86_64 1/10 2026-02-17T04:20:20.147 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : libcephsqlite-2:20.3.0-5271.g32585015.el9.x86_64 2/10 2026-02-17T04:20:20.147 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 3/10 2026-02-17T04:20:20.148 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 4/10 2026-02-17T04:20:20.148 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 5/10 2026-02-17T04:20:20.148 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 6/10 2026-02-17T04:20:20.148 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 7/10 2026-02-17T04:20:20.148 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 8/10 2026-02-17T04:20:20.148 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 9/10 2026-02-17T04:20:20.202 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 10/10 2026-02-17T04:20:20.202 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:20.202 INFO:teuthology.orchestra.run.trial040.stdout:Installed: 2026-02-17T04:20:20.202 INFO:teuthology.orchestra.run.trial040.stdout: ceph-test-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:20:20.202 INFO:teuthology.orchestra.run.trial040.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-17T04:20:20.202 INFO:teuthology.orchestra.run.trial040.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-17T04:20:20.202 INFO:teuthology.orchestra.run.trial040.stdout: libcephsqlite-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:20:20.202 INFO:teuthology.orchestra.run.trial040.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-17T04:20:20.202 INFO:teuthology.orchestra.run.trial040.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-17T04:20:20.202 INFO:teuthology.orchestra.run.trial040.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-17T04:20:20.202 INFO:teuthology.orchestra.run.trial040.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-17T04:20:20.202 INFO:teuthology.orchestra.run.trial040.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-17T04:20:20.202 INFO:teuthology.orchestra.run.trial040.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-17T04:20:20.202 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:20.202 INFO:teuthology.orchestra.run.trial040.stdout:Complete! 2026-02-17T04:20:20.239 DEBUG:teuthology.orchestra.run.trial040:> sudo yum -y install ceph 2026-02-17T04:20:20.546 INFO:teuthology.orchestra.run.trial040.stdout:Last metadata expiration check: 0:00:27 ago on Tue 17 Feb 2026 04:19:53 AM UTC. 2026-02-17T04:20:20.631 INFO:teuthology.orchestra.run.trial040.stdout:Dependencies resolved. 2026-02-17T04:20:20.633 INFO:teuthology.orchestra.run.trial040.stdout:======================================================================================= 2026-02-17T04:20:20.633 INFO:teuthology.orchestra.run.trial040.stdout: Package Arch Version Repository Size 2026-02-17T04:20:20.634 INFO:teuthology.orchestra.run.trial040.stdout:======================================================================================= 2026-02-17T04:20:20.634 INFO:teuthology.orchestra.run.trial040.stdout:Installing: 2026-02-17T04:20:20.634 INFO:teuthology.orchestra.run.trial040.stdout: ceph x86_64 2:20.3.0-5271.g32585015.el9 ceph 6.5 k 2026-02-17T04:20:20.634 INFO:teuthology.orchestra.run.trial040.stdout:Installing dependencies: 2026-02-17T04:20:20.634 INFO:teuthology.orchestra.run.trial040.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-17T04:20:20.634 INFO:teuthology.orchestra.run.trial040.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5271.g32585015.el9 ceph-noarch 57 k 2026-02-17T04:20:20.634 INFO:teuthology.orchestra.run.trial040.stdout: ceph-mds x86_64 2:20.3.0-5271.g32585015.el9 ceph 2.4 M 2026-02-17T04:20:20.634 INFO:teuthology.orchestra.run.trial040.stdout: ceph-mgr x86_64 2:20.3.0-5271.g32585015.el9 ceph 936 k 2026-02-17T04:20:20.634 INFO:teuthology.orchestra.run.trial040.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5271.g32585015.el9 ceph-noarch 297 k 2026-02-17T04:20:20.634 INFO:teuthology.orchestra.run.trial040.stdout: ceph-mon x86_64 2:20.3.0-5271.g32585015.el9 ceph 5.0 M 2026-02-17T04:20:20.634 INFO:teuthology.orchestra.run.trial040.stdout: ceph-osd x86_64 2:20.3.0-5271.g32585015.el9 ceph 167 k 2026-02-17T04:20:20.634 INFO:teuthology.orchestra.run.trial040.stdout: ceph-osd-classic x86_64 2:20.3.0-5271.g32585015.el9 ceph 16 M 2026-02-17T04:20:20.634 INFO:teuthology.orchestra.run.trial040.stdout: ceph-osd-crimson x86_64 2:20.3.0-5271.g32585015.el9 ceph 19 M 2026-02-17T04:20:20.634 INFO:teuthology.orchestra.run.trial040.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5271.g32585015.el9 ceph-noarch 17 k 2026-02-17T04:20:20.634 INFO:teuthology.orchestra.run.trial040.stdout: cephadm noarch 2:20.3.0-5271.g32585015.el9 ceph-noarch 1.0 M 2026-02-17T04:20:20.634 INFO:teuthology.orchestra.run.trial040.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-17T04:20:20.634 INFO:teuthology.orchestra.run.trial040.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-17T04:20:20.634 INFO:teuthology.orchestra.run.trial040.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-17T04:20:20.634 INFO:teuthology.orchestra.run.trial040.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-17T04:20:20.634 INFO:teuthology.orchestra.run.trial040.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-17T04:20:20.634 INFO:teuthology.orchestra.run.trial040.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-17T04:20:20.634 INFO:teuthology.orchestra.run.trial040.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-17T04:20:20.634 INFO:teuthology.orchestra.run.trial040.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-17T04:20:20.634 INFO:teuthology.orchestra.run.trial040.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-17T04:20:20.634 INFO:teuthology.orchestra.run.trial040.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-17T04:20:20.634 INFO:teuthology.orchestra.run.trial040.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-17T04:20:20.634 INFO:teuthology.orchestra.run.trial040.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-17T04:20:20.634 INFO:teuthology.orchestra.run.trial040.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-17T04:20:20.634 INFO:teuthology.orchestra.run.trial040.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-17T04:20:20.635 INFO:teuthology.orchestra.run.trial040.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-17T04:20:20.635 INFO:teuthology.orchestra.run.trial040.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-17T04:20:20.635 INFO:teuthology.orchestra.run.trial040.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-17T04:20:20.635 INFO:teuthology.orchestra.run.trial040.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-17T04:20:20.635 INFO:teuthology.orchestra.run.trial040.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-17T04:20:20.635 INFO:teuthology.orchestra.run.trial040.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-17T04:20:20.635 INFO:teuthology.orchestra.run.trial040.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-17T04:20:20.635 INFO:teuthology.orchestra.run.trial040.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-17T04:20:20.635 INFO:teuthology.orchestra.run.trial040.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-17T04:20:20.635 INFO:teuthology.orchestra.run.trial040.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-17T04:20:20.635 INFO:teuthology.orchestra.run.trial040.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-17T04:20:20.635 INFO:teuthology.orchestra.run.trial040.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-17T04:20:20.635 INFO:teuthology.orchestra.run.trial040.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-17T04:20:20.635 INFO:teuthology.orchestra.run.trial040.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-17T04:20:20.635 INFO:teuthology.orchestra.run.trial040.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-17T04:20:20.635 INFO:teuthology.orchestra.run.trial040.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-17T04:20:20.635 INFO:teuthology.orchestra.run.trial040.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-17T04:20:20.635 INFO:teuthology.orchestra.run.trial040.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-17T04:20:20.635 INFO:teuthology.orchestra.run.trial040.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-17T04:20:20.635 INFO:teuthology.orchestra.run.trial040.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-17T04:20:20.635 INFO:teuthology.orchestra.run.trial040.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-17T04:20:20.635 INFO:teuthology.orchestra.run.trial040.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-17T04:20:20.635 INFO:teuthology.orchestra.run.trial040.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-17T04:20:20.635 INFO:teuthology.orchestra.run.trial040.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-17T04:20:20.635 INFO:teuthology.orchestra.run.trial040.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-17T04:20:20.635 INFO:teuthology.orchestra.run.trial040.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-17T04:20:20.635 INFO:teuthology.orchestra.run.trial040.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-17T04:20:20.635 INFO:teuthology.orchestra.run.trial040.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-17T04:20:20.635 INFO:teuthology.orchestra.run.trial040.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-17T04:20:20.635 INFO:teuthology.orchestra.run.trial040.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-17T04:20:20.635 INFO:teuthology.orchestra.run.trial040.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-17T04:20:20.635 INFO:teuthology.orchestra.run.trial040.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-17T04:20:20.636 INFO:teuthology.orchestra.run.trial040.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-17T04:20:20.636 INFO:teuthology.orchestra.run.trial040.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-17T04:20:20.636 INFO:teuthology.orchestra.run.trial040.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-17T04:20:20.636 INFO:teuthology.orchestra.run.trial040.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-17T04:20:20.636 INFO:teuthology.orchestra.run.trial040.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-17T04:20:20.636 INFO:teuthology.orchestra.run.trial040.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-17T04:20:20.636 INFO:teuthology.orchestra.run.trial040.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-17T04:20:20.636 INFO:teuthology.orchestra.run.trial040.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-17T04:20:20.636 INFO:teuthology.orchestra.run.trial040.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-17T04:20:20.636 INFO:teuthology.orchestra.run.trial040.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-17T04:20:20.636 INFO:teuthology.orchestra.run.trial040.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-17T04:20:20.636 INFO:teuthology.orchestra.run.trial040.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-17T04:20:20.636 INFO:teuthology.orchestra.run.trial040.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-17T04:20:20.636 INFO:teuthology.orchestra.run.trial040.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-17T04:20:20.636 INFO:teuthology.orchestra.run.trial040.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-17T04:20:20.636 INFO:teuthology.orchestra.run.trial040.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-17T04:20:20.636 INFO:teuthology.orchestra.run.trial040.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-17T04:20:20.636 INFO:teuthology.orchestra.run.trial040.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-17T04:20:20.636 INFO:teuthology.orchestra.run.trial040.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-17T04:20:20.636 INFO:teuthology.orchestra.run.trial040.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-17T04:20:20.636 INFO:teuthology.orchestra.run.trial040.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-17T04:20:20.636 INFO:teuthology.orchestra.run.trial040.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-17T04:20:20.636 INFO:teuthology.orchestra.run.trial040.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-17T04:20:20.636 INFO:teuthology.orchestra.run.trial040.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-17T04:20:20.636 INFO:teuthology.orchestra.run.trial040.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-17T04:20:20.636 INFO:teuthology.orchestra.run.trial040.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-17T04:20:20.636 INFO:teuthology.orchestra.run.trial040.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-17T04:20:20.636 INFO:teuthology.orchestra.run.trial040.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-17T04:20:20.636 INFO:teuthology.orchestra.run.trial040.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-17T04:20:20.636 INFO:teuthology.orchestra.run.trial040.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-17T04:20:20.636 INFO:teuthology.orchestra.run.trial040.stdout:Installing weak dependencies: 2026-02-17T04:20:20.636 INFO:teuthology.orchestra.run.trial040.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5271.g32585015.el9 ceph-noarch 184 k 2026-02-17T04:20:20.637 INFO:teuthology.orchestra.run.trial040.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5271.g32585015.el9 ceph-noarch 51 M 2026-02-17T04:20:20.637 INFO:teuthology.orchestra.run.trial040.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5271.g32585015.el9 ceph-noarch 7.4 M 2026-02-17T04:20:20.637 INFO:teuthology.orchestra.run.trial040.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5271.g32585015.el9 ceph-noarch 22 k 2026-02-17T04:20:20.637 INFO:teuthology.orchestra.run.trial040.stdout: ceph-mgr-rook noarch 2:20.3.0-5271.g32585015.el9 ceph-noarch 50 k 2026-02-17T04:20:20.637 INFO:teuthology.orchestra.run.trial040.stdout: ceph-volume noarch 2:20.3.0-5271.g32585015.el9 ceph-noarch 299 k 2026-02-17T04:20:20.637 INFO:teuthology.orchestra.run.trial040.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-17T04:20:20.637 INFO:teuthology.orchestra.run.trial040.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-17T04:20:20.637 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:20.637 INFO:teuthology.orchestra.run.trial040.stdout:Transaction Summary 2026-02-17T04:20:20.637 INFO:teuthology.orchestra.run.trial040.stdout:======================================================================================= 2026-02-17T04:20:20.637 INFO:teuthology.orchestra.run.trial040.stdout:Install 96 Packages 2026-02-17T04:20:20.637 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:20.637 INFO:teuthology.orchestra.run.trial040.stdout:Total download size: 158 M 2026-02-17T04:20:20.637 INFO:teuthology.orchestra.run.trial040.stdout:Installed size: 732 M 2026-02-17T04:20:20.637 INFO:teuthology.orchestra.run.trial040.stdout:Downloading Packages: 2026-02-17T04:20:20.970 INFO:teuthology.orchestra.run.trial040.stdout:(1/96): ceph-20.3.0-5271.g32585015.el9.x86_64.r 127 kB/s | 6.5 kB 00:00 2026-02-17T04:20:21.090 INFO:teuthology.orchestra.run.trial040.stdout:(2/96): ceph-mds-20.3.0-5271.g32585015.el9.x86_ 14 MB/s | 2.4 MB 00:00 2026-02-17T04:20:21.091 INFO:teuthology.orchestra.run.trial040.stdout:(3/96): ceph-mgr-20.3.0-5271.g32585015.el9.x86_ 5.3 MB/s | 936 kB 00:00 2026-02-17T04:20:21.110 INFO:teuthology.orchestra.run.trial040.stdout:(4/96): ceph-osd-20.3.0-5271.g32585015.el9.x86_ 8.3 MB/s | 167 kB 00:00 2026-02-17T04:20:21.213 INFO:teuthology.orchestra.run.trial040.stdout:(5/96): ceph-mon-20.3.0-5271.g32585015.el9.x86_ 20 MB/s | 5.0 MB 00:00 2026-02-17T04:20:21.256 INFO:teuthology.orchestra.run.trial040.stdout:(6/96): ceph-grafana-dashboards-20.3.0-5271.g32 1.3 MB/s | 57 kB 00:00 2026-02-17T04:20:21.304 INFO:teuthology.orchestra.run.trial040.stdout:(7/96): ceph-mgr-cephadm-20.3.0-5271.g32585015. 3.8 MB/s | 184 kB 00:00 2026-02-17T04:20:21.754 INFO:teuthology.orchestra.run.trial040.stdout:(8/96): ceph-osd-crimson-20.3.0-5271.g32585015. 30 MB/s | 19 MB 00:00 2026-02-17T04:20:22.016 INFO:teuthology.orchestra.run.trial040.stdout:(9/96): ceph-mgr-diskprediction-local-20.3.0-52 28 MB/s | 7.4 MB 00:00 2026-02-17T04:20:22.040 INFO:teuthology.orchestra.run.trial040.stdout:(10/96): ceph-mgr-k8sevents-20.3.0-5271.g325850 961 kB/s | 22 kB 00:00 2026-02-17T04:20:22.071 INFO:teuthology.orchestra.run.trial040.stdout:(11/96): ceph-mgr-modules-core-20.3.0-5271.g325 9.3 MB/s | 297 kB 00:00 2026-02-17T04:20:22.099 INFO:teuthology.orchestra.run.trial040.stdout:(12/96): ceph-mgr-rook-20.3.0-5271.g32585015.el 1.8 MB/s | 50 kB 00:00 2026-02-17T04:20:22.124 INFO:teuthology.orchestra.run.trial040.stdout:(13/96): ceph-prometheus-alerts-20.3.0-5271.g32 679 kB/s | 17 kB 00:00 2026-02-17T04:20:22.157 INFO:teuthology.orchestra.run.trial040.stdout:(14/96): ceph-volume-20.3.0-5271.g32585015.el9. 9.1 MB/s | 299 kB 00:00 2026-02-17T04:20:22.202 INFO:teuthology.orchestra.run.trial040.stdout:(15/96): cephadm-20.3.0-5271.g32585015.el9.noar 22 MB/s | 1.0 MB 00:00 2026-02-17T04:20:22.281 INFO:teuthology.orchestra.run.trial040.stdout:(16/96): ceph-osd-classic-20.3.0-5271.g32585015 13 MB/s | 16 MB 00:01 2026-02-17T04:20:22.289 INFO:teuthology.orchestra.run.trial040.stdout:(17/96): cryptsetup-2.8.1-2.el9.x86_64.rpm 4.0 MB/s | 350 kB 00:00 2026-02-17T04:20:22.298 INFO:teuthology.orchestra.run.trial040.stdout:(18/96): libconfig-1.7.2-9.el9.x86_64.rpm 7.4 MB/s | 72 kB 00:00 2026-02-17T04:20:22.310 INFO:teuthology.orchestra.run.trial040.stdout:(19/96): ledmon-libs-1.1.0-3.el9.x86_64.rpm 1.4 MB/s | 40 kB 00:00 2026-02-17T04:20:22.325 INFO:teuthology.orchestra.run.trial040.stdout:(20/96): libgfortran-11.5.0-14.el9.x86_64.rpm 29 MB/s | 794 kB 00:00 2026-02-17T04:20:22.339 INFO:teuthology.orchestra.run.trial040.stdout:(21/96): python3-cffi-1.14.5-5.el9.x86_64.rpm 18 MB/s | 253 kB 00:00 2026-02-17T04:20:22.339 INFO:teuthology.orchestra.run.trial040.stdout:(22/96): libquadmath-11.5.0-14.el9.x86_64.rpm 6.2 MB/s | 184 kB 00:00 2026-02-17T04:20:22.351 INFO:teuthology.orchestra.run.trial040.stdout:(23/96): python3-ply-3.11-14.el9.noarch.rpm 9.1 MB/s | 106 kB 00:00 2026-02-17T04:20:22.359 INFO:teuthology.orchestra.run.trial040.stdout:(24/96): python3-cryptography-36.0.1-5.el9.x86_ 62 MB/s | 1.2 MB 00:00 2026-02-17T04:20:22.363 INFO:teuthology.orchestra.run.trial040.stdout:(25/96): python3-pycparser-2.20-6.el9.noarch.rp 11 MB/s | 135 kB 00:00 2026-02-17T04:20:22.369 INFO:teuthology.orchestra.run.trial040.stdout:(26/96): python3-pyparsing-2.4.7-9.el9.noarch.r 14 MB/s | 150 kB 00:00 2026-02-17T04:20:22.375 INFO:teuthology.orchestra.run.trial040.stdout:(27/96): python3-requests-2.25.1-10.el9.noarch. 11 MB/s | 126 kB 00:00 2026-02-17T04:20:22.380 INFO:teuthology.orchestra.run.trial040.stdout:(28/96): python3-urllib3-1.26.5-7.el9.noarch.rp 19 MB/s | 218 kB 00:00 2026-02-17T04:20:22.388 INFO:teuthology.orchestra.run.trial040.stdout:(29/96): unzip-6.0-59.el9.x86_64.rpm 14 MB/s | 182 kB 00:00 2026-02-17T04:20:22.391 INFO:teuthology.orchestra.run.trial040.stdout:(30/96): zip-3.0-35.el9.x86_64.rpm 25 MB/s | 266 kB 00:00 2026-02-17T04:20:22.397 INFO:teuthology.orchestra.run.trial040.stdout:(31/96): flexiblas-3.0.4-9.el9.x86_64.rpm 3.2 MB/s | 30 kB 00:00 2026-02-17T04:20:22.406 INFO:teuthology.orchestra.run.trial040.stdout:(32/96): flexiblas-openblas-openmp-3.0.4-9.el9. 1.7 MB/s | 15 kB 00:00 2026-02-17T04:20:22.413 INFO:teuthology.orchestra.run.trial040.stdout:(33/96): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 135 MB/s | 3.0 MB 00:00 2026-02-17T04:20:22.420 INFO:teuthology.orchestra.run.trial040.stdout:(34/96): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 18 MB/s | 246 kB 00:00 2026-02-17T04:20:22.424 INFO:teuthology.orchestra.run.trial040.stdout:(35/96): lua-5.4.4-4.el9.x86_64.rpm 18 MB/s | 188 kB 00:00 2026-02-17T04:20:22.429 INFO:teuthology.orchestra.run.trial040.stdout:(36/96): openblas-0.3.29-1.el9.x86_64.rpm 4.5 MB/s | 42 kB 00:00 2026-02-17T04:20:22.457 INFO:teuthology.orchestra.run.trial040.stdout:(37/96): openblas-openmp-0.3.29-1.el9.x86_64.rp 161 MB/s | 5.3 MB 00:00 2026-02-17T04:20:22.468 INFO:teuthology.orchestra.run.trial040.stdout:(38/96): python3-devel-3.9.25-2.el9.x86_64.rpm 21 MB/s | 244 kB 00:00 2026-02-17T04:20:22.482 INFO:teuthology.orchestra.run.trial040.stdout:(39/96): python3-jinja2-2.11.3-8.el9.noarch.rpm 18 MB/s | 249 kB 00:00 2026-02-17T04:20:22.492 INFO:teuthology.orchestra.run.trial040.stdout:(40/96): python3-jmespath-1.0.1-1.el9.noarch.rp 4.9 MB/s | 48 kB 00:00 2026-02-17T04:20:22.503 INFO:teuthology.orchestra.run.trial040.stdout:(41/96): python3-libstoragemgmt-1.10.1-1.el9.x8 16 MB/s | 177 kB 00:00 2026-02-17T04:20:22.537 INFO:teuthology.orchestra.run.trial040.stdout:(42/96): python3-lxml-4.6.5-3.el9.x86_64.rpm 36 MB/s | 1.2 MB 00:00 2026-02-17T04:20:22.546 INFO:teuthology.orchestra.run.trial040.stdout:(43/96): python3-markupsafe-1.1.1-12.el9.x86_64 3.7 MB/s | 35 kB 00:00 2026-02-17T04:20:22.562 INFO:teuthology.orchestra.run.trial040.stdout:(44/96): python3-babel-2.9.1-2.el9.noarch.rpm 45 MB/s | 6.0 MB 00:00 2026-02-17T04:20:22.575 INFO:teuthology.orchestra.run.trial040.stdout:(45/96): python3-numpy-f2py-1.23.5-2.el9.x86_64 33 MB/s | 442 kB 00:00 2026-02-17T04:20:22.584 INFO:teuthology.orchestra.run.trial040.stdout:(46/96): python3-numpy-1.23.5-2.el9.x86_64.rpm 165 MB/s | 6.1 MB 00:00 2026-02-17T04:20:22.586 INFO:teuthology.orchestra.run.trial040.stdout:(47/96): python3-packaging-20.9-5.el9.noarch.rp 7.1 MB/s | 77 kB 00:00 2026-02-17T04:20:22.595 INFO:teuthology.orchestra.run.trial040.stdout:(48/96): python3-protobuf-3.14.0-17.el9.noarch. 24 MB/s | 267 kB 00:00 2026-02-17T04:20:22.596 INFO:teuthology.orchestra.run.trial040.stdout:(49/96): python3-pyasn1-0.4.8-6.el9.noarch.rpm 15 MB/s | 159 kB 00:00 2026-02-17T04:20:22.606 INFO:teuthology.orchestra.run.trial040.stdout:(50/96): python3-pyasn1-modules-0.4.8-6.el9.noa 24 MB/s | 279 kB 00:00 2026-02-17T04:20:22.607 INFO:teuthology.orchestra.run.trial040.stdout:(51/96): python3-requests-oauthlib-1.3.0-12.el9 5.0 MB/s | 54 kB 00:00 2026-02-17T04:20:22.616 INFO:teuthology.orchestra.run.trial040.stdout:(52/96): python3-toml-0.10.2-6.el9.noarch.rpm 4.2 MB/s | 42 kB 00:00 2026-02-17T04:20:22.626 INFO:teuthology.orchestra.run.trial040.stdout:(53/96): xmlsec1-1.2.29-13.el9.x86_64.rpm 19 MB/s | 189 kB 00:00 2026-02-17T04:20:22.637 INFO:teuthology.orchestra.run.trial040.stdout:(54/96): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 8.3 MB/s | 90 kB 00:00 2026-02-17T04:20:22.661 INFO:teuthology.orchestra.run.trial040.stdout:(55/96): lua-devel-5.4.4-4.el9.x86_64.rpm 917 kB/s | 22 kB 00:00 2026-02-17T04:20:22.703 INFO:teuthology.orchestra.run.trial040.stdout:(56/96): python3-scipy-1.9.3-2.el9.x86_64.rpm 200 MB/s | 19 MB 00:00 2026-02-17T04:20:22.721 INFO:teuthology.orchestra.run.trial040.stdout:(57/96): protobuf-compiler-3.14.0-17.el9.x86_64 14 MB/s | 862 kB 00:00 2026-02-17T04:20:22.859 INFO:teuthology.orchestra.run.trial040.stdout:(58/96): ceph-mgr-dashboard-20.3.0-5271.g325850 33 MB/s | 51 MB 00:01 2026-02-17T04:20:23.034 INFO:teuthology.orchestra.run.trial040.stdout:[MIRROR] abseil-cpp-20211102.0-4.el9.x86_64.rpm: Status code: 503 for https://ftp-osl.osuosl.org/pub/fedora-epel/9/Everything/x86_64/Packages/a/abseil-cpp-20211102.0-4.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-17T04:20:23.194 INFO:teuthology.orchestra.run.trial040.stdout:(59/96): grpc-data-1.46.7-10.el9.noarch.rpm 41 kB/s | 19 kB 00:00 2026-02-17T04:20:23.199 INFO:teuthology.orchestra.run.trial040.stdout:[MIRROR] abseil-cpp-20211102.0-4.el9.x86_64.rpm: Status code: 503 for http://ftp-osl.osuosl.org/pub/fedora-epel/9/Everything/x86_64/Packages/a/abseil-cpp-20211102.0-4.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-17T04:20:23.242 INFO:teuthology.orchestra.run.trial040.stdout:(60/96): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.0 MB/s | 551 kB 00:00 2026-02-17T04:20:23.276 INFO:teuthology.orchestra.run.trial040.stdout:[MIRROR] python3-asyncssh-2.13.2-5.el9.noarch.rpm: Status code: 503 for https://ftp-osl.osuosl.org/pub/fedora-epel/9/Everything/x86_64/Packages/p/python3-asyncssh-2.13.2-5.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-17T04:20:23.443 INFO:teuthology.orchestra.run.trial040.stdout:[MIRROR] python3-asyncssh-2.13.2-5.el9.noarch.rpm: Status code: 503 for http://ftp-osl.osuosl.org/pub/fedora-epel/9/Everything/x86_64/Packages/p/python3-asyncssh-2.13.2-5.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-17T04:20:23.453 INFO:teuthology.orchestra.run.trial040.stdout:(61/96): python3-asyncssh-2.13.2-5.el9.noarch.r 2.1 MB/s | 548 kB 00:00 2026-02-17T04:20:23.575 INFO:teuthology.orchestra.run.trial040.stdout:[MIRROR] python3-autocommand-2.2.2-8.el9.noarch.rpm: Status code: 503 for https://ftp-osl.osuosl.org/pub/fedora-epel/9/Everything/x86_64/Packages/p/python3-autocommand-2.2.2-8.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-17T04:20:23.618 INFO:teuthology.orchestra.run.trial040.stdout:[MIRROR] python3-backports-tarfile-1.2.0-1.el9.noarch.rpm: Status code: 503 for http://ftp-osl.osuosl.org/pub/fedora-epel/9/Everything/x86_64/Packages/p/python3-backports-tarfile-1.2.0-1.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-17T04:20:23.740 INFO:teuthology.orchestra.run.trial040.stdout:[MIRROR] python3-autocommand-2.2.2-8.el9.noarch.rpm: Status code: 503 for http://ftp-osl.osuosl.org/pub/fedora-epel/9/Everything/x86_64/Packages/p/python3-autocommand-2.2.2-8.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-17T04:20:23.744 INFO:teuthology.orchestra.run.trial040.stdout:(62/96): python3-autocommand-2.2.2-8.el9.noarch 59 kB/s | 29 kB 00:00 2026-02-17T04:20:23.759 INFO:teuthology.orchestra.run.trial040.stdout:(63/96): luarocks-3.9.2-5.el9.noarch.rpm 169 kB/s | 151 kB 00:00 2026-02-17T04:20:23.841 INFO:teuthology.orchestra.run.trial040.stdout:[MIRROR] python3-cachetools-4.2.4-1.el9.noarch.rpm: Status code: 503 for https://ftp-osl.osuosl.org/pub/fedora-epel/9/Everything/x86_64/Packages/p/python3-cachetools-4.2.4-1.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-17T04:20:23.846 INFO:teuthology.orchestra.run.trial040.stdout:(64/96): python3-cachetools-4.2.4-1.el9.noarch. 370 kB/s | 32 kB 00:00 2026-02-17T04:20:23.850 INFO:teuthology.orchestra.run.trial040.stdout:(65/96): python3-certifi-2023.05.07-4.el9.noarc 3.3 MB/s | 14 kB 00:00 2026-02-17T04:20:23.855 INFO:teuthology.orchestra.run.trial040.stdout:(66/96): python3-cheroot-10.0.1-4.el9.noarch.rp 34 MB/s | 173 kB 00:00 2026-02-17T04:20:23.861 INFO:teuthology.orchestra.run.trial040.stdout:(67/96): python3-cherrypy-18.6.1-2.el9.noarch.r 59 MB/s | 358 kB 00:00 2026-02-17T04:20:23.867 INFO:teuthology.orchestra.run.trial040.stdout:(68/96): python3-google-auth-2.45.0-1.el9.noarc 46 MB/s | 254 kB 00:00 2026-02-17T04:20:23.881 INFO:teuthology.orchestra.run.trial040.stdout:(69/96): python3-grpcio-1.46.7-10.el9.x86_64.rp 139 MB/s | 2.0 MB 00:00 2026-02-17T04:20:23.886 INFO:teuthology.orchestra.run.trial040.stdout:(70/96): python3-grpcio-tools-1.46.7-10.el9.x86 29 MB/s | 144 kB 00:00 2026-02-17T04:20:23.891 INFO:teuthology.orchestra.run.trial040.stdout:(71/96): python3-influxdb-5.3.1-1.el9.noarch.rp 28 MB/s | 139 kB 00:00 2026-02-17T04:20:23.896 INFO:teuthology.orchestra.run.trial040.stdout:(72/96): python3-isodate-0.6.1-3.el9.noarch.rpm 13 MB/s | 56 kB 00:00 2026-02-17T04:20:23.900 INFO:teuthology.orchestra.run.trial040.stdout:(73/96): python3-jaraco-8.2.1-3.el9.noarch.rpm 2.6 MB/s | 11 kB 00:00 2026-02-17T04:20:23.904 INFO:teuthology.orchestra.run.trial040.stdout:(74/96): python3-jaraco-classes-3.2.1-5.el9.noa 4.1 MB/s | 18 kB 00:00 2026-02-17T04:20:23.909 INFO:teuthology.orchestra.run.trial040.stdout:(75/96): python3-jaraco-collections-3.0.0-8.el9 5.4 MB/s | 23 kB 00:00 2026-02-17T04:20:23.913 INFO:teuthology.orchestra.run.trial040.stdout:(76/96): python3-jaraco-context-6.0.1-3.el9.noa 4.6 MB/s | 20 kB 00:00 2026-02-17T04:20:23.917 INFO:teuthology.orchestra.run.trial040.stdout:(77/96): python3-jaraco-functools-3.5.0-2.el9.n 4.6 MB/s | 19 kB 00:00 2026-02-17T04:20:23.921 INFO:teuthology.orchestra.run.trial040.stdout:(78/96): python3-jaraco-text-4.0.0-2.el9.noarch 6.3 MB/s | 26 kB 00:00 2026-02-17T04:20:23.930 INFO:teuthology.orchestra.run.trial040.stdout:(79/96): python3-kubernetes-26.1.0-3.el9.noarch 121 MB/s | 1.0 MB 00:00 2026-02-17T04:20:23.935 INFO:teuthology.orchestra.run.trial040.stdout:(80/96): python3-more-itertools-8.12.0-2.el9.no 17 MB/s | 79 kB 00:00 2026-02-17T04:20:23.939 INFO:teuthology.orchestra.run.trial040.stdout:(81/96): python3-msgpack-1.0.3-2.el9.x86_64.rpm 19 MB/s | 86 kB 00:00 2026-02-17T04:20:23.944 INFO:teuthology.orchestra.run.trial040.stdout:(82/96): python3-natsort-7.1.1-5.el9.noarch.rpm 13 MB/s | 58 kB 00:00 2026-02-17T04:20:23.948 INFO:teuthology.orchestra.run.trial040.stdout:(83/96): python3-portend-3.1.0-2.el9.noarch.rpm 4.0 MB/s | 16 kB 00:00 2026-02-17T04:20:23.952 INFO:teuthology.orchestra.run.trial040.stdout:[MIRROR] python3-backports-tarfile-1.2.0-1.el9.noarch.rpm: Status code: 503 for https://ftp-osl.osuosl.org/pub/fedora-epel/9/Everything/x86_64/Packages/p/python3-backports-tarfile-1.2.0-1.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-17T04:20:23.952 INFO:teuthology.orchestra.run.trial040.stdout:(84/96): python3-pyOpenSSL-21.0.0-1.el9.noarch. 20 MB/s | 90 kB 00:00 2026-02-17T04:20:23.959 INFO:teuthology.orchestra.run.trial040.stdout:(85/96): python3-repoze-lru-0.7-16.el9.noarch.r 4.9 MB/s | 31 kB 00:00 2026-02-17T04:20:23.963 INFO:teuthology.orchestra.run.trial040.stdout:(86/96): python3-routes-2.5.1-5.el9.noarch.rpm 39 MB/s | 188 kB 00:00 2026-02-17T04:20:23.968 INFO:teuthology.orchestra.run.trial040.stdout:(87/96): python3-rsa-4.9-2.el9.noarch.rpm 14 MB/s | 59 kB 00:00 2026-02-17T04:20:23.972 INFO:teuthology.orchestra.run.trial040.stdout:(88/96): python3-saml-1.16.0-1.el9.noarch.rpm 27 MB/s | 125 kB 00:00 2026-02-17T04:20:23.977 INFO:teuthology.orchestra.run.trial040.stdout:(89/96): python3-tempora-5.0.0-2.el9.noarch.rpm 8.6 MB/s | 36 kB 00:00 2026-02-17T04:20:23.978 INFO:teuthology.orchestra.run.trial040.stdout:(90/96): python3-backports-tarfile-1.2.0-1.el9. 114 kB/s | 60 kB 00:00 2026-02-17T04:20:23.981 INFO:teuthology.orchestra.run.trial040.stdout:(91/96): python3-typing-extensions-4.15.0-1.el9 19 MB/s | 86 kB 00:00 2026-02-17T04:20:23.985 INFO:teuthology.orchestra.run.trial040.stdout:(92/96): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 11 MB/s | 48 kB 00:00 2026-02-17T04:20:23.986 INFO:teuthology.orchestra.run.trial040.stdout:(93/96): python3-websocket-client-1.2.3-2.el9.n 11 MB/s | 90 kB 00:00 2026-02-17T04:20:23.990 INFO:teuthology.orchestra.run.trial040.stdout:(94/96): python3-xmltodict-0.12.0-15.el9.noarch 5.3 MB/s | 22 kB 00:00 2026-02-17T04:20:23.991 INFO:teuthology.orchestra.run.trial040.stdout:(95/96): python3-zc-lockfile-2.0-10.el9.noarch. 4.2 MB/s | 20 kB 00:00 2026-02-17T04:20:24.077 INFO:teuthology.orchestra.run.trial040.stdout:[MIRROR] python3-bcrypt-3.2.2-1.el9.x86_64.rpm: Status code: 503 for https://ftp-osl.osuosl.org/pub/fedora-epel/9/Everything/x86_64/Packages/p/python3-bcrypt-3.2.2-1.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-17T04:20:24.082 INFO:teuthology.orchestra.run.trial040.stdout:(96/96): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 129 kB/s | 43 kB 00:00 2026-02-17T04:20:24.085 INFO:teuthology.orchestra.run.trial040.stdout:-------------------------------------------------------------------------------- 2026-02-17T04:20:24.086 INFO:teuthology.orchestra.run.trial040.stdout:Total 46 MB/s | 158 MB 00:03 2026-02-17T04:20:24.520 INFO:teuthology.orchestra.run.trial040.stdout:Running transaction check 2026-02-17T04:20:24.559 INFO:teuthology.orchestra.run.trial040.stdout:Transaction check succeeded. 2026-02-17T04:20:24.559 INFO:teuthology.orchestra.run.trial040.stdout:Running transaction test 2026-02-17T04:20:25.160 INFO:teuthology.orchestra.run.trial040.stdout:Transaction test succeeded. 2026-02-17T04:20:25.160 INFO:teuthology.orchestra.run.trial040.stdout:Running transaction 2026-02-17T04:20:25.785 INFO:teuthology.orchestra.run.trial040.stdout: Preparing : 1/1 2026-02-17T04:20:25.786 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/96 2026-02-17T04:20:25.790 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/96 2026-02-17T04:20:25.811 INFO:teuthology.orchestra.run.trial040.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/96 2026-02-17T04:20:25.846 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 4/96 2026-02-17T04:20:25.853 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/96 2026-02-17T04:20:25.855 INFO:teuthology.orchestra.run.trial040.stdout: Installing : lua-5.4.4-4.el9.x86_64 6/96 2026-02-17T04:20:25.860 INFO:teuthology.orchestra.run.trial040.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 7/96 2026-02-17T04:20:25.883 INFO:teuthology.orchestra.run.trial040.stdout: Installing : unzip-6.0-59.el9.x86_64 8/96 2026-02-17T04:20:25.895 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 9/96 2026-02-17T04:20:25.898 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 10/96 2026-02-17T04:20:25.904 INFO:teuthology.orchestra.run.trial040.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 11/96 2026-02-17T04:20:25.906 INFO:teuthology.orchestra.run.trial040.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 12/96 2026-02-17T04:20:25.917 INFO:teuthology.orchestra.run.trial040.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 13/96 2026-02-17T04:20:25.923 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 14/96 2026-02-17T04:20:25.947 INFO:teuthology.orchestra.run.trial040.stdout: Installing : zip-3.0-35.el9.x86_64 15/96 2026-02-17T04:20:25.950 INFO:teuthology.orchestra.run.trial040.stdout: Installing : luarocks-3.9.2-5.el9.noarch 16/96 2026-02-17T04:20:26.000 INFO:teuthology.orchestra.run.trial040.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 17/96 2026-02-17T04:20:26.013 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 18/96 2026-02-17T04:20:26.015 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-rsa-4.9-2.el9.noarch 19/96 2026-02-17T04:20:26.020 INFO:teuthology.orchestra.run.trial040.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 20/96 2026-02-17T04:20:26.025 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 21/96 2026-02-17T04:20:26.029 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 22/96 2026-02-17T04:20:26.032 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 23/96 2026-02-17T04:20:26.047 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 24/96 2026-02-17T04:20:26.051 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 25/96 2026-02-17T04:20:26.056 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 26/96 2026-02-17T04:20:26.067 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 27/96 2026-02-17T04:20:26.076 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 28/96 2026-02-17T04:20:26.082 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 29/96 2026-02-17T04:20:26.102 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 30/96 2026-02-17T04:20:26.113 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 31/96 2026-02-17T04:20:26.128 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 32/96 2026-02-17T04:20:26.133 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 33/96 2026-02-17T04:20:26.140 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 34/96 2026-02-17T04:20:26.180 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 35/96 2026-02-17T04:20:26.502 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 36/96 2026-02-17T04:20:26.512 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 37/96 2026-02-17T04:20:26.516 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 38/96 2026-02-17T04:20:26.522 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 39/96 2026-02-17T04:20:26.524 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 40/96 2026-02-17T04:20:26.551 INFO:teuthology.orchestra.run.trial040.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 41/96 2026-02-17T04:20:26.594 INFO:teuthology.orchestra.run.trial040.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 42/96 2026-02-17T04:20:26.603 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 43/96 2026-02-17T04:20:26.608 INFO:teuthology.orchestra.run.trial040.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 44/96 2026-02-17T04:20:26.612 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 45/96 2026-02-17T04:20:26.617 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 46/96 2026-02-17T04:20:26.621 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 47/96 2026-02-17T04:20:26.628 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 48/96 2026-02-17T04:20:26.631 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 49/96 2026-02-17T04:20:26.659 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 50/96 2026-02-17T04:20:26.669 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 51/96 2026-02-17T04:20:26.675 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 52/96 2026-02-17T04:20:26.681 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 53/96 2026-02-17T04:20:26.716 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 54/96 2026-02-17T04:20:26.939 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 55/96 2026-02-17T04:20:26.962 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 56/96 2026-02-17T04:20:26.966 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 57/96 2026-02-17T04:20:27.024 INFO:teuthology.orchestra.run.trial040.stdout: Installing : openblas-0.3.29-1.el9.x86_64 58/96 2026-02-17T04:20:27.026 INFO:teuthology.orchestra.run.trial040.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 59/96 2026-02-17T04:20:27.047 INFO:teuthology.orchestra.run.trial040.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 60/96 2026-02-17T04:20:27.371 INFO:teuthology.orchestra.run.trial040.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 61/96 2026-02-17T04:20:27.443 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 62/96 2026-02-17T04:20:28.110 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 63/96 2026-02-17T04:20:28.126 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 64/96 2026-02-17T04:20:28.136 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 65/96 2026-02-17T04:20:28.143 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-packaging-20.9-5.el9.noarch 66/96 2026-02-17T04:20:28.156 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-ply-3.11-14.el9.noarch 67/96 2026-02-17T04:20:28.172 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 68/96 2026-02-17T04:20:28.247 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 69/96 2026-02-17T04:20:28.255 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 70/96 2026-02-17T04:20:28.279 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 71/96 2026-02-17T04:20:28.308 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 72/96 2026-02-17T04:20:28.358 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 73/96 2026-02-17T04:20:28.364 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 74/96 2026-02-17T04:20:28.368 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 75/96 2026-02-17T04:20:28.369 INFO:teuthology.orchestra.run.trial040.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 76/96 2026-02-17T04:20:28.388 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-17T04:20:28.388 INFO:teuthology.orchestra.run.trial040.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-17T04:20:28.388 INFO:teuthology.orchestra.run.trial040.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-17T04:20:28.388 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:28.397 INFO:teuthology.orchestra.run.trial040.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-17T04:20:28.424 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-17T04:20:28.424 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-17T04:20:28.424 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:28.459 INFO:teuthology.orchestra.run.trial040.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 78/96 2026-02-17T04:20:29.093 INFO:teuthology.orchestra.run.trial040.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 79/96 2026-02-17T04:20:29.868 INFO:teuthology.orchestra.run.trial040.stdout: Installing : ceph-osd-classic-2:20.3.0-5271.g32585015.el9.x86_6 80/96 2026-02-17T04:20:29.931 INFO:teuthology.orchestra.run.trial040.stdout: Installing : ceph-osd-crimson-2:20.3.0-5271.g32585015.el9.x86_6 81/96 2026-02-17T04:20:29.933 INFO:teuthology.orchestra.run.trial040.stdout: Installing : ceph-volume-2:20.3.0-5271.g32585015.el9.noarch 82/96 2026-02-17T04:20:29.948 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: ceph-volume-2:20.3.0-5271.g32585015.el9.noarch 82/96 2026-02-17T04:20:29.949 INFO:teuthology.orchestra.run.trial040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T04:20:29.949 INFO:teuthology.orchestra.run.trial040.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-17T04:20:29.949 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:29.959 INFO:teuthology.orchestra.run.trial040.stdout: Installing : ceph-osd-2:20.3.0-5271.g32585015.el9.x86_64 83/96 2026-02-17T04:20:29.983 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: ceph-osd-2:20.3.0-5271.g32585015.el9.x86_64 83/96 2026-02-17T04:20:29.983 INFO:teuthology.orchestra.run.trial040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T04:20:29.983 INFO:teuthology.orchestra.run.trial040.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-17T04:20:29.984 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T04:20:29.984 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T04:20:29.984 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:30.046 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: cephadm-2:20.3.0-5271.g32585015.el9.noarch 84/96 2026-02-17T04:20:30.048 INFO:teuthology.orchestra.run.trial040.stdout: Installing : cephadm-2:20.3.0-5271.g32585015.el9.noarch 84/96 2026-02-17T04:20:30.057 INFO:teuthology.orchestra.run.trial040.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5271.g32585015.el9 85/96 2026-02-17T04:20:30.081 INFO:teuthology.orchestra.run.trial040.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5271.g32585015.el 86/96 2026-02-17T04:20:30.082 INFO:teuthology.orchestra.run.trial040.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5271.g32585015.el9.noarc 87/96 2026-02-17T04:20:33.007 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5271.g32585015.el9.noarc 87/96 2026-02-17T04:20:33.014 INFO:teuthology.orchestra.run.trial040.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5271.g32585015.el9.noa 88/96 2026-02-17T04:20:33.476 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5271.g32585015.el9.noa 88/96 2026-02-17T04:20:33.477 INFO:teuthology.orchestra.run.trial040.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5271.g32585 89/96 2026-02-17T04:20:33.491 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5271.g32585 89/96 2026-02-17T04:20:33.492 INFO:teuthology.orchestra.run.trial040.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5271.g32585015.el9.noa 90/96 2026-02-17T04:20:33.555 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5271.g32585015.el9.noa 90/96 2026-02-17T04:20:33.598 INFO:teuthology.orchestra.run.trial040.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5271.g32585015.el9. 91/96 2026-02-17T04:20:33.599 INFO:teuthology.orchestra.run.trial040.stdout: Installing : ceph-mgr-2:20.3.0-5271.g32585015.el9.x86_64 92/96 2026-02-17T04:20:33.622 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5271.g32585015.el9.x86_64 92/96 2026-02-17T04:20:33.622 INFO:teuthology.orchestra.run.trial040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T04:20:33.622 INFO:teuthology.orchestra.run.trial040.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-17T04:20:33.622 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T04:20:33.622 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T04:20:33.622 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:33.634 INFO:teuthology.orchestra.run.trial040.stdout: Installing : ceph-mgr-rook-2:20.3.0-5271.g32585015.el9.noarch 93/96 2026-02-17T04:20:33.861 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5271.g32585015.el9.noarch 93/96 2026-02-17T04:20:33.867 INFO:teuthology.orchestra.run.trial040.stdout: Installing : ceph-mon-2:20.3.0-5271.g32585015.el9.x86_64 94/96 2026-02-17T04:20:33.883 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: ceph-mon-2:20.3.0-5271.g32585015.el9.x86_64 94/96 2026-02-17T04:20:33.883 INFO:teuthology.orchestra.run.trial040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T04:20:33.883 INFO:teuthology.orchestra.run.trial040.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-17T04:20:33.883 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T04:20:33.883 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T04:20:33.883 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:33.980 INFO:teuthology.orchestra.run.trial040.stdout: Installing : ceph-mds-2:20.3.0-5271.g32585015.el9.x86_64 95/96 2026-02-17T04:20:34.001 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: ceph-mds-2:20.3.0-5271.g32585015.el9.x86_64 95/96 2026-02-17T04:20:34.001 INFO:teuthology.orchestra.run.trial040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T04:20:34.001 INFO:teuthology.orchestra.run.trial040.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-17T04:20:34.001 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T04:20:34.001 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T04:20:34.001 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:34.002 INFO:teuthology.orchestra.run.trial040.stdout: Installing : ceph-2:20.3.0-5271.g32585015.el9.x86_64 96/96 2026-02-17T04:20:34.009 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5271.g32585015.el9.x86_6 96/96 2026-02-17T04:20:34.033 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5271.g32585015.el9.x86_6 96/96 2026-02-17T04:20:34.827 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: ceph-2:20.3.0-5271.g32585015.el9.x86_64 96/96 2026-02-17T04:20:34.827 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : ceph-2:20.3.0-5271.g32585015.el9.x86_64 1/96 2026-02-17T04:20:34.827 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : ceph-mds-2:20.3.0-5271.g32585015.el9.x86_64 2/96 2026-02-17T04:20:34.827 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : ceph-mgr-2:20.3.0-5271.g32585015.el9.x86_64 3/96 2026-02-17T04:20:34.827 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : ceph-mon-2:20.3.0-5271.g32585015.el9.x86_64 4/96 2026-02-17T04:20:34.827 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : ceph-osd-2:20.3.0-5271.g32585015.el9.x86_64 5/96 2026-02-17T04:20:34.827 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : ceph-osd-classic-2:20.3.0-5271.g32585015.el9.x86_6 6/96 2026-02-17T04:20:34.827 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5271.g32585015.el9.x86_6 7/96 2026-02-17T04:20:34.827 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5271.g32585015.el 8/96 2026-02-17T04:20:34.828 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5271.g32585015.el9.noarc 9/96 2026-02-17T04:20:34.828 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5271.g32585015.el9.noa 10/96 2026-02-17T04:20:34.828 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5271.g32585 11/96 2026-02-17T04:20:34.828 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : ceph-mgr-k8sevents-2:20.3.0-5271.g32585015.el9.noa 12/96 2026-02-17T04:20:34.828 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5271.g32585015.el9. 13/96 2026-02-17T04:20:34.828 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5271.g32585015.el9.noarch 14/96 2026-02-17T04:20:34.828 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5271.g32585015.el9 15/96 2026-02-17T04:20:34.828 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : ceph-volume-2:20.3.0-5271.g32585015.el9.noarch 16/96 2026-02-17T04:20:34.828 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : cephadm-2:20.3.0-5271.g32585015.el9.noarch 17/96 2026-02-17T04:20:34.828 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 18/96 2026-02-17T04:20:34.828 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 19/96 2026-02-17T04:20:34.828 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 20/96 2026-02-17T04:20:34.829 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 21/96 2026-02-17T04:20:34.829 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 22/96 2026-02-17T04:20:34.829 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 23/96 2026-02-17T04:20:34.829 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 24/96 2026-02-17T04:20:34.829 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-ply-3.11-14.el9.noarch 25/96 2026-02-17T04:20:34.829 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 26/96 2026-02-17T04:20:34.829 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 27/96 2026-02-17T04:20:34.829 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 28/96 2026-02-17T04:20:34.829 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 29/96 2026-02-17T04:20:34.829 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : unzip-6.0-59.el9.x86_64 30/96 2026-02-17T04:20:34.829 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : zip-3.0-35.el9.x86_64 31/96 2026-02-17T04:20:34.829 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 32/96 2026-02-17T04:20:34.829 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 33/96 2026-02-17T04:20:34.830 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 34/96 2026-02-17T04:20:34.830 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 35/96 2026-02-17T04:20:34.830 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : lua-5.4.4-4.el9.x86_64 36/96 2026-02-17T04:20:34.830 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 37/96 2026-02-17T04:20:34.830 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 38/96 2026-02-17T04:20:34.830 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 39/96 2026-02-17T04:20:34.830 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 40/96 2026-02-17T04:20:34.830 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 41/96 2026-02-17T04:20:34.830 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 42/96 2026-02-17T04:20:34.830 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 43/96 2026-02-17T04:20:34.830 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 44/96 2026-02-17T04:20:34.830 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 45/96 2026-02-17T04:20:34.830 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 46/96 2026-02-17T04:20:34.831 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 47/96 2026-02-17T04:20:34.831 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 48/96 2026-02-17T04:20:34.831 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 49/96 2026-02-17T04:20:34.831 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 50/96 2026-02-17T04:20:34.831 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 51/96 2026-02-17T04:20:34.831 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 52/96 2026-02-17T04:20:34.831 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 53/96 2026-02-17T04:20:34.831 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 54/96 2026-02-17T04:20:34.831 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 55/96 2026-02-17T04:20:34.831 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 56/96 2026-02-17T04:20:34.831 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 57/96 2026-02-17T04:20:34.831 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 58/96 2026-02-17T04:20:34.832 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 59/96 2026-02-17T04:20:34.832 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 60/96 2026-02-17T04:20:34.832 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 61/96 2026-02-17T04:20:34.832 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 62/96 2026-02-17T04:20:34.832 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 63/96 2026-02-17T04:20:34.832 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 64/96 2026-02-17T04:20:34.832 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 65/96 2026-02-17T04:20:34.832 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 66/96 2026-02-17T04:20:34.832 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 67/96 2026-02-17T04:20:34.832 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 68/96 2026-02-17T04:20:34.832 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 69/96 2026-02-17T04:20:34.832 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 70/96 2026-02-17T04:20:34.832 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 71/96 2026-02-17T04:20:34.833 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 72/96 2026-02-17T04:20:34.833 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 73/96 2026-02-17T04:20:34.833 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 74/96 2026-02-17T04:20:34.833 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 75/96 2026-02-17T04:20:34.833 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 76/96 2026-02-17T04:20:34.833 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 77/96 2026-02-17T04:20:34.833 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 78/96 2026-02-17T04:20:34.833 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 79/96 2026-02-17T04:20:34.833 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 80/96 2026-02-17T04:20:34.833 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 81/96 2026-02-17T04:20:34.833 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/96 2026-02-17T04:20:34.833 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/96 2026-02-17T04:20:34.833 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/96 2026-02-17T04:20:34.833 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/96 2026-02-17T04:20:34.834 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/96 2026-02-17T04:20:34.834 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/96 2026-02-17T04:20:34.834 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/96 2026-02-17T04:20:34.834 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/96 2026-02-17T04:20:34.834 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/96 2026-02-17T04:20:34.834 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/96 2026-02-17T04:20:34.834 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/96 2026-02-17T04:20:34.834 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 93/96 2026-02-17T04:20:34.834 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 94/96 2026-02-17T04:20:34.834 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 95/96 2026-02-17T04:20:34.891 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 96/96 2026-02-17T04:20:34.891 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:34.892 INFO:teuthology.orchestra.run.trial040.stdout:Installed: 2026-02-17T04:20:34.892 INFO:teuthology.orchestra.run.trial040.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-17T04:20:34.892 INFO:teuthology.orchestra.run.trial040.stdout: ceph-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:20:34.892 INFO:teuthology.orchestra.run.trial040.stdout: ceph-grafana-dashboards-2:20.3.0-5271.g32585015.el9.noarch 2026-02-17T04:20:34.892 INFO:teuthology.orchestra.run.trial040.stdout: ceph-mds-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:20:34.893 INFO:teuthology.orchestra.run.trial040.stdout: ceph-mgr-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:20:34.893 INFO:teuthology.orchestra.run.trial040.stdout: ceph-mgr-cephadm-2:20.3.0-5271.g32585015.el9.noarch 2026-02-17T04:20:34.893 INFO:teuthology.orchestra.run.trial040.stdout: ceph-mgr-dashboard-2:20.3.0-5271.g32585015.el9.noarch 2026-02-17T04:20:34.893 INFO:teuthology.orchestra.run.trial040.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5271.g32585015.el9.noarch 2026-02-17T04:20:34.893 INFO:teuthology.orchestra.run.trial040.stdout: ceph-mgr-k8sevents-2:20.3.0-5271.g32585015.el9.noarch 2026-02-17T04:20:34.893 INFO:teuthology.orchestra.run.trial040.stdout: ceph-mgr-modules-core-2:20.3.0-5271.g32585015.el9.noarch 2026-02-17T04:20:34.894 INFO:teuthology.orchestra.run.trial040.stdout: ceph-mgr-rook-2:20.3.0-5271.g32585015.el9.noarch 2026-02-17T04:20:34.894 INFO:teuthology.orchestra.run.trial040.stdout: ceph-mon-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:20:34.894 INFO:teuthology.orchestra.run.trial040.stdout: ceph-osd-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:20:34.894 INFO:teuthology.orchestra.run.trial040.stdout: ceph-osd-classic-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:20:34.894 INFO:teuthology.orchestra.run.trial040.stdout: ceph-osd-crimson-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:20:34.894 INFO:teuthology.orchestra.run.trial040.stdout: ceph-prometheus-alerts-2:20.3.0-5271.g32585015.el9.noarch 2026-02-17T04:20:34.894 INFO:teuthology.orchestra.run.trial040.stdout: ceph-volume-2:20.3.0-5271.g32585015.el9.noarch 2026-02-17T04:20:34.895 INFO:teuthology.orchestra.run.trial040.stdout: cephadm-2:20.3.0-5271.g32585015.el9.noarch 2026-02-17T04:20:34.895 INFO:teuthology.orchestra.run.trial040.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-17T04:20:34.895 INFO:teuthology.orchestra.run.trial040.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-17T04:20:34.895 INFO:teuthology.orchestra.run.trial040.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-17T04:20:34.895 INFO:teuthology.orchestra.run.trial040.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-17T04:20:34.895 INFO:teuthology.orchestra.run.trial040.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-17T04:20:34.896 INFO:teuthology.orchestra.run.trial040.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-17T04:20:34.896 INFO:teuthology.orchestra.run.trial040.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-17T04:20:34.896 INFO:teuthology.orchestra.run.trial040.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-17T04:20:34.896 INFO:teuthology.orchestra.run.trial040.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-17T04:20:34.896 INFO:teuthology.orchestra.run.trial040.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T04:20:34.896 INFO:teuthology.orchestra.run.trial040.stdout: lua-5.4.4-4.el9.x86_64 2026-02-17T04:20:34.896 INFO:teuthology.orchestra.run.trial040.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-17T04:20:34.896 INFO:teuthology.orchestra.run.trial040.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-17T04:20:34.897 INFO:teuthology.orchestra.run.trial040.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-17T04:20:34.897 INFO:teuthology.orchestra.run.trial040.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-17T04:20:34.897 INFO:teuthology.orchestra.run.trial040.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-17T04:20:34.897 INFO:teuthology.orchestra.run.trial040.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-17T04:20:34.897 INFO:teuthology.orchestra.run.trial040.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-17T04:20:34.897 INFO:teuthology.orchestra.run.trial040.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-17T04:20:34.897 INFO:teuthology.orchestra.run.trial040.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-17T04:20:34.898 INFO:teuthology.orchestra.run.trial040.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-17T04:20:34.898 INFO:teuthology.orchestra.run.trial040.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-17T04:20:34.898 INFO:teuthology.orchestra.run.trial040.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-17T04:20:34.898 INFO:teuthology.orchestra.run.trial040.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-17T04:20:34.898 INFO:teuthology.orchestra.run.trial040.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-17T04:20:34.898 INFO:teuthology.orchestra.run.trial040.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-17T04:20:34.899 INFO:teuthology.orchestra.run.trial040.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-17T04:20:34.899 INFO:teuthology.orchestra.run.trial040.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-17T04:20:34.899 INFO:teuthology.orchestra.run.trial040.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-17T04:20:34.899 INFO:teuthology.orchestra.run.trial040.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-17T04:20:34.899 INFO:teuthology.orchestra.run.trial040.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-17T04:20:34.899 INFO:teuthology.orchestra.run.trial040.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-17T04:20:34.899 INFO:teuthology.orchestra.run.trial040.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-17T04:20:34.899 INFO:teuthology.orchestra.run.trial040.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-17T04:20:34.900 INFO:teuthology.orchestra.run.trial040.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-17T04:20:34.900 INFO:teuthology.orchestra.run.trial040.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-17T04:20:34.900 INFO:teuthology.orchestra.run.trial040.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-17T04:20:34.900 INFO:teuthology.orchestra.run.trial040.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-17T04:20:34.900 INFO:teuthology.orchestra.run.trial040.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-17T04:20:34.900 INFO:teuthology.orchestra.run.trial040.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-17T04:20:34.900 INFO:teuthology.orchestra.run.trial040.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-17T04:20:34.900 INFO:teuthology.orchestra.run.trial040.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-17T04:20:34.900 INFO:teuthology.orchestra.run.trial040.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T04:20:34.900 INFO:teuthology.orchestra.run.trial040.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-17T04:20:34.900 INFO:teuthology.orchestra.run.trial040.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-17T04:20:34.900 INFO:teuthology.orchestra.run.trial040.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-17T04:20:34.901 INFO:teuthology.orchestra.run.trial040.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-17T04:20:34.901 INFO:teuthology.orchestra.run.trial040.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-17T04:20:34.901 INFO:teuthology.orchestra.run.trial040.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-17T04:20:34.901 INFO:teuthology.orchestra.run.trial040.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-17T04:20:34.901 INFO:teuthology.orchestra.run.trial040.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-17T04:20:34.901 INFO:teuthology.orchestra.run.trial040.stdout: python3-ply-3.11-14.el9.noarch 2026-02-17T04:20:34.901 INFO:teuthology.orchestra.run.trial040.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-17T04:20:34.901 INFO:teuthology.orchestra.run.trial040.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-17T04:20:34.901 INFO:teuthology.orchestra.run.trial040.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-17T04:20:34.901 INFO:teuthology.orchestra.run.trial040.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-17T04:20:34.901 INFO:teuthology.orchestra.run.trial040.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-17T04:20:34.901 INFO:teuthology.orchestra.run.trial040.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-17T04:20:34.901 INFO:teuthology.orchestra.run.trial040.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-17T04:20:34.902 INFO:teuthology.orchestra.run.trial040.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-17T04:20:34.902 INFO:teuthology.orchestra.run.trial040.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-17T04:20:34.902 INFO:teuthology.orchestra.run.trial040.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-17T04:20:34.902 INFO:teuthology.orchestra.run.trial040.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-17T04:20:34.902 INFO:teuthology.orchestra.run.trial040.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-17T04:20:34.902 INFO:teuthology.orchestra.run.trial040.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-17T04:20:34.902 INFO:teuthology.orchestra.run.trial040.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-17T04:20:34.902 INFO:teuthology.orchestra.run.trial040.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-17T04:20:34.902 INFO:teuthology.orchestra.run.trial040.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-17T04:20:34.902 INFO:teuthology.orchestra.run.trial040.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-17T04:20:34.902 INFO:teuthology.orchestra.run.trial040.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-17T04:20:34.902 INFO:teuthology.orchestra.run.trial040.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-17T04:20:34.902 INFO:teuthology.orchestra.run.trial040.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-17T04:20:34.903 INFO:teuthology.orchestra.run.trial040.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-17T04:20:34.903 INFO:teuthology.orchestra.run.trial040.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-17T04:20:34.903 INFO:teuthology.orchestra.run.trial040.stdout: unzip-6.0-59.el9.x86_64 2026-02-17T04:20:34.903 INFO:teuthology.orchestra.run.trial040.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-17T04:20:34.903 INFO:teuthology.orchestra.run.trial040.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-17T04:20:34.903 INFO:teuthology.orchestra.run.trial040.stdout: zip-3.0-35.el9.x86_64 2026-02-17T04:20:34.903 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:34.903 INFO:teuthology.orchestra.run.trial040.stdout:Complete! 2026-02-17T04:20:34.954 DEBUG:teuthology.orchestra.run.trial040:> sudo yum -y install ceph-base 2026-02-17T04:20:35.265 INFO:teuthology.orchestra.run.trial040.stdout:Last metadata expiration check: 0:00:42 ago on Tue 17 Feb 2026 04:19:53 AM UTC. 2026-02-17T04:20:35.329 INFO:teuthology.orchestra.run.trial040.stdout:Package ceph-base-2:20.3.0-5271.g32585015.el9.x86_64 is already installed. 2026-02-17T04:20:35.347 INFO:teuthology.orchestra.run.trial040.stdout:Dependencies resolved. 2026-02-17T04:20:35.348 INFO:teuthology.orchestra.run.trial040.stdout:Nothing to do. 2026-02-17T04:20:35.348 INFO:teuthology.orchestra.run.trial040.stdout:Complete! 2026-02-17T04:20:35.369 DEBUG:teuthology.orchestra.run.trial040:> sudo yum -y install cephadm 2026-02-17T04:20:35.682 INFO:teuthology.orchestra.run.trial040.stdout:Last metadata expiration check: 0:00:42 ago on Tue 17 Feb 2026 04:19:53 AM UTC. 2026-02-17T04:20:35.746 INFO:teuthology.orchestra.run.trial040.stdout:Package cephadm-2:20.3.0-5271.g32585015.el9.noarch is already installed. 2026-02-17T04:20:35.764 INFO:teuthology.orchestra.run.trial040.stdout:Dependencies resolved. 2026-02-17T04:20:35.764 INFO:teuthology.orchestra.run.trial040.stdout:Nothing to do. 2026-02-17T04:20:35.764 INFO:teuthology.orchestra.run.trial040.stdout:Complete! 2026-02-17T04:20:35.786 DEBUG:teuthology.orchestra.run.trial040:> sudo yum -y install ceph-immutable-object-cache 2026-02-17T04:20:36.091 INFO:teuthology.orchestra.run.trial040.stdout:Last metadata expiration check: 0:00:43 ago on Tue 17 Feb 2026 04:19:53 AM UTC. 2026-02-17T04:20:36.172 INFO:teuthology.orchestra.run.trial040.stdout:Dependencies resolved. 2026-02-17T04:20:36.173 INFO:teuthology.orchestra.run.trial040.stdout:================================================================================ 2026-02-17T04:20:36.173 INFO:teuthology.orchestra.run.trial040.stdout: Package Arch Version Repo Size 2026-02-17T04:20:36.173 INFO:teuthology.orchestra.run.trial040.stdout:================================================================================ 2026-02-17T04:20:36.173 INFO:teuthology.orchestra.run.trial040.stdout:Installing: 2026-02-17T04:20:36.173 INFO:teuthology.orchestra.run.trial040.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5271.g32585015.el9 ceph 147 k 2026-02-17T04:20:36.173 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:36.173 INFO:teuthology.orchestra.run.trial040.stdout:Transaction Summary 2026-02-17T04:20:36.173 INFO:teuthology.orchestra.run.trial040.stdout:================================================================================ 2026-02-17T04:20:36.173 INFO:teuthology.orchestra.run.trial040.stdout:Install 1 Package 2026-02-17T04:20:36.173 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:36.173 INFO:teuthology.orchestra.run.trial040.stdout:Total download size: 147 k 2026-02-17T04:20:36.173 INFO:teuthology.orchestra.run.trial040.stdout:Installed size: 419 k 2026-02-17T04:20:36.173 INFO:teuthology.orchestra.run.trial040.stdout:Downloading Packages: 2026-02-17T04:20:36.261 INFO:teuthology.orchestra.run.trial040.stdout:ceph-immutable-object-cache-20.3.0-5271.g325850 1.7 MB/s | 147 kB 00:00 2026-02-17T04:20:36.262 INFO:teuthology.orchestra.run.trial040.stdout:-------------------------------------------------------------------------------- 2026-02-17T04:20:36.262 INFO:teuthology.orchestra.run.trial040.stdout:Total 1.6 MB/s | 147 kB 00:00 2026-02-17T04:20:36.262 INFO:teuthology.orchestra.run.trial040.stdout:Running transaction check 2026-02-17T04:20:36.266 INFO:teuthology.orchestra.run.trial040.stdout:Transaction check succeeded. 2026-02-17T04:20:36.266 INFO:teuthology.orchestra.run.trial040.stdout:Running transaction test 2026-02-17T04:20:36.298 INFO:teuthology.orchestra.run.trial040.stdout:Transaction test succeeded. 2026-02-17T04:20:36.298 INFO:teuthology.orchestra.run.trial040.stdout:Running transaction 2026-02-17T04:20:36.355 INFO:teuthology.orchestra.run.trial040.stdout: Preparing : 1/1 2026-02-17T04:20:36.357 INFO:teuthology.orchestra.run.trial040.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5271.g32585015. 1/1 2026-02-17T04:20:36.379 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5271.g32585015. 1/1 2026-02-17T04:20:36.379 INFO:teuthology.orchestra.run.trial040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T04:20:36.379 INFO:teuthology.orchestra.run.trial040.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-17T04:20:36.380 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:36.655 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5271.g32585015. 1/1 2026-02-17T04:20:36.655 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:36.656 INFO:teuthology.orchestra.run.trial040.stdout:Installed: 2026-02-17T04:20:36.656 INFO:teuthology.orchestra.run.trial040.stdout: ceph-immutable-object-cache-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:20:36.656 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:36.656 INFO:teuthology.orchestra.run.trial040.stdout:Complete! 2026-02-17T04:20:36.683 DEBUG:teuthology.orchestra.run.trial040:> sudo yum -y install ceph-mgr 2026-02-17T04:20:36.998 INFO:teuthology.orchestra.run.trial040.stdout:Last metadata expiration check: 0:00:43 ago on Tue 17 Feb 2026 04:19:53 AM UTC. 2026-02-17T04:20:37.061 INFO:teuthology.orchestra.run.trial040.stdout:Package ceph-mgr-2:20.3.0-5271.g32585015.el9.x86_64 is already installed. 2026-02-17T04:20:37.079 INFO:teuthology.orchestra.run.trial040.stdout:Dependencies resolved. 2026-02-17T04:20:37.079 INFO:teuthology.orchestra.run.trial040.stdout:Nothing to do. 2026-02-17T04:20:37.080 INFO:teuthology.orchestra.run.trial040.stdout:Complete! 2026-02-17T04:20:37.100 DEBUG:teuthology.orchestra.run.trial040:> sudo yum -y install ceph-mgr-dashboard 2026-02-17T04:20:37.410 INFO:teuthology.orchestra.run.trial040.stdout:Last metadata expiration check: 0:00:44 ago on Tue 17 Feb 2026 04:19:53 AM UTC. 2026-02-17T04:20:37.473 INFO:teuthology.orchestra.run.trial040.stdout:Package ceph-mgr-dashboard-2:20.3.0-5271.g32585015.el9.noarch is already installed. 2026-02-17T04:20:37.491 INFO:teuthology.orchestra.run.trial040.stdout:Dependencies resolved. 2026-02-17T04:20:37.491 INFO:teuthology.orchestra.run.trial040.stdout:Nothing to do. 2026-02-17T04:20:37.491 INFO:teuthology.orchestra.run.trial040.stdout:Complete! 2026-02-17T04:20:37.513 DEBUG:teuthology.orchestra.run.trial040:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-17T04:20:37.825 INFO:teuthology.orchestra.run.trial040.stdout:Last metadata expiration check: 0:00:44 ago on Tue 17 Feb 2026 04:19:53 AM UTC. 2026-02-17T04:20:37.890 INFO:teuthology.orchestra.run.trial040.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5271.g32585015.el9.noarch is already installed. 2026-02-17T04:20:37.907 INFO:teuthology.orchestra.run.trial040.stdout:Dependencies resolved. 2026-02-17T04:20:37.908 INFO:teuthology.orchestra.run.trial040.stdout:Nothing to do. 2026-02-17T04:20:37.908 INFO:teuthology.orchestra.run.trial040.stdout:Complete! 2026-02-17T04:20:37.929 DEBUG:teuthology.orchestra.run.trial040:> sudo yum -y install ceph-mgr-rook 2026-02-17T04:20:38.244 INFO:teuthology.orchestra.run.trial040.stdout:Last metadata expiration check: 0:00:45 ago on Tue 17 Feb 2026 04:19:53 AM UTC. 2026-02-17T04:20:38.308 INFO:teuthology.orchestra.run.trial040.stdout:Package ceph-mgr-rook-2:20.3.0-5271.g32585015.el9.noarch is already installed. 2026-02-17T04:20:38.326 INFO:teuthology.orchestra.run.trial040.stdout:Dependencies resolved. 2026-02-17T04:20:38.327 INFO:teuthology.orchestra.run.trial040.stdout:Nothing to do. 2026-02-17T04:20:38.327 INFO:teuthology.orchestra.run.trial040.stdout:Complete! 2026-02-17T04:20:38.349 DEBUG:teuthology.orchestra.run.trial040:> sudo yum -y install ceph-mgr-cephadm 2026-02-17T04:20:38.659 INFO:teuthology.orchestra.run.trial040.stdout:Last metadata expiration check: 0:00:45 ago on Tue 17 Feb 2026 04:19:53 AM UTC. 2026-02-17T04:20:38.724 INFO:teuthology.orchestra.run.trial040.stdout:Package ceph-mgr-cephadm-2:20.3.0-5271.g32585015.el9.noarch is already installed. 2026-02-17T04:20:38.741 INFO:teuthology.orchestra.run.trial040.stdout:Dependencies resolved. 2026-02-17T04:20:38.742 INFO:teuthology.orchestra.run.trial040.stdout:Nothing to do. 2026-02-17T04:20:38.742 INFO:teuthology.orchestra.run.trial040.stdout:Complete! 2026-02-17T04:20:38.763 DEBUG:teuthology.orchestra.run.trial040:> sudo yum -y install ceph-osd 2026-02-17T04:20:39.077 INFO:teuthology.orchestra.run.trial040.stdout:Last metadata expiration check: 0:00:46 ago on Tue 17 Feb 2026 04:19:53 AM UTC. 2026-02-17T04:20:39.142 INFO:teuthology.orchestra.run.trial040.stdout:Package ceph-osd-2:20.3.0-5271.g32585015.el9.x86_64 is already installed. 2026-02-17T04:20:39.159 INFO:teuthology.orchestra.run.trial040.stdout:Dependencies resolved. 2026-02-17T04:20:39.159 INFO:teuthology.orchestra.run.trial040.stdout:Nothing to do. 2026-02-17T04:20:39.159 INFO:teuthology.orchestra.run.trial040.stdout:Complete! 2026-02-17T04:20:39.181 DEBUG:teuthology.orchestra.run.trial040:> sudo yum -y install ceph-osd-classic 2026-02-17T04:20:39.489 INFO:teuthology.orchestra.run.trial040.stdout:Last metadata expiration check: 0:00:46 ago on Tue 17 Feb 2026 04:19:53 AM UTC. 2026-02-17T04:20:39.554 INFO:teuthology.orchestra.run.trial040.stdout:Package ceph-osd-classic-2:20.3.0-5271.g32585015.el9.x86_64 is already installed. 2026-02-17T04:20:39.571 INFO:teuthology.orchestra.run.trial040.stdout:Dependencies resolved. 2026-02-17T04:20:39.571 INFO:teuthology.orchestra.run.trial040.stdout:Nothing to do. 2026-02-17T04:20:39.572 INFO:teuthology.orchestra.run.trial040.stdout:Complete! 2026-02-17T04:20:39.593 DEBUG:teuthology.orchestra.run.trial040:> sudo yum -y install ceph-fuse 2026-02-17T04:20:39.907 INFO:teuthology.orchestra.run.trial040.stdout:Last metadata expiration check: 0:00:46 ago on Tue 17 Feb 2026 04:19:53 AM UTC. 2026-02-17T04:20:39.989 INFO:teuthology.orchestra.run.trial040.stdout:Dependencies resolved. 2026-02-17T04:20:39.989 INFO:teuthology.orchestra.run.trial040.stdout:================================================================================ 2026-02-17T04:20:39.989 INFO:teuthology.orchestra.run.trial040.stdout: Package Arch Version Repo Size 2026-02-17T04:20:39.989 INFO:teuthology.orchestra.run.trial040.stdout:================================================================================ 2026-02-17T04:20:39.989 INFO:teuthology.orchestra.run.trial040.stdout:Installing: 2026-02-17T04:20:39.989 INFO:teuthology.orchestra.run.trial040.stdout: ceph-fuse x86_64 2:20.3.0-5271.g32585015.el9 ceph 987 k 2026-02-17T04:20:39.990 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:39.990 INFO:teuthology.orchestra.run.trial040.stdout:Transaction Summary 2026-02-17T04:20:39.990 INFO:teuthology.orchestra.run.trial040.stdout:================================================================================ 2026-02-17T04:20:39.990 INFO:teuthology.orchestra.run.trial040.stdout:Install 1 Package 2026-02-17T04:20:39.990 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:39.990 INFO:teuthology.orchestra.run.trial040.stdout:Total download size: 987 k 2026-02-17T04:20:39.990 INFO:teuthology.orchestra.run.trial040.stdout:Installed size: 2.9 M 2026-02-17T04:20:39.990 INFO:teuthology.orchestra.run.trial040.stdout:Downloading Packages: 2026-02-17T04:20:40.113 INFO:teuthology.orchestra.run.trial040.stdout:ceph-fuse-20.3.0-5271.g32585015.el9.x86_64.rpm 7.9 MB/s | 987 kB 00:00 2026-02-17T04:20:40.113 INFO:teuthology.orchestra.run.trial040.stdout:-------------------------------------------------------------------------------- 2026-02-17T04:20:40.114 INFO:teuthology.orchestra.run.trial040.stdout:Total 7.8 MB/s | 987 kB 00:00 2026-02-17T04:20:40.114 INFO:teuthology.orchestra.run.trial040.stdout:Running transaction check 2026-02-17T04:20:40.118 INFO:teuthology.orchestra.run.trial040.stdout:Transaction check succeeded. 2026-02-17T04:20:40.118 INFO:teuthology.orchestra.run.trial040.stdout:Running transaction test 2026-02-17T04:20:40.155 INFO:teuthology.orchestra.run.trial040.stdout:Transaction test succeeded. 2026-02-17T04:20:40.155 INFO:teuthology.orchestra.run.trial040.stdout:Running transaction 2026-02-17T04:20:40.248 INFO:teuthology.orchestra.run.trial040.stdout: Preparing : 1/1 2026-02-17T04:20:40.265 INFO:teuthology.orchestra.run.trial040.stdout: Installing : ceph-fuse-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T04:20:40.514 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: ceph-fuse-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T04:20:40.571 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : ceph-fuse-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T04:20:40.571 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:40.571 INFO:teuthology.orchestra.run.trial040.stdout:Installed: 2026-02-17T04:20:40.571 INFO:teuthology.orchestra.run.trial040.stdout: ceph-fuse-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:20:40.571 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:40.572 INFO:teuthology.orchestra.run.trial040.stdout:Complete! 2026-02-17T04:20:40.598 DEBUG:teuthology.orchestra.run.trial040:> sudo yum -y install ceph-volume 2026-02-17T04:20:40.914 INFO:teuthology.orchestra.run.trial040.stdout:Last metadata expiration check: 0:00:47 ago on Tue 17 Feb 2026 04:19:53 AM UTC. 2026-02-17T04:20:40.979 INFO:teuthology.orchestra.run.trial040.stdout:Package ceph-volume-2:20.3.0-5271.g32585015.el9.noarch is already installed. 2026-02-17T04:20:40.997 INFO:teuthology.orchestra.run.trial040.stdout:Dependencies resolved. 2026-02-17T04:20:40.998 INFO:teuthology.orchestra.run.trial040.stdout:Nothing to do. 2026-02-17T04:20:40.998 INFO:teuthology.orchestra.run.trial040.stdout:Complete! 2026-02-17T04:20:41.020 DEBUG:teuthology.orchestra.run.trial040:> sudo yum -y install librados-devel 2026-02-17T04:20:41.329 INFO:teuthology.orchestra.run.trial040.stdout:Last metadata expiration check: 0:00:48 ago on Tue 17 Feb 2026 04:19:53 AM UTC. 2026-02-17T04:20:41.410 INFO:teuthology.orchestra.run.trial040.stdout:Dependencies resolved. 2026-02-17T04:20:41.411 INFO:teuthology.orchestra.run.trial040.stdout:================================================================================ 2026-02-17T04:20:41.411 INFO:teuthology.orchestra.run.trial040.stdout: Package Arch Version Repo Size 2026-02-17T04:20:41.411 INFO:teuthology.orchestra.run.trial040.stdout:================================================================================ 2026-02-17T04:20:41.411 INFO:teuthology.orchestra.run.trial040.stdout:Installing: 2026-02-17T04:20:41.411 INFO:teuthology.orchestra.run.trial040.stdout: librados-devel x86_64 2:20.3.0-5271.g32585015.el9 ceph 123 k 2026-02-17T04:20:41.411 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:41.411 INFO:teuthology.orchestra.run.trial040.stdout:Transaction Summary 2026-02-17T04:20:41.411 INFO:teuthology.orchestra.run.trial040.stdout:================================================================================ 2026-02-17T04:20:41.411 INFO:teuthology.orchestra.run.trial040.stdout:Install 1 Package 2026-02-17T04:20:41.411 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:41.411 INFO:teuthology.orchestra.run.trial040.stdout:Total download size: 123 k 2026-02-17T04:20:41.411 INFO:teuthology.orchestra.run.trial040.stdout:Installed size: 437 k 2026-02-17T04:20:41.411 INFO:teuthology.orchestra.run.trial040.stdout:Downloading Packages: 2026-02-17T04:20:41.499 INFO:teuthology.orchestra.run.trial040.stdout:librados-devel-20.3.0-5271.g32585015.el9.x86_64 1.4 MB/s | 123 kB 00:00 2026-02-17T04:20:41.499 INFO:teuthology.orchestra.run.trial040.stdout:-------------------------------------------------------------------------------- 2026-02-17T04:20:41.499 INFO:teuthology.orchestra.run.trial040.stdout:Total 1.4 MB/s | 123 kB 00:00 2026-02-17T04:20:41.499 INFO:teuthology.orchestra.run.trial040.stdout:Running transaction check 2026-02-17T04:20:41.502 INFO:teuthology.orchestra.run.trial040.stdout:Transaction check succeeded. 2026-02-17T04:20:41.502 INFO:teuthology.orchestra.run.trial040.stdout:Running transaction test 2026-02-17T04:20:41.533 INFO:teuthology.orchestra.run.trial040.stdout:Transaction test succeeded. 2026-02-17T04:20:41.534 INFO:teuthology.orchestra.run.trial040.stdout:Running transaction 2026-02-17T04:20:41.588 INFO:teuthology.orchestra.run.trial040.stdout: Preparing : 1/1 2026-02-17T04:20:41.604 INFO:teuthology.orchestra.run.trial040.stdout: Installing : librados-devel-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T04:20:41.694 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: librados-devel-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T04:20:41.751 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : librados-devel-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T04:20:41.751 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:41.751 INFO:teuthology.orchestra.run.trial040.stdout:Installed: 2026-02-17T04:20:41.751 INFO:teuthology.orchestra.run.trial040.stdout: librados-devel-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:20:41.751 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:41.751 INFO:teuthology.orchestra.run.trial040.stdout:Complete! 2026-02-17T04:20:41.779 DEBUG:teuthology.orchestra.run.trial040:> sudo yum -y install libcephfs2 2026-02-17T04:20:42.090 INFO:teuthology.orchestra.run.trial040.stdout:Last metadata expiration check: 0:00:49 ago on Tue 17 Feb 2026 04:19:53 AM UTC. 2026-02-17T04:20:42.155 INFO:teuthology.orchestra.run.trial040.stdout:Package libcephfs2-2:20.3.0-5271.g32585015.el9.x86_64 is already installed. 2026-02-17T04:20:42.172 INFO:teuthology.orchestra.run.trial040.stdout:Dependencies resolved. 2026-02-17T04:20:42.173 INFO:teuthology.orchestra.run.trial040.stdout:Nothing to do. 2026-02-17T04:20:42.173 INFO:teuthology.orchestra.run.trial040.stdout:Complete! 2026-02-17T04:20:42.195 DEBUG:teuthology.orchestra.run.trial040:> sudo yum -y install libcephfs-devel 2026-02-17T04:20:42.501 INFO:teuthology.orchestra.run.trial040.stdout:Last metadata expiration check: 0:00:49 ago on Tue 17 Feb 2026 04:19:53 AM UTC. 2026-02-17T04:20:42.583 INFO:teuthology.orchestra.run.trial040.stdout:Dependencies resolved. 2026-02-17T04:20:42.583 INFO:teuthology.orchestra.run.trial040.stdout:================================================================================ 2026-02-17T04:20:42.583 INFO:teuthology.orchestra.run.trial040.stdout: Package Arch Version Repo Size 2026-02-17T04:20:42.583 INFO:teuthology.orchestra.run.trial040.stdout:================================================================================ 2026-02-17T04:20:42.584 INFO:teuthology.orchestra.run.trial040.stdout:Installing: 2026-02-17T04:20:42.584 INFO:teuthology.orchestra.run.trial040.stdout: libcephfs-devel x86_64 2:20.3.0-5271.g32585015.el9 ceph 37 k 2026-02-17T04:20:42.584 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:42.584 INFO:teuthology.orchestra.run.trial040.stdout:Transaction Summary 2026-02-17T04:20:42.584 INFO:teuthology.orchestra.run.trial040.stdout:================================================================================ 2026-02-17T04:20:42.584 INFO:teuthology.orchestra.run.trial040.stdout:Install 1 Package 2026-02-17T04:20:42.584 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:42.584 INFO:teuthology.orchestra.run.trial040.stdout:Total download size: 37 k 2026-02-17T04:20:42.584 INFO:teuthology.orchestra.run.trial040.stdout:Installed size: 171 k 2026-02-17T04:20:42.584 INFO:teuthology.orchestra.run.trial040.stdout:Downloading Packages: 2026-02-17T04:20:42.647 INFO:teuthology.orchestra.run.trial040.stdout:libcephfs-devel-20.3.0-5271.g32585015.el9.x86_6 586 kB/s | 37 kB 00:00 2026-02-17T04:20:42.647 INFO:teuthology.orchestra.run.trial040.stdout:-------------------------------------------------------------------------------- 2026-02-17T04:20:42.648 INFO:teuthology.orchestra.run.trial040.stdout:Total 575 kB/s | 37 kB 00:00 2026-02-17T04:20:42.648 INFO:teuthology.orchestra.run.trial040.stdout:Running transaction check 2026-02-17T04:20:42.650 INFO:teuthology.orchestra.run.trial040.stdout:Transaction check succeeded. 2026-02-17T04:20:42.650 INFO:teuthology.orchestra.run.trial040.stdout:Running transaction test 2026-02-17T04:20:42.652 INFO:teuthology.orchestra.run.trial040.stdout:Transaction test succeeded. 2026-02-17T04:20:42.653 INFO:teuthology.orchestra.run.trial040.stdout:Running transaction 2026-02-17T04:20:42.674 INFO:teuthology.orchestra.run.trial040.stdout: Preparing : 1/1 2026-02-17T04:20:42.690 INFO:teuthology.orchestra.run.trial040.stdout: Installing : libcephfs-devel-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T04:20:42.750 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: libcephfs-devel-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T04:20:42.808 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : libcephfs-devel-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T04:20:42.808 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:42.808 INFO:teuthology.orchestra.run.trial040.stdout:Installed: 2026-02-17T04:20:42.808 INFO:teuthology.orchestra.run.trial040.stdout: libcephfs-devel-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:20:42.809 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:42.809 INFO:teuthology.orchestra.run.trial040.stdout:Complete! 2026-02-17T04:20:42.834 DEBUG:teuthology.orchestra.run.trial040:> sudo yum -y install librados2 2026-02-17T04:20:43.143 INFO:teuthology.orchestra.run.trial040.stdout:Last metadata expiration check: 0:00:50 ago on Tue 17 Feb 2026 04:19:53 AM UTC. 2026-02-17T04:20:43.207 INFO:teuthology.orchestra.run.trial040.stdout:Package librados2-2:20.3.0-5271.g32585015.el9.x86_64 is already installed. 2026-02-17T04:20:43.225 INFO:teuthology.orchestra.run.trial040.stdout:Dependencies resolved. 2026-02-17T04:20:43.225 INFO:teuthology.orchestra.run.trial040.stdout:Nothing to do. 2026-02-17T04:20:43.226 INFO:teuthology.orchestra.run.trial040.stdout:Complete! 2026-02-17T04:20:43.247 DEBUG:teuthology.orchestra.run.trial040:> sudo yum -y install librbd1 2026-02-17T04:20:43.560 INFO:teuthology.orchestra.run.trial040.stdout:Last metadata expiration check: 0:00:50 ago on Tue 17 Feb 2026 04:19:53 AM UTC. 2026-02-17T04:20:43.625 INFO:teuthology.orchestra.run.trial040.stdout:Package librbd1-2:20.3.0-5271.g32585015.el9.x86_64 is already installed. 2026-02-17T04:20:43.642 INFO:teuthology.orchestra.run.trial040.stdout:Dependencies resolved. 2026-02-17T04:20:43.642 INFO:teuthology.orchestra.run.trial040.stdout:Nothing to do. 2026-02-17T04:20:43.642 INFO:teuthology.orchestra.run.trial040.stdout:Complete! 2026-02-17T04:20:43.664 DEBUG:teuthology.orchestra.run.trial040:> sudo yum -y install python3-rados 2026-02-17T04:20:43.980 INFO:teuthology.orchestra.run.trial040.stdout:Last metadata expiration check: 0:00:50 ago on Tue 17 Feb 2026 04:19:53 AM UTC. 2026-02-17T04:20:44.044 INFO:teuthology.orchestra.run.trial040.stdout:Package python3-rados-2:20.3.0-5271.g32585015.el9.x86_64 is already installed. 2026-02-17T04:20:44.061 INFO:teuthology.orchestra.run.trial040.stdout:Dependencies resolved. 2026-02-17T04:20:44.062 INFO:teuthology.orchestra.run.trial040.stdout:Nothing to do. 2026-02-17T04:20:44.062 INFO:teuthology.orchestra.run.trial040.stdout:Complete! 2026-02-17T04:20:44.083 DEBUG:teuthology.orchestra.run.trial040:> sudo yum -y install python3-rgw 2026-02-17T04:20:44.400 INFO:teuthology.orchestra.run.trial040.stdout:Last metadata expiration check: 0:00:51 ago on Tue 17 Feb 2026 04:19:53 AM UTC. 2026-02-17T04:20:44.465 INFO:teuthology.orchestra.run.trial040.stdout:Package python3-rgw-2:20.3.0-5271.g32585015.el9.x86_64 is already installed. 2026-02-17T04:20:44.482 INFO:teuthology.orchestra.run.trial040.stdout:Dependencies resolved. 2026-02-17T04:20:44.483 INFO:teuthology.orchestra.run.trial040.stdout:Nothing to do. 2026-02-17T04:20:44.483 INFO:teuthology.orchestra.run.trial040.stdout:Complete! 2026-02-17T04:20:44.505 DEBUG:teuthology.orchestra.run.trial040:> sudo yum -y install python3-cephfs 2026-02-17T04:20:44.815 INFO:teuthology.orchestra.run.trial040.stdout:Last metadata expiration check: 0:00:51 ago on Tue 17 Feb 2026 04:19:53 AM UTC. 2026-02-17T04:20:44.882 INFO:teuthology.orchestra.run.trial040.stdout:Package python3-cephfs-2:20.3.0-5271.g32585015.el9.x86_64 is already installed. 2026-02-17T04:20:44.899 INFO:teuthology.orchestra.run.trial040.stdout:Dependencies resolved. 2026-02-17T04:20:44.900 INFO:teuthology.orchestra.run.trial040.stdout:Nothing to do. 2026-02-17T04:20:44.900 INFO:teuthology.orchestra.run.trial040.stdout:Complete! 2026-02-17T04:20:44.921 DEBUG:teuthology.orchestra.run.trial040:> sudo yum -y install python3-rbd 2026-02-17T04:20:45.235 INFO:teuthology.orchestra.run.trial040.stdout:Last metadata expiration check: 0:00:52 ago on Tue 17 Feb 2026 04:19:53 AM UTC. 2026-02-17T04:20:45.299 INFO:teuthology.orchestra.run.trial040.stdout:Package python3-rbd-2:20.3.0-5271.g32585015.el9.x86_64 is already installed. 2026-02-17T04:20:45.317 INFO:teuthology.orchestra.run.trial040.stdout:Dependencies resolved. 2026-02-17T04:20:45.317 INFO:teuthology.orchestra.run.trial040.stdout:Nothing to do. 2026-02-17T04:20:45.317 INFO:teuthology.orchestra.run.trial040.stdout:Complete! 2026-02-17T04:20:45.339 DEBUG:teuthology.orchestra.run.trial040:> sudo yum -y install rbd-fuse 2026-02-17T04:20:45.649 INFO:teuthology.orchestra.run.trial040.stdout:Last metadata expiration check: 0:00:52 ago on Tue 17 Feb 2026 04:19:53 AM UTC. 2026-02-17T04:20:45.732 INFO:teuthology.orchestra.run.trial040.stdout:Dependencies resolved. 2026-02-17T04:20:45.732 INFO:teuthology.orchestra.run.trial040.stdout:================================================================================ 2026-02-17T04:20:45.733 INFO:teuthology.orchestra.run.trial040.stdout: Package Architecture Version Repository Size 2026-02-17T04:20:45.733 INFO:teuthology.orchestra.run.trial040.stdout:================================================================================ 2026-02-17T04:20:45.733 INFO:teuthology.orchestra.run.trial040.stdout:Installing: 2026-02-17T04:20:45.733 INFO:teuthology.orchestra.run.trial040.stdout: rbd-fuse x86_64 2:20.3.0-5271.g32585015.el9 ceph 84 k 2026-02-17T04:20:45.733 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:45.733 INFO:teuthology.orchestra.run.trial040.stdout:Transaction Summary 2026-02-17T04:20:45.733 INFO:teuthology.orchestra.run.trial040.stdout:================================================================================ 2026-02-17T04:20:45.733 INFO:teuthology.orchestra.run.trial040.stdout:Install 1 Package 2026-02-17T04:20:45.733 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:45.733 INFO:teuthology.orchestra.run.trial040.stdout:Total download size: 84 k 2026-02-17T04:20:45.734 INFO:teuthology.orchestra.run.trial040.stdout:Installed size: 209 k 2026-02-17T04:20:45.734 INFO:teuthology.orchestra.run.trial040.stdout:Downloading Packages: 2026-02-17T04:20:45.933 INFO:teuthology.orchestra.run.trial040.stdout:rbd-fuse-20.3.0-5271.g32585015.el9.x86_64.rpm 421 kB/s | 84 kB 00:00 2026-02-17T04:20:45.934 INFO:teuthology.orchestra.run.trial040.stdout:-------------------------------------------------------------------------------- 2026-02-17T04:20:45.934 INFO:teuthology.orchestra.run.trial040.stdout:Total 418 kB/s | 84 kB 00:00 2026-02-17T04:20:45.934 INFO:teuthology.orchestra.run.trial040.stdout:Running transaction check 2026-02-17T04:20:45.939 INFO:teuthology.orchestra.run.trial040.stdout:Transaction check succeeded. 2026-02-17T04:20:45.939 INFO:teuthology.orchestra.run.trial040.stdout:Running transaction test 2026-02-17T04:20:45.971 INFO:teuthology.orchestra.run.trial040.stdout:Transaction test succeeded. 2026-02-17T04:20:45.971 INFO:teuthology.orchestra.run.trial040.stdout:Running transaction 2026-02-17T04:20:46.024 INFO:teuthology.orchestra.run.trial040.stdout: Preparing : 1/1 2026-02-17T04:20:46.041 INFO:teuthology.orchestra.run.trial040.stdout: Installing : rbd-fuse-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T04:20:46.122 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: rbd-fuse-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T04:20:46.180 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : rbd-fuse-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T04:20:46.181 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:46.181 INFO:teuthology.orchestra.run.trial040.stdout:Installed: 2026-02-17T04:20:46.181 INFO:teuthology.orchestra.run.trial040.stdout: rbd-fuse-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:20:46.181 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:46.181 INFO:teuthology.orchestra.run.trial040.stdout:Complete! 2026-02-17T04:20:46.209 DEBUG:teuthology.orchestra.run.trial040:> sudo yum -y install rbd-mirror 2026-02-17T04:20:46.527 INFO:teuthology.orchestra.run.trial040.stdout:Last metadata expiration check: 0:00:53 ago on Tue 17 Feb 2026 04:19:53 AM UTC. 2026-02-17T04:20:46.610 INFO:teuthology.orchestra.run.trial040.stdout:Dependencies resolved. 2026-02-17T04:20:46.610 INFO:teuthology.orchestra.run.trial040.stdout:================================================================================ 2026-02-17T04:20:46.610 INFO:teuthology.orchestra.run.trial040.stdout: Package Arch Version Repo Size 2026-02-17T04:20:46.610 INFO:teuthology.orchestra.run.trial040.stdout:================================================================================ 2026-02-17T04:20:46.610 INFO:teuthology.orchestra.run.trial040.stdout:Installing: 2026-02-17T04:20:46.610 INFO:teuthology.orchestra.run.trial040.stdout: rbd-mirror x86_64 2:20.3.0-5271.g32585015.el9 ceph 2.9 M 2026-02-17T04:20:46.610 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:46.611 INFO:teuthology.orchestra.run.trial040.stdout:Transaction Summary 2026-02-17T04:20:46.611 INFO:teuthology.orchestra.run.trial040.stdout:================================================================================ 2026-02-17T04:20:46.611 INFO:teuthology.orchestra.run.trial040.stdout:Install 1 Package 2026-02-17T04:20:46.611 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:46.611 INFO:teuthology.orchestra.run.trial040.stdout:Total download size: 2.9 M 2026-02-17T04:20:46.611 INFO:teuthology.orchestra.run.trial040.stdout:Installed size: 11 M 2026-02-17T04:20:46.611 INFO:teuthology.orchestra.run.trial040.stdout:Downloading Packages: 2026-02-17T04:20:46.926 INFO:teuthology.orchestra.run.trial040.stdout:rbd-mirror-20.3.0-5271.g32585015.el9.x86_64.rpm 9.1 MB/s | 2.9 MB 00:00 2026-02-17T04:20:46.927 INFO:teuthology.orchestra.run.trial040.stdout:-------------------------------------------------------------------------------- 2026-02-17T04:20:46.927 INFO:teuthology.orchestra.run.trial040.stdout:Total 9.0 MB/s | 2.9 MB 00:00 2026-02-17T04:20:46.927 INFO:teuthology.orchestra.run.trial040.stdout:Running transaction check 2026-02-17T04:20:46.932 INFO:teuthology.orchestra.run.trial040.stdout:Transaction check succeeded. 2026-02-17T04:20:46.932 INFO:teuthology.orchestra.run.trial040.stdout:Running transaction test 2026-02-17T04:20:46.972 INFO:teuthology.orchestra.run.trial040.stdout:Transaction test succeeded. 2026-02-17T04:20:46.972 INFO:teuthology.orchestra.run.trial040.stdout:Running transaction 2026-02-17T04:20:47.152 INFO:teuthology.orchestra.run.trial040.stdout: Preparing : 1/1 2026-02-17T04:20:47.153 INFO:teuthology.orchestra.run.trial040.stdout: Installing : rbd-mirror-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T04:20:47.177 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T04:20:47.178 INFO:teuthology.orchestra.run.trial040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T04:20:47.178 INFO:teuthology.orchestra.run.trial040.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-17T04:20:47.178 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T04:20:47.178 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T04:20:47.178 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:47.505 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : rbd-mirror-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T04:20:47.505 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:47.506 INFO:teuthology.orchestra.run.trial040.stdout:Installed: 2026-02-17T04:20:47.506 INFO:teuthology.orchestra.run.trial040.stdout: rbd-mirror-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:20:47.506 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:47.506 INFO:teuthology.orchestra.run.trial040.stdout:Complete! 2026-02-17T04:20:47.534 DEBUG:teuthology.orchestra.run.trial040:> sudo yum -y install rbd-nbd 2026-02-17T04:20:47.853 INFO:teuthology.orchestra.run.trial040.stdout:Last metadata expiration check: 0:00:54 ago on Tue 17 Feb 2026 04:19:53 AM UTC. 2026-02-17T04:20:47.936 INFO:teuthology.orchestra.run.trial040.stdout:Dependencies resolved. 2026-02-17T04:20:47.936 INFO:teuthology.orchestra.run.trial040.stdout:================================================================================ 2026-02-17T04:20:47.936 INFO:teuthology.orchestra.run.trial040.stdout: Package Architecture Version Repository Size 2026-02-17T04:20:47.936 INFO:teuthology.orchestra.run.trial040.stdout:================================================================================ 2026-02-17T04:20:47.936 INFO:teuthology.orchestra.run.trial040.stdout:Installing: 2026-02-17T04:20:47.937 INFO:teuthology.orchestra.run.trial040.stdout: rbd-nbd x86_64 2:20.3.0-5271.g32585015.el9 ceph 172 k 2026-02-17T04:20:47.937 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:47.937 INFO:teuthology.orchestra.run.trial040.stdout:Transaction Summary 2026-02-17T04:20:47.937 INFO:teuthology.orchestra.run.trial040.stdout:================================================================================ 2026-02-17T04:20:47.937 INFO:teuthology.orchestra.run.trial040.stdout:Install 1 Package 2026-02-17T04:20:47.937 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:47.937 INFO:teuthology.orchestra.run.trial040.stdout:Total download size: 172 k 2026-02-17T04:20:47.937 INFO:teuthology.orchestra.run.trial040.stdout:Installed size: 462 k 2026-02-17T04:20:47.937 INFO:teuthology.orchestra.run.trial040.stdout:Downloading Packages: 2026-02-17T04:20:48.021 INFO:teuthology.orchestra.run.trial040.stdout:rbd-nbd-20.3.0-5271.g32585015.el9.x86_64.rpm 2.0 MB/s | 172 kB 00:00 2026-02-17T04:20:48.022 INFO:teuthology.orchestra.run.trial040.stdout:-------------------------------------------------------------------------------- 2026-02-17T04:20:48.022 INFO:teuthology.orchestra.run.trial040.stdout:Total 2.0 MB/s | 172 kB 00:00 2026-02-17T04:20:48.022 INFO:teuthology.orchestra.run.trial040.stdout:Running transaction check 2026-02-17T04:20:48.026 INFO:teuthology.orchestra.run.trial040.stdout:Transaction check succeeded. 2026-02-17T04:20:48.026 INFO:teuthology.orchestra.run.trial040.stdout:Running transaction test 2026-02-17T04:20:48.057 INFO:teuthology.orchestra.run.trial040.stdout:Transaction test succeeded. 2026-02-17T04:20:48.058 INFO:teuthology.orchestra.run.trial040.stdout:Running transaction 2026-02-17T04:20:48.114 INFO:teuthology.orchestra.run.trial040.stdout: Preparing : 1/1 2026-02-17T04:20:48.132 INFO:teuthology.orchestra.run.trial040.stdout: Installing : rbd-nbd-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T04:20:48.210 INFO:teuthology.orchestra.run.trial040.stdout: Running scriptlet: rbd-nbd-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T04:20:48.270 INFO:teuthology.orchestra.run.trial040.stdout: Verifying : rbd-nbd-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T04:20:48.270 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:48.270 INFO:teuthology.orchestra.run.trial040.stdout:Installed: 2026-02-17T04:20:48.270 INFO:teuthology.orchestra.run.trial040.stdout: rbd-nbd-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:20:48.270 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:48.270 INFO:teuthology.orchestra.run.trial040.stdout:Complete! 2026-02-17T04:20:48.300 DEBUG:teuthology.parallel:result is None 2026-02-17T04:20:48.300 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=325850157d309f65985eea9ec9bb9f1d56726fee 2026-02-17T04:20:48.444 DEBUG:teuthology.orchestra.run.trial040:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-17T04:20:48.466 INFO:teuthology.orchestra.run.trial040.stdout:20.3.0-5271.g32585015.el9 2026-02-17T04:20:48.467 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5271.g32585015.el9 2026-02-17T04:20:48.467 INFO:teuthology.task.install:The correct ceph version 20.3.0-5271.g32585015 is installed. 2026-02-17T04:20:48.469 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-17T04:20:48.470 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T04:20:48.470 DEBUG:teuthology.orchestra.run.trial040:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T04:20:48.532 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-17T04:20:48.532 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T04:20:48.532 DEBUG:teuthology.orchestra.run.trial040:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T04:20:48.597 DEBUG:teuthology.orchestra.run.trial040:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T04:20:48.662 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-17T04:20:48.662 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T04:20:48.662 DEBUG:teuthology.orchestra.run.trial040:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T04:20:48.725 DEBUG:teuthology.orchestra.run.trial040:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T04:20:48.788 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-17T04:20:48.788 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T04:20:48.788 DEBUG:teuthology.orchestra.run.trial040:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T04:20:48.852 DEBUG:teuthology.orchestra.run.trial040:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T04:20:48.916 INFO:teuthology.run_tasks:Running task ceph... 2026-02-17T04:20:48.999 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-17T04:20:48.999 DEBUG:teuthology.orchestra.run.trial040:> sudo chmod 777 /var/log/ceph 2026-02-17T04:20:49.025 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-17T04:20:49.025 DEBUG:teuthology.orchestra.run.trial040:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-17T04:20:49.090 INFO:tasks.ceph:Creating extra log directories... 2026-02-17T04:20:49.090 DEBUG:teuthology.orchestra.run.trial040:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-17T04:20:49.162 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-17T04:20:49.162 INFO:tasks.ceph:config {'conf': {'osd': {'osd max object name len': 400, 'osd max object namespace len': 64, 'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'global': {'mon election default strategy': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 30, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['but it is still running', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_APP_NOT_ENABLED\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-17T04:20:49.162 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_03:53:03-rados-wip-bharath18-testing-2026-02-13-0856-distro-default-trial/50828', 'branch': 'wip-bharath18-testing-2026-02-13-0856', 'description': 'rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{centos_latest}}', 'email': 'skanta@redhat.com', 'first_in_suite': False, 'flavor': 'default', 'job_id': '50828', 'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'skanta-2026-02-17_03:53:03-rados-wip-bharath18-testing-2026-02-13-0856-distro-default-trial', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-bharath18-testing-2026-02-13-0856'}, 'ceph': {'conf': {'global': {'mon election default strategy': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 30, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '325850157d309f65985eea9ec9bb9f1d56726fee'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '325850157d309f65985eea9ec9bb9f1d56726fee'}}, 'workunit': {'branch': 'wip-bharath18-testing-2026-02-13-0856', 'sha1': '325850157d309f65985eea9ec9bb9f1d56726fee'}}, 'owner': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'priority': 69, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'osd.8', 'osd.9', 'client.0']], 'seed': 7109, 'sha1': '325850157d309f65985eea9ec9bb9f1d56726fee', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-bharath18-testing-2026-02-13-0856', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_325850157d309f65985eea9ec9bb9f1d56726fee/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '325850157d309f65985eea9ec9bb9f1d56726fee', 'targets': {'trial040.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHe+QgnyeQzkZM99X2e15xIrqi5GELipxRDlLUKl9zEWWjL6Q9bBZh/RbaP2rMAK9M4IuCk9xVSy2jC5Kkc3KAA='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'osd': {'osd max object name len': 400, 'osd max object namespace len': 64, 'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'global': {'mon election default strategy': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 30, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}}, 'log-ignorelist': ['but it is still running', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_APP_NOT_ENABLED\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'pre-mgr-commands': ['sudo ceph config set mgr mgr_pool false --force'], 'flavor': 'default', 'sha1': '325850157d309f65985eea9ec9bb9f1d56726fee', 'cluster': 'ceph'}}, {'workunit': {'clients': {'all': ['rados/test_health_warnings.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-17_03:53:03', 'tube': 'trial', 'user': 'skanta', 'verbose': True, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682'} 2026-02-17T04:20:49.162 DEBUG:teuthology.orchestra.run.trial040:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-17T04:20:49.210 DEBUG:teuthology.orchestra.run.trial040:> sudo install -d -m0777 -- /var/run/ceph 2026-02-17T04:20:49.282 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T04:20:49.283 DEBUG:teuthology.orchestra.run.trial040:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T04:20:49.336 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T04:20:49.336 DEBUG:teuthology.orchestra.run.trial040:> stat /dev/vg_nvme/lv_1 2026-02-17T04:20:49.394 INFO:teuthology.orchestra.run.trial040.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T04:20:49.395 INFO:teuthology.orchestra.run.trial040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T04:20:49.395 INFO:teuthology.orchestra.run.trial040.stdout:Device: 6h/6d Inode: 1302 Links: 1 2026-02-17T04:20:49.395 INFO:teuthology.orchestra.run.trial040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T04:20:49.395 INFO:teuthology.orchestra.run.trial040.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T04:20:49.395 INFO:teuthology.orchestra.run.trial040.stdout:Access: 2026-02-17 04:20:47.311391586 +0000 2026-02-17T04:20:49.395 INFO:teuthology.orchestra.run.trial040.stdout:Modify: 2026-02-17 04:20:01.061208483 +0000 2026-02-17T04:20:49.395 INFO:teuthology.orchestra.run.trial040.stdout:Change: 2026-02-17 04:20:01.061208483 +0000 2026-02-17T04:20:49.396 INFO:teuthology.orchestra.run.trial040.stdout: Birth: 2026-02-17 04:20:01.061208483 +0000 2026-02-17T04:20:49.396 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T04:20:49.457 INFO:teuthology.orchestra.run.trial040.stderr:1+0 records in 2026-02-17T04:20:49.457 INFO:teuthology.orchestra.run.trial040.stderr:1+0 records out 2026-02-17T04:20:49.457 INFO:teuthology.orchestra.run.trial040.stderr:512 bytes copied, 0.0001506 s, 3.4 MB/s 2026-02-17T04:20:49.459 DEBUG:teuthology.orchestra.run.trial040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T04:20:49.516 DEBUG:teuthology.orchestra.run.trial040:> stat /dev/vg_nvme/lv_2 2026-02-17T04:20:49.572 INFO:teuthology.orchestra.run.trial040.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T04:20:49.572 INFO:teuthology.orchestra.run.trial040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T04:20:49.573 INFO:teuthology.orchestra.run.trial040.stdout:Device: 6h/6d Inode: 1288 Links: 1 2026-02-17T04:20:49.573 INFO:teuthology.orchestra.run.trial040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T04:20:49.573 INFO:teuthology.orchestra.run.trial040.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T04:20:49.573 INFO:teuthology.orchestra.run.trial040.stdout:Access: 2026-02-17 04:20:47.311391586 +0000 2026-02-17T04:20:49.573 INFO:teuthology.orchestra.run.trial040.stdout:Modify: 2026-02-17 04:20:01.061208483 +0000 2026-02-17T04:20:49.573 INFO:teuthology.orchestra.run.trial040.stdout:Change: 2026-02-17 04:20:01.061208483 +0000 2026-02-17T04:20:49.573 INFO:teuthology.orchestra.run.trial040.stdout: Birth: 2026-02-17 04:20:01.061208483 +0000 2026-02-17T04:20:49.573 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T04:20:49.636 INFO:teuthology.orchestra.run.trial040.stderr:1+0 records in 2026-02-17T04:20:49.636 INFO:teuthology.orchestra.run.trial040.stderr:1+0 records out 2026-02-17T04:20:49.636 INFO:teuthology.orchestra.run.trial040.stderr:512 bytes copied, 0.00014523 s, 3.5 MB/s 2026-02-17T04:20:49.637 DEBUG:teuthology.orchestra.run.trial040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T04:20:49.695 DEBUG:teuthology.orchestra.run.trial040:> stat /dev/vg_nvme/lv_3 2026-02-17T04:20:49.750 INFO:teuthology.orchestra.run.trial040.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T04:20:49.750 INFO:teuthology.orchestra.run.trial040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T04:20:49.751 INFO:teuthology.orchestra.run.trial040.stdout:Device: 6h/6d Inode: 1300 Links: 1 2026-02-17T04:20:49.751 INFO:teuthology.orchestra.run.trial040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T04:20:49.751 INFO:teuthology.orchestra.run.trial040.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T04:20:49.751 INFO:teuthology.orchestra.run.trial040.stdout:Access: 2026-02-17 04:20:47.311391586 +0000 2026-02-17T04:20:49.751 INFO:teuthology.orchestra.run.trial040.stdout:Modify: 2026-02-17 04:20:01.061208483 +0000 2026-02-17T04:20:49.751 INFO:teuthology.orchestra.run.trial040.stdout:Change: 2026-02-17 04:20:01.061208483 +0000 2026-02-17T04:20:49.751 INFO:teuthology.orchestra.run.trial040.stdout: Birth: 2026-02-17 04:20:01.061208483 +0000 2026-02-17T04:20:49.751 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T04:20:49.813 INFO:teuthology.orchestra.run.trial040.stderr:1+0 records in 2026-02-17T04:20:49.814 INFO:teuthology.orchestra.run.trial040.stderr:1+0 records out 2026-02-17T04:20:49.814 INFO:teuthology.orchestra.run.trial040.stderr:512 bytes copied, 0.000161169 s, 3.2 MB/s 2026-02-17T04:20:49.815 DEBUG:teuthology.orchestra.run.trial040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T04:20:49.873 DEBUG:teuthology.orchestra.run.trial040:> stat /dev/vg_nvme/lv_4 2026-02-17T04:20:49.930 INFO:teuthology.orchestra.run.trial040.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T04:20:49.930 INFO:teuthology.orchestra.run.trial040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T04:20:49.930 INFO:teuthology.orchestra.run.trial040.stdout:Device: 6h/6d Inode: 1312 Links: 1 2026-02-17T04:20:49.930 INFO:teuthology.orchestra.run.trial040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T04:20:49.930 INFO:teuthology.orchestra.run.trial040.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T04:20:49.930 INFO:teuthology.orchestra.run.trial040.stdout:Access: 2026-02-17 04:20:47.312391561 +0000 2026-02-17T04:20:49.930 INFO:teuthology.orchestra.run.trial040.stdout:Modify: 2026-02-17 04:20:01.062208466 +0000 2026-02-17T04:20:49.931 INFO:teuthology.orchestra.run.trial040.stdout:Change: 2026-02-17 04:20:01.062208466 +0000 2026-02-17T04:20:49.931 INFO:teuthology.orchestra.run.trial040.stdout: Birth: 2026-02-17 04:20:01.062208466 +0000 2026-02-17T04:20:49.931 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T04:20:49.992 INFO:teuthology.orchestra.run.trial040.stderr:1+0 records in 2026-02-17T04:20:49.992 INFO:teuthology.orchestra.run.trial040.stderr:1+0 records out 2026-02-17T04:20:49.993 INFO:teuthology.orchestra.run.trial040.stderr:512 bytes copied, 0.000168272 s, 3.0 MB/s 2026-02-17T04:20:49.994 DEBUG:teuthology.orchestra.run.trial040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T04:20:50.052 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-17T04:20:50.052 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial040.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2026-02-17T04:20:50.052 INFO:tasks.ceph:Generating config... 2026-02-17T04:20:50.053 INFO:tasks.ceph:[osd] osd max object name len = 400 2026-02-17T04:20:50.053 INFO:tasks.ceph:[osd] osd max object namespace len = 64 2026-02-17T04:20:50.053 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2026-02-17T04:20:50.053 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-17T04:20:50.053 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-17T04:20:50.053 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2026-02-17T04:20:50.053 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2026-02-17T04:20:50.053 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2026-02-17T04:20:50.053 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2026-02-17T04:20:50.054 INFO:tasks.ceph:[osd] osd mclock skip benchmark = True 2026-02-17T04:20:50.054 INFO:tasks.ceph:[osd] osd op queue = debug_random 2026-02-17T04:20:50.054 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2026-02-17T04:20:50.054 INFO:tasks.ceph:[global] mon election default strategy = 1 2026-02-17T04:20:50.054 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-17T04:20:50.054 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-17T04:20:50.054 INFO:tasks.ceph:[mon] debug mon = 30 2026-02-17T04:20:50.054 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-17T04:20:50.054 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-17T04:20:50.054 INFO:tasks.ceph:[mon] mon scrub interval = 300 2026-02-17T04:20:50.054 INFO:tasks.ceph:Setting up mon.a... 2026-02-17T04:20:50.054 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-17T04:20:50.126 INFO:teuthology.orchestra.run.trial040.stdout:creating /etc/ceph/ceph.keyring 2026-02-17T04:20:50.128 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-17T04:20:50.204 DEBUG:teuthology.orchestra.run.trial040:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T04:20:50.269 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.40')] 2026-02-17T04:20:50.269 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.40', 'mon election default strategy': 1}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'osd max object name len': 400, 'osd max object namespace len': 64, 'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd mclock override recovery settings': True, 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 30, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon scrub interval': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}} 2026-02-17T04:20:50.271 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T04:20:50.271 DEBUG:teuthology.orchestra.run.trial040:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-17T04:20:50.324 DEBUG:teuthology.orchestra.run.trial040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.40 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-17T04:20:50.392 INFO:teuthology.orchestra.run.trial040.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-17T04:20:50.392 INFO:teuthology.orchestra.run.trial040.stdout:monmaptool: generated fsid 1c4f66e4-59c5-4536-b735-09464fcda99a 2026-02-17T04:20:50.392 INFO:teuthology.orchestra.run.trial040.stdout:setting min_mon_release = tentacle 2026-02-17T04:20:50.392 INFO:teuthology.orchestra.run.trial040.stdout:epoch 0 2026-02-17T04:20:50.392 INFO:teuthology.orchestra.run.trial040.stdout:fsid 1c4f66e4-59c5-4536-b735-09464fcda99a 2026-02-17T04:20:50.392 INFO:teuthology.orchestra.run.trial040.stdout:last_changed 2026-02-17T04:20:50.391738+0000 2026-02-17T04:20:50.392 INFO:teuthology.orchestra.run.trial040.stdout:created 2026-02-17T04:20:50.391738+0000 2026-02-17T04:20:50.392 INFO:teuthology.orchestra.run.trial040.stdout:min_mon_release 20 (tentacle) 2026-02-17T04:20:50.392 INFO:teuthology.orchestra.run.trial040.stdout:election_strategy: 1 2026-02-17T04:20:50.392 INFO:teuthology.orchestra.run.trial040.stdout:0: [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] mon.a 2026-02-17T04:20:50.392 INFO:teuthology.orchestra.run.trial040.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2026-02-17T04:20:50.392 DEBUG:teuthology.orchestra.run.trial040:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-17T04:20:50.449 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 1c4f66e4-59c5-4536-b735-09464fcda99a... 2026-02-17T04:20:50.450 DEBUG:teuthology.orchestra.run.trial040:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-17T04:20:50.530 INFO:teuthology.orchestra.run.trial040.stdout:[global] 2026-02-17T04:20:50.530 INFO:teuthology.orchestra.run.trial040.stdout: chdir = "" 2026-02-17T04:20:50.531 INFO:teuthology.orchestra.run.trial040.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-17T04:20:50.531 INFO:teuthology.orchestra.run.trial040.stdout: auth supported = cephx 2026-02-17T04:20:50.531 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:50.531 INFO:teuthology.orchestra.run.trial040.stdout: filestore xattr use omap = true 2026-02-17T04:20:50.531 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:50.531 INFO:teuthology.orchestra.run.trial040.stdout: mon clock drift allowed = 1.000 2026-02-17T04:20:50.531 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:50.531 INFO:teuthology.orchestra.run.trial040.stdout: osd crush chooseleaf type = 0 2026-02-17T04:20:50.531 INFO:teuthology.orchestra.run.trial040.stdout: auth debug = true 2026-02-17T04:20:50.531 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:50.532 INFO:teuthology.orchestra.run.trial040.stdout: ms die on old message = true 2026-02-17T04:20:50.532 INFO:teuthology.orchestra.run.trial040.stdout: ms die on bug = true 2026-02-17T04:20:50.532 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:50.532 INFO:teuthology.orchestra.run.trial040.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-17T04:20:50.532 INFO:teuthology.orchestra.run.trial040.stdout: mon pg warn max object skew = 0 2026-02-17T04:20:50.532 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:50.532 INFO:teuthology.orchestra.run.trial040.stdout: # disable pg_autoscaler by default for new pools 2026-02-17T04:20:50.532 INFO:teuthology.orchestra.run.trial040.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-17T04:20:50.532 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:50.532 INFO:teuthology.orchestra.run.trial040.stdout: osd pool default size = 2 2026-02-17T04:20:50.532 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:50.533 INFO:teuthology.orchestra.run.trial040.stdout: mon osd allow primary affinity = true 2026-02-17T04:20:50.533 INFO:teuthology.orchestra.run.trial040.stdout: mon osd allow pg remap = true 2026-02-17T04:20:50.533 INFO:teuthology.orchestra.run.trial040.stdout: mon warn on legacy crush tunables = false 2026-02-17T04:20:50.533 INFO:teuthology.orchestra.run.trial040.stdout: mon warn on crush straw calc version zero = false 2026-02-17T04:20:50.533 INFO:teuthology.orchestra.run.trial040.stdout: mon warn on no sortbitwise = false 2026-02-17T04:20:50.533 INFO:teuthology.orchestra.run.trial040.stdout: mon warn on osd down out interval zero = false 2026-02-17T04:20:50.533 INFO:teuthology.orchestra.run.trial040.stdout: mon warn on too few osds = false 2026-02-17T04:20:50.533 INFO:teuthology.orchestra.run.trial040.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-17T04:20:50.533 INFO:teuthology.orchestra.run.trial040.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-17T04:20:50.533 INFO:teuthology.orchestra.run.trial040.stdout: mon_allow_pool_size_one = true 2026-02-17T04:20:50.533 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:50.533 INFO:teuthology.orchestra.run.trial040.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-17T04:20:50.534 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:50.534 INFO:teuthology.orchestra.run.trial040.stdout: osd default data pool replay window = 5 2026-02-17T04:20:50.534 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:50.534 INFO:teuthology.orchestra.run.trial040.stdout: mon allow pool delete = true 2026-02-17T04:20:50.534 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:50.534 INFO:teuthology.orchestra.run.trial040.stdout: mon cluster log file level = debug 2026-02-17T04:20:50.534 INFO:teuthology.orchestra.run.trial040.stdout: debug asserts on shutdown = true 2026-02-17T04:20:50.534 INFO:teuthology.orchestra.run.trial040.stdout: mon health detail to clog = false 2026-02-17T04:20:50.534 INFO:teuthology.orchestra.run.trial040.stdout: mon host = 10.20.193.40 2026-02-17T04:20:50.534 INFO:teuthology.orchestra.run.trial040.stdout: mon election default strategy = 1 2026-02-17T04:20:50.534 INFO:teuthology.orchestra.run.trial040.stdout: fsid = 1c4f66e4-59c5-4536-b735-09464fcda99a 2026-02-17T04:20:50.535 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:50.535 INFO:teuthology.orchestra.run.trial040.stdout:[osd] 2026-02-17T04:20:50.535 INFO:teuthology.orchestra.run.trial040.stdout: osd journal size = 100 2026-02-17T04:20:50.535 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:50.535 INFO:teuthology.orchestra.run.trial040.stdout: osd scrub load threshold = 5.0 2026-02-17T04:20:50.535 INFO:teuthology.orchestra.run.trial040.stdout: osd scrub max interval = 600 2026-02-17T04:20:50.535 INFO:teuthology.orchestra.run.trial040.stdout: osd mclock profile = high_recovery_ops 2026-02-17T04:20:50.535 INFO:teuthology.orchestra.run.trial040.stdout: osd mclock skip benchmark = True 2026-02-17T04:20:50.535 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:50.535 INFO:teuthology.orchestra.run.trial040.stdout: osd recover clone overlap = true 2026-02-17T04:20:50.535 INFO:teuthology.orchestra.run.trial040.stdout: osd recovery max chunk = 1048576 2026-02-17T04:20:50.535 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:50.536 INFO:teuthology.orchestra.run.trial040.stdout: osd debug shutdown = true 2026-02-17T04:20:50.536 INFO:teuthology.orchestra.run.trial040.stdout: osd debug op order = true 2026-02-17T04:20:50.536 INFO:teuthology.orchestra.run.trial040.stdout: osd debug verify stray on activate = true 2026-02-17T04:20:50.536 INFO:teuthology.orchestra.run.trial040.stdout: osd debug trim objects = true 2026-02-17T04:20:50.536 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:50.536 INFO:teuthology.orchestra.run.trial040.stdout: osd open classes on start = true 2026-02-17T04:20:50.536 INFO:teuthology.orchestra.run.trial040.stdout: osd debug pg log writeout = true 2026-02-17T04:20:50.536 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:50.536 INFO:teuthology.orchestra.run.trial040.stdout: osd deep scrub update digest min age = 30 2026-02-17T04:20:50.536 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:50.536 INFO:teuthology.orchestra.run.trial040.stdout: osd map max advance = 10 2026-02-17T04:20:50.536 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:50.536 INFO:teuthology.orchestra.run.trial040.stdout: journal zero on create = true 2026-02-17T04:20:50.537 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:50.537 INFO:teuthology.orchestra.run.trial040.stdout: filestore ondisk finisher threads = 3 2026-02-17T04:20:50.537 INFO:teuthology.orchestra.run.trial040.stdout: filestore apply finisher threads = 3 2026-02-17T04:20:50.537 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:50.537 INFO:teuthology.orchestra.run.trial040.stdout: bdev debug aio = true 2026-02-17T04:20:50.537 INFO:teuthology.orchestra.run.trial040.stdout: osd debug misdirected ops = true 2026-02-17T04:20:50.537 INFO:teuthology.orchestra.run.trial040.stdout: osd max object name len = 400 2026-02-17T04:20:50.537 INFO:teuthology.orchestra.run.trial040.stdout: osd max object namespace len = 64 2026-02-17T04:20:50.537 INFO:teuthology.orchestra.run.trial040.stdout: bluestore zero block detection = True 2026-02-17T04:20:50.537 INFO:teuthology.orchestra.run.trial040.stdout: debug ms = 1 2026-02-17T04:20:50.537 INFO:teuthology.orchestra.run.trial040.stdout: debug osd = 20 2026-02-17T04:20:50.537 INFO:teuthology.orchestra.run.trial040.stdout: osd debug verify cached snaps = True 2026-02-17T04:20:50.537 INFO:teuthology.orchestra.run.trial040.stdout: osd debug verify missing on start = True 2026-02-17T04:20:50.538 INFO:teuthology.orchestra.run.trial040.stdout: osd mclock override recovery settings = True 2026-02-17T04:20:50.538 INFO:teuthology.orchestra.run.trial040.stdout: osd op queue = debug_random 2026-02-17T04:20:50.538 INFO:teuthology.orchestra.run.trial040.stdout: osd op queue cut off = debug_random 2026-02-17T04:20:50.538 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:50.538 INFO:teuthology.orchestra.run.trial040.stdout:[mgr] 2026-02-17T04:20:50.538 INFO:teuthology.orchestra.run.trial040.stdout: debug ms = 1 2026-02-17T04:20:50.538 INFO:teuthology.orchestra.run.trial040.stdout: debug mgr = 20 2026-02-17T04:20:50.538 INFO:teuthology.orchestra.run.trial040.stdout: debug mon = 20 2026-02-17T04:20:50.538 INFO:teuthology.orchestra.run.trial040.stdout: debug auth = 20 2026-02-17T04:20:50.538 INFO:teuthology.orchestra.run.trial040.stdout: mon reweight min pgs per osd = 4 2026-02-17T04:20:50.538 INFO:teuthology.orchestra.run.trial040.stdout: mon reweight min bytes per osd = 10 2026-02-17T04:20:50.538 INFO:teuthology.orchestra.run.trial040.stdout: mgr/telemetry/nag = false 2026-02-17T04:20:50.539 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:50.539 INFO:teuthology.orchestra.run.trial040.stdout:[mon] 2026-02-17T04:20:50.539 INFO:teuthology.orchestra.run.trial040.stdout: debug ms = 1 2026-02-17T04:20:50.539 INFO:teuthology.orchestra.run.trial040.stdout: debug mon = 30 2026-02-17T04:20:50.539 INFO:teuthology.orchestra.run.trial040.stdout: debug paxos = 20 2026-02-17T04:20:50.539 INFO:teuthology.orchestra.run.trial040.stdout: debug auth = 20 2026-02-17T04:20:50.539 INFO:teuthology.orchestra.run.trial040.stdout: mon data avail warn = 5 2026-02-17T04:20:50.539 INFO:teuthology.orchestra.run.trial040.stdout: mon mgr mkfs grace = 240 2026-02-17T04:20:50.539 INFO:teuthology.orchestra.run.trial040.stdout: mon reweight min pgs per osd = 4 2026-02-17T04:20:50.539 INFO:teuthology.orchestra.run.trial040.stdout: mon osd reporter subtree level = osd 2026-02-17T04:20:50.539 INFO:teuthology.orchestra.run.trial040.stdout: mon osd prime pg temp = true 2026-02-17T04:20:50.540 INFO:teuthology.orchestra.run.trial040.stdout: mon reweight min bytes per osd = 10 2026-02-17T04:20:50.540 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:50.540 INFO:teuthology.orchestra.run.trial040.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-17T04:20:50.540 INFO:teuthology.orchestra.run.trial040.stdout: auth mon ticket ttl = 660 # 11m 2026-02-17T04:20:50.540 INFO:teuthology.orchestra.run.trial040.stdout: auth service ticket ttl = 240 # 4m 2026-02-17T04:20:50.540 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:50.540 INFO:teuthology.orchestra.run.trial040.stdout: # don't complain about insecure global_id in the test suite 2026-02-17T04:20:50.540 INFO:teuthology.orchestra.run.trial040.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-17T04:20:50.540 INFO:teuthology.orchestra.run.trial040.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-17T04:20:50.540 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:50.540 INFO:teuthology.orchestra.run.trial040.stdout: # 1m isn't quite enough 2026-02-17T04:20:50.541 INFO:teuthology.orchestra.run.trial040.stdout: mon_down_mkfs_grace = 2m 2026-02-17T04:20:50.541 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:50.541 INFO:teuthology.orchestra.run.trial040.stdout: mon_warn_on_filestore_osds = false 2026-02-17T04:20:50.541 INFO:teuthology.orchestra.run.trial040.stdout: mon scrub interval = 300 2026-02-17T04:20:50.541 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:20:50.541 INFO:teuthology.orchestra.run.trial040.stdout:[client] 2026-02-17T04:20:50.541 INFO:teuthology.orchestra.run.trial040.stdout: rgw cache enabled = true 2026-02-17T04:20:50.541 INFO:teuthology.orchestra.run.trial040.stdout: rgw enable ops log = true 2026-02-17T04:20:50.541 INFO:teuthology.orchestra.run.trial040.stdout: rgw enable usage log = true 2026-02-17T04:20:50.541 INFO:teuthology.orchestra.run.trial040.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-17T04:20:50.541 INFO:teuthology.orchestra.run.trial040.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-17T04:20:50.542 INFO:teuthology.orchestra.run.trial040.stdout:[mon.a] 2026-02-17T04:20:50.543 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-17T04:20:50.543 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-17T04:20:50.625 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-17T04:20:50.625 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T04:20:50.625 DEBUG:teuthology.orchestra.run.trial040:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-17T04:20:50.681 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T04:20:50.681 DEBUG:teuthology.orchestra.run.trial040:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-17T04:20:50.737 INFO:tasks.ceph:Sending monmap to node ubuntu@trial040.front.sepia.ceph.com 2026-02-17T04:20:50.738 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T04:20:50.738 DEBUG:teuthology.orchestra.run.trial040:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-17T04:20:50.738 DEBUG:teuthology.orchestra.run.trial040:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T04:20:50.809 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T04:20:50.809 DEBUG:teuthology.orchestra.run.trial040:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-17T04:20:50.865 INFO:tasks.ceph:Setting up mon nodes... 2026-02-17T04:20:50.866 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-17T04:20:50.866 DEBUG:teuthology.orchestra.run.trial040:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-17T04:20:50.947 INFO:teuthology.orchestra.run.trial040.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-17T04:20:50.950 INFO:tasks.ceph:Setting up mds nodes... 2026-02-17T04:20:50.950 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-17T04:20:50.951 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-17T04:20:51.024 INFO:teuthology.orchestra.run.trial040.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-17T04:20:51.034 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-17T04:20:51.034 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial040.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2026-02-17T04:20:51.035 DEBUG:teuthology.orchestra.run.trial040:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-17T04:20:51.097 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-17T04:20:51.097 INFO:tasks.ceph:role: osd.0 2026-02-17T04:20:51.097 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial040.front.sepia.ceph.com 2026-02-17T04:20:51.098 DEBUG:teuthology.orchestra.run.trial040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-17T04:20:51.163 INFO:teuthology.orchestra.run.trial040.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T04:20:51.163 INFO:teuthology.orchestra.run.trial040.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T04:20:51.163 INFO:teuthology.orchestra.run.trial040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T04:20:51.163 INFO:teuthology.orchestra.run.trial040.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T04:20:51.164 INFO:teuthology.orchestra.run.trial040.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T04:20:51.164 INFO:teuthology.orchestra.run.trial040.stdout: = sunit=0 swidth=0 blks 2026-02-17T04:20:51.164 INFO:teuthology.orchestra.run.trial040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T04:20:51.164 INFO:teuthology.orchestra.run.trial040.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T04:20:51.164 INFO:teuthology.orchestra.run.trial040.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T04:20:51.164 INFO:teuthology.orchestra.run.trial040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T04:20:51.731 INFO:teuthology.orchestra.run.trial040.stdout:Discarding blocks...Done. 2026-02-17T04:20:51.733 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial040.front.sepia.ceph.com -o noatime 2026-02-17T04:20:51.734 DEBUG:teuthology.orchestra.run.trial040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-17T04:20:51.803 DEBUG:teuthology.orchestra.run.trial040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-17T04:20:51.871 DEBUG:teuthology.orchestra.run.trial040:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-17T04:20:51.937 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-17T04:20:51.937 INFO:tasks.ceph:role: osd.1 2026-02-17T04:20:51.937 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial040.front.sepia.ceph.com 2026-02-17T04:20:51.938 DEBUG:teuthology.orchestra.run.trial040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-17T04:20:52.002 INFO:teuthology.orchestra.run.trial040.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T04:20:52.002 INFO:teuthology.orchestra.run.trial040.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T04:20:52.002 INFO:teuthology.orchestra.run.trial040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T04:20:52.002 INFO:teuthology.orchestra.run.trial040.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T04:20:52.002 INFO:teuthology.orchestra.run.trial040.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T04:20:52.002 INFO:teuthology.orchestra.run.trial040.stdout: = sunit=0 swidth=0 blks 2026-02-17T04:20:52.002 INFO:teuthology.orchestra.run.trial040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T04:20:52.002 INFO:teuthology.orchestra.run.trial040.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T04:20:52.002 INFO:teuthology.orchestra.run.trial040.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T04:20:52.002 INFO:teuthology.orchestra.run.trial040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T04:20:52.561 INFO:teuthology.orchestra.run.trial040.stdout:Discarding blocks...Done. 2026-02-17T04:20:52.563 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial040.front.sepia.ceph.com -o noatime 2026-02-17T04:20:52.563 DEBUG:teuthology.orchestra.run.trial040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-17T04:20:52.632 DEBUG:teuthology.orchestra.run.trial040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-17T04:20:52.699 DEBUG:teuthology.orchestra.run.trial040:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-17T04:20:52.763 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-17T04:20:52.763 INFO:tasks.ceph:role: osd.2 2026-02-17T04:20:52.763 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial040.front.sepia.ceph.com 2026-02-17T04:20:52.763 DEBUG:teuthology.orchestra.run.trial040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-17T04:20:52.827 INFO:teuthology.orchestra.run.trial040.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T04:20:52.828 INFO:teuthology.orchestra.run.trial040.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T04:20:52.828 INFO:teuthology.orchestra.run.trial040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T04:20:52.828 INFO:teuthology.orchestra.run.trial040.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T04:20:52.828 INFO:teuthology.orchestra.run.trial040.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T04:20:52.828 INFO:teuthology.orchestra.run.trial040.stdout: = sunit=0 swidth=0 blks 2026-02-17T04:20:52.828 INFO:teuthology.orchestra.run.trial040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T04:20:52.828 INFO:teuthology.orchestra.run.trial040.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T04:20:52.828 INFO:teuthology.orchestra.run.trial040.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T04:20:52.828 INFO:teuthology.orchestra.run.trial040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T04:20:53.387 INFO:teuthology.orchestra.run.trial040.stdout:Discarding blocks...Done. 2026-02-17T04:20:53.388 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial040.front.sepia.ceph.com -o noatime 2026-02-17T04:20:53.389 DEBUG:teuthology.orchestra.run.trial040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2026-02-17T04:20:53.457 DEBUG:teuthology.orchestra.run.trial040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-17T04:20:53.523 DEBUG:teuthology.orchestra.run.trial040:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-17T04:20:53.587 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-17T04:20:53.587 INFO:tasks.ceph:role: osd.3 2026-02-17T04:20:53.587 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial040.front.sepia.ceph.com 2026-02-17T04:20:53.587 DEBUG:teuthology.orchestra.run.trial040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-17T04:20:53.652 INFO:teuthology.orchestra.run.trial040.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T04:20:53.652 INFO:teuthology.orchestra.run.trial040.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T04:20:53.652 INFO:teuthology.orchestra.run.trial040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T04:20:53.652 INFO:teuthology.orchestra.run.trial040.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T04:20:53.652 INFO:teuthology.orchestra.run.trial040.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T04:20:53.652 INFO:teuthology.orchestra.run.trial040.stdout: = sunit=0 swidth=0 blks 2026-02-17T04:20:53.652 INFO:teuthology.orchestra.run.trial040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T04:20:53.652 INFO:teuthology.orchestra.run.trial040.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T04:20:53.652 INFO:teuthology.orchestra.run.trial040.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T04:20:53.652 INFO:teuthology.orchestra.run.trial040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T04:20:54.212 INFO:teuthology.orchestra.run.trial040.stdout:Discarding blocks...Done. 2026-02-17T04:20:54.214 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial040.front.sepia.ceph.com -o noatime 2026-02-17T04:20:54.214 DEBUG:teuthology.orchestra.run.trial040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2026-02-17T04:20:54.291 DEBUG:teuthology.orchestra.run.trial040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-17T04:20:54.359 DEBUG:teuthology.orchestra.run.trial040:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2026-02-17T04:20:54.423 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-17T04:20:54.423 INFO:tasks.ceph:role: osd.4 2026-02-17T04:20:54.423 DEBUG:teuthology.orchestra.run.trial040:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2026-02-17T04:20:54.488 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-17T04:20:54.489 INFO:tasks.ceph:role: osd.5 2026-02-17T04:20:54.489 DEBUG:teuthology.orchestra.run.trial040:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2026-02-17T04:20:54.554 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-17T04:20:54.554 INFO:tasks.ceph:role: osd.6 2026-02-17T04:20:54.554 DEBUG:teuthology.orchestra.run.trial040:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2026-02-17T04:20:54.618 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-17T04:20:54.618 INFO:tasks.ceph:role: osd.7 2026-02-17T04:20:54.618 DEBUG:teuthology.orchestra.run.trial040:> sudo mkdir -p /var/lib/ceph/osd/ceph-8 2026-02-17T04:20:54.681 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-17T04:20:54.682 INFO:tasks.ceph:role: osd.8 2026-02-17T04:20:54.682 DEBUG:teuthology.orchestra.run.trial040:> sudo mkdir -p /var/lib/ceph/osd/ceph-9 2026-02-17T04:20:54.745 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-17T04:20:54.745 INFO:tasks.ceph:role: osd.9 2026-02-17T04:20:54.746 DEBUG:teuthology.orchestra.run.trial040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T04:20:54.821 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T04:20:54.820+0000 7fd709634780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-17T04:20:54.822 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T04:20:54.821+0000 7fd709634780 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-17T04:20:54.822 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T04:20:54.821+0000 7fd709634780 -1 bdev(0x3fc7400 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-17T04:20:54.822 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T04:20:54.821+0000 7fd709634780 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-17T04:20:55.136 DEBUG:teuthology.orchestra.run.trial040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-17T04:20:55.201 DEBUG:teuthology.orchestra.run.trial040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T04:20:55.277 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T04:20:55.275+0000 7fcdb562f780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-17T04:20:55.277 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T04:20:55.275+0000 7fcdb562f780 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-17T04:20:55.277 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T04:20:55.276+0000 7fcdb562f780 -1 bdev(0x2775400 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-17T04:20:55.277 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T04:20:55.276+0000 7fcdb562f780 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-17T04:20:55.590 DEBUG:teuthology.orchestra.run.trial040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-17T04:20:55.655 DEBUG:teuthology.orchestra.run.trial040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T04:20:55.730 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T04:20:55.729+0000 7f1a38c46780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-17T04:20:55.731 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T04:20:55.729+0000 7f1a38c46780 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-17T04:20:55.731 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T04:20:55.729+0000 7f1a38c46780 -1 bdev(0x335b400 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-02-17T04:20:55.731 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T04:20:55.729+0000 7f1a38c46780 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-17T04:20:56.040 DEBUG:teuthology.orchestra.run.trial040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-17T04:20:56.105 DEBUG:teuthology.orchestra.run.trial040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T04:20:56.181 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T04:20:56.179+0000 7f367246d780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2026-02-17T04:20:56.181 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T04:20:56.180+0000 7f367246d780 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2026-02-17T04:20:56.181 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T04:20:56.180+0000 7f367246d780 -1 bdev(0x42f3400 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2026-02-17T04:20:56.182 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T04:20:56.180+0000 7f367246d780 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2026-02-17T04:20:56.507 DEBUG:teuthology.orchestra.run.trial040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-17T04:20:56.573 DEBUG:teuthology.orchestra.run.trial040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T04:20:56.648 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T04:20:56.647+0000 7f1d4c22c780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2026-02-17T04:20:56.648 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T04:20:56.647+0000 7f1d4c22c780 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2026-02-17T04:20:56.648 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T04:20:56.647+0000 7f1d4c22c780 -1 bdev(0x4023400 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2026-02-17T04:20:56.648 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T04:20:56.647+0000 7f1d4c22c780 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2026-02-17T04:20:56.971 DEBUG:teuthology.orchestra.run.trial040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2026-02-17T04:20:57.036 DEBUG:teuthology.orchestra.run.trial040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T04:20:57.113 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T04:20:57.111+0000 7f142ca1a780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2026-02-17T04:20:57.113 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T04:20:57.111+0000 7f142ca1a780 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2026-02-17T04:20:57.113 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T04:20:57.111+0000 7f142ca1a780 -1 bdev(0x4085400 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2026-02-17T04:20:57.113 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T04:20:57.111+0000 7f142ca1a780 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2026-02-17T04:20:57.430 DEBUG:teuthology.orchestra.run.trial040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2026-02-17T04:20:57.496 DEBUG:teuthology.orchestra.run.trial040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T04:20:57.573 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T04:20:57.571+0000 7fc903e17780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2026-02-17T04:20:57.573 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T04:20:57.571+0000 7fc903e17780 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2026-02-17T04:20:57.573 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T04:20:57.571+0000 7fc903e17780 -1 bdev(0x2d17400 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2026-02-17T04:20:57.574 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T04:20:57.572+0000 7fc903e17780 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2026-02-17T04:20:57.896 DEBUG:teuthology.orchestra.run.trial040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2026-02-17T04:20:57.962 DEBUG:teuthology.orchestra.run.trial040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T04:20:58.039 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T04:20:58.037+0000 7fa83be3a780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2026-02-17T04:20:58.039 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T04:20:58.037+0000 7fa83be3a780 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2026-02-17T04:20:58.039 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T04:20:58.037+0000 7fa83be3a780 -1 bdev(0x3df9400 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2026-02-17T04:20:58.039 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T04:20:58.038+0000 7fa83be3a780 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2026-02-17T04:20:58.373 DEBUG:teuthology.orchestra.run.trial040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2026-02-17T04:20:58.440 DEBUG:teuthology.orchestra.run.trial040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 8 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T04:20:58.516 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T04:20:58.514+0000 7f671560a780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-8/keyring: can't open /var/lib/ceph/osd/ceph-8/keyring: (2) No such file or directory 2026-02-17T04:20:58.516 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T04:20:58.514+0000 7f671560a780 -1 created new key in keyring /var/lib/ceph/osd/ceph-8/keyring 2026-02-17T04:20:58.516 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T04:20:58.514+0000 7f671560a780 -1 bdev(0x351b400 /var/lib/ceph/osd/ceph-8/block) open stat got: (1) Operation not permitted 2026-02-17T04:20:58.516 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T04:20:58.514+0000 7f671560a780 -1 bluestore(/var/lib/ceph/osd/ceph-8) _read_fsid unparsable uuid 2026-02-17T04:20:58.821 DEBUG:teuthology.orchestra.run.trial040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-8 2026-02-17T04:20:58.886 DEBUG:teuthology.orchestra.run.trial040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 9 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T04:20:58.962 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T04:20:58.960+0000 7fbd12c25780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-9/keyring: can't open /var/lib/ceph/osd/ceph-9/keyring: (2) No such file or directory 2026-02-17T04:20:58.962 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T04:20:58.960+0000 7fbd12c25780 -1 created new key in keyring /var/lib/ceph/osd/ceph-9/keyring 2026-02-17T04:20:58.962 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T04:20:58.960+0000 7fbd12c25780 -1 bdev(0x323f400 /var/lib/ceph/osd/ceph-9/block) open stat got: (1) Operation not permitted 2026-02-17T04:20:58.962 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T04:20:58.961+0000 7fbd12c25780 -1 bluestore(/var/lib/ceph/osd/ceph-9) _read_fsid unparsable uuid 2026-02-17T04:20:59.279 DEBUG:teuthology.orchestra.run.trial040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-9 2026-02-17T04:20:59.344 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-17T04:20:59.345 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T04:20:59.345 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-17T04:20:59.408 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T04:20:59.408 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-17T04:20:59.472 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T04:20:59.472 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-17T04:20:59.536 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T04:20:59.536 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-17T04:20:59.600 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T04:20:59.600 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-17T04:20:59.664 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T04:20:59.664 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2026-02-17T04:20:59.728 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T04:20:59.728 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2026-02-17T04:20:59.790 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T04:20:59.790 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2026-02-17T04:20:59.854 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T04:20:59.854 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2026-02-17T04:20:59.917 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T04:20:59.918 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/var/lib/ceph/osd/ceph-8/keyring of=/dev/stdout 2026-02-17T04:20:59.981 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T04:20:59.981 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/var/lib/ceph/osd/ceph-9/keyring of=/dev/stdout 2026-02-17T04:21:00.045 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T04:21:00.045 DEBUG:teuthology.orchestra.run.trial040:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-17T04:21:00.102 INFO:tasks.ceph:Adding keys to all mons... 2026-02-17T04:21:00.102 DEBUG:teuthology.orchestra.run.trial040:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-17T04:21:00.164 INFO:teuthology.orchestra.run.trial040.stdout:[mgr.x] 2026-02-17T04:21:00.164 INFO:teuthology.orchestra.run.trial040.stdout: key = AQCi7JNpFEd5OBAAEjwzyIJ4aBPI+cnuL36phg== 2026-02-17T04:21:00.164 INFO:teuthology.orchestra.run.trial040.stdout:[osd.0] 2026-02-17T04:21:00.164 INFO:teuthology.orchestra.run.trial040.stdout: key = AQCm7JNpgIf2MBAAyhwZSPqf6EclaGcNGxKnBA== 2026-02-17T04:21:00.165 INFO:teuthology.orchestra.run.trial040.stdout:[osd.1] 2026-02-17T04:21:00.165 INFO:teuthology.orchestra.run.trial040.stdout: key = AQCn7JNpZk55EBAAjX1yNIpJm7wnihLWs2JZAg== 2026-02-17T04:21:00.165 INFO:teuthology.orchestra.run.trial040.stdout:[osd.2] 2026-02-17T04:21:00.165 INFO:teuthology.orchestra.run.trial040.stdout: key = AQCn7JNpN/2EKxAA4XWksOmx/kvwNTuzJobwzQ== 2026-02-17T04:21:00.165 INFO:teuthology.orchestra.run.trial040.stdout:[osd.3] 2026-02-17T04:21:00.165 INFO:teuthology.orchestra.run.trial040.stdout: key = AQCo7JNpan7EChAA22NrR0pMWACwSw5K5R/+xQ== 2026-02-17T04:21:00.165 INFO:teuthology.orchestra.run.trial040.stdout:[osd.4] 2026-02-17T04:21:00.165 INFO:teuthology.orchestra.run.trial040.stdout: key = AQCo7JNpuHiiJhAA0hMmfNotSbKS3pXVu5MlPA== 2026-02-17T04:21:00.165 INFO:teuthology.orchestra.run.trial040.stdout:[osd.5] 2026-02-17T04:21:00.166 INFO:teuthology.orchestra.run.trial040.stdout: key = AQCp7JNpuq6tBhAAgIN5DZtwSOSCGv/KOqVRpw== 2026-02-17T04:21:00.166 INFO:teuthology.orchestra.run.trial040.stdout:[osd.6] 2026-02-17T04:21:00.166 INFO:teuthology.orchestra.run.trial040.stdout: key = AQCp7JNp48MfIhAAS84zmtgWjvDEN4O9lScSrQ== 2026-02-17T04:21:00.166 INFO:teuthology.orchestra.run.trial040.stdout:[osd.7] 2026-02-17T04:21:00.166 INFO:teuthology.orchestra.run.trial040.stdout: key = AQCq7JNpSXRLAhAAcWMmqT8lBNfbTdtjzoZWZQ== 2026-02-17T04:21:00.166 INFO:teuthology.orchestra.run.trial040.stdout:[osd.8] 2026-02-17T04:21:00.166 INFO:teuthology.orchestra.run.trial040.stdout: key = AQCq7JNpbb23HhAACmxs7OTnDiEABK7vkteE6g== 2026-02-17T04:21:00.166 INFO:teuthology.orchestra.run.trial040.stdout:[osd.9] 2026-02-17T04:21:00.166 INFO:teuthology.orchestra.run.trial040.stdout: key = AQCq7JNpcVxQORAAN1Y4fJwRWRECJYLu5phwlg== 2026-02-17T04:21:00.167 INFO:teuthology.orchestra.run.trial040.stdout:[client.0] 2026-02-17T04:21:00.167 INFO:teuthology.orchestra.run.trial040.stdout: key = AQCj7JNpYvZmARAAyZylcRc/rDPCIDYnXhSdYQ== 2026-02-17T04:21:00.168 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-17T04:21:00.248 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T04:21:00.327 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T04:21:00.405 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T04:21:00.483 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T04:21:00.564 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T04:21:00.642 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T04:21:00.720 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T04:21:00.799 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T04:21:00.877 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T04:21:00.955 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T04:21:01.032 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-17T04:21:01.113 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-17T04:21:01.114 DEBUG:teuthology.orchestra.run.trial040:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-17T04:21:01.178 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-17T04:21:01.263 DEBUG:teuthology.orchestra.run.trial040:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-17T04:21:01.288 DEBUG:teuthology.orchestra.run.trial040:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-17T04:21:01.344 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-17T04:21:01.345 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-17T04:21:01.345 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-17T04:21:01.387 INFO:tasks.ceph.mon.a:Started 2026-02-17T04:21:01.387 DEBUG:teuthology.orchestra.run.trial040:> sudo ceph config set mgr mgr_pool false --force 2026-02-17T04:21:01.498 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-17T04:21:01.499 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-17T04:21:01.499 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-17T04:21:01.501 INFO:tasks.ceph.mgr.x:Started 2026-02-17T04:21:01.501 DEBUG:tasks.ceph:set 0 configs 2026-02-17T04:21:01.501 DEBUG:teuthology.orchestra.run.trial040:> sudo ceph --cluster ceph config dump 2026-02-17T04:21:01.597 INFO:teuthology.orchestra.run.trial040.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-17T04:21:01.597 INFO:teuthology.orchestra.run.trial040.stdout:mgr dev mgr_pool false * 2026-02-17T04:21:01.603 INFO:tasks.ceph:Setting crush tunables to default 2026-02-17T04:21:01.603 DEBUG:teuthology.orchestra.run.trial040:> sudo ceph --cluster ceph osd crush tunables default 2026-02-17T04:21:01.702 INFO:teuthology.orchestra.run.trial040.stderr:adjusted tunables profile to default 2026-02-17T04:21:01.711 INFO:tasks.ceph:check_enable_crimson: False 2026-02-17T04:21:01.711 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-17T04:21:01.712 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T04:21:01.712 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-17T04:21:01.737 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T04:21:01.737 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-17T04:21:01.801 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T04:21:01.801 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-17T04:21:01.865 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T04:21:01.865 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-17T04:21:01.929 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T04:21:01.930 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2026-02-17T04:21:01.994 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T04:21:01.995 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2026-02-17T04:21:02.059 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T04:21:02.059 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2026-02-17T04:21:02.124 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T04:21:02.125 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2026-02-17T04:21:02.188 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T04:21:02.188 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/var/lib/ceph/osd/ceph-8/fsid of=/dev/stdout 2026-02-17T04:21:02.253 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T04:21:02.253 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/var/lib/ceph/osd/ceph-9/fsid of=/dev/stdout 2026-02-17T04:21:02.318 DEBUG:teuthology.orchestra.run.trial040:> sudo ceph --cluster ceph osd new 9b681887-684b-44e0-acf6-e5d30335ecb8 0 2026-02-17T04:21:02.403 INFO:tasks.ceph.mgr.x.trial040.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-17T04:21:02.404 INFO:tasks.ceph.mgr.x.trial040.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-17T04:21:02.404 INFO:tasks.ceph.mgr.x.trial040.stderr: from numpy import show_config as show_numpy_config 2026-02-17T04:21:02.461 INFO:teuthology.orchestra.run.trial040.stdout:0 2026-02-17T04:21:02.469 DEBUG:teuthology.orchestra.run.trial040:> sudo ceph --cluster ceph osd new e9ffe230-1fbf-4cb0-a60b-04616c81fb04 1 2026-02-17T04:21:02.569 INFO:teuthology.orchestra.run.trial040.stdout:1 2026-02-17T04:21:02.575 DEBUG:teuthology.orchestra.run.trial040:> sudo ceph --cluster ceph osd new f7462c2d-bfc0-425b-9f80-6e1ba496c5eb 2 2026-02-17T04:21:02.679 INFO:teuthology.orchestra.run.trial040.stdout:2 2026-02-17T04:21:02.688 DEBUG:teuthology.orchestra.run.trial040:> sudo ceph --cluster ceph osd new 883cff36-bdc9-42b5-a441-2c41cbcaa436 3 2026-02-17T04:21:02.789 INFO:teuthology.orchestra.run.trial040.stdout:3 2026-02-17T04:21:02.797 DEBUG:teuthology.orchestra.run.trial040:> sudo ceph --cluster ceph osd new f064d240-a32d-4fc5-b325-b1ee001ae26a 4 2026-02-17T04:21:02.898 INFO:teuthology.orchestra.run.trial040.stdout:4 2026-02-17T04:21:02.906 DEBUG:teuthology.orchestra.run.trial040:> sudo ceph --cluster ceph osd new ed482956-372f-4226-958c-90e7cfb56aa2 5 2026-02-17T04:21:03.010 INFO:teuthology.orchestra.run.trial040.stdout:5 2026-02-17T04:21:03.020 DEBUG:teuthology.orchestra.run.trial040:> sudo ceph --cluster ceph osd new 7452861a-0234-4f3c-a239-d8b337b95edd 6 2026-02-17T04:21:03.123 INFO:teuthology.orchestra.run.trial040.stdout:6 2026-02-17T04:21:03.132 DEBUG:teuthology.orchestra.run.trial040:> sudo ceph --cluster ceph osd new b8767e59-833b-4e55-a19c-e7f9a1f48dd4 7 2026-02-17T04:21:03.235 INFO:teuthology.orchestra.run.trial040.stdout:7 2026-02-17T04:21:03.244 DEBUG:teuthology.orchestra.run.trial040:> sudo ceph --cluster ceph osd new 99853150-03af-45d5-ae45-182cefcf001c 8 2026-02-17T04:21:03.345 INFO:teuthology.orchestra.run.trial040.stdout:8 2026-02-17T04:21:03.354 DEBUG:teuthology.orchestra.run.trial040:> sudo ceph --cluster ceph osd new e15bab05-6ad7-49e7-999c-6fbb6fb16d33 9 2026-02-17T04:21:03.459 INFO:teuthology.orchestra.run.trial040.stdout:9 2026-02-17T04:21:03.467 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-17T04:21:03.467 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-17T04:21:03.470 INFO:tasks.ceph.osd.0:Started 2026-02-17T04:21:03.470 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-17T04:21:03.470 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-02-17T04:21:03.472 INFO:tasks.ceph.osd.1:Started 2026-02-17T04:21:03.472 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-17T04:21:03.473 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2026-02-17T04:21:03.475 INFO:tasks.ceph.osd.2:Started 2026-02-17T04:21:03.475 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-17T04:21:03.475 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2026-02-17T04:21:03.477 INFO:tasks.ceph.osd.3:Started 2026-02-17T04:21:03.477 INFO:tasks.ceph.osd.4:Restarting daemon 2026-02-17T04:21:03.478 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2026-02-17T04:21:03.480 INFO:tasks.ceph.osd.4:Started 2026-02-17T04:21:03.480 INFO:tasks.ceph.osd.5:Restarting daemon 2026-02-17T04:21:03.480 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2026-02-17T04:21:03.482 INFO:tasks.ceph.osd.5:Started 2026-02-17T04:21:03.483 INFO:tasks.ceph.osd.6:Restarting daemon 2026-02-17T04:21:03.483 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2026-02-17T04:21:03.485 INFO:tasks.ceph.osd.6:Started 2026-02-17T04:21:03.485 INFO:tasks.ceph.osd.7:Restarting daemon 2026-02-17T04:21:03.486 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2026-02-17T04:21:03.488 INFO:tasks.ceph.osd.7:Started 2026-02-17T04:21:03.488 INFO:tasks.ceph.osd.8:Restarting daemon 2026-02-17T04:21:03.488 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 8 2026-02-17T04:21:03.490 INFO:tasks.ceph.osd.8:Started 2026-02-17T04:21:03.491 INFO:tasks.ceph.osd.9:Restarting daemon 2026-02-17T04:21:03.491 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 9 2026-02-17T04:21:03.493 INFO:tasks.ceph.osd.9:Started 2026-02-17T04:21:03.493 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T04:21:03.599 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:21:03.599 INFO:teuthology.orchestra.run.trial040.stdout:{"epoch":12,"fsid":"1c4f66e4-59c5-4536-b735-09464fcda99a","created":"2026-02-17T04:21:01.447252+0000","modified":"2026-02-17T04:21:03.458211+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T04:21:03.458211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":10,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9b681887-684b-44e0-acf6-e5d30335ecb8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e9ffe230-1fbf-4cb0-a60b-04616c81fb04","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f7462c2d-bfc0-425b-9f80-6e1ba496c5eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"883cff36-bdc9-42b5-a441-2c41cbcaa436","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f064d240-a32d-4fc5-b325-b1ee001ae26a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ed482956-372f-4226-958c-90e7cfb56aa2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7452861a-0234-4f3c-a239-d8b337b95edd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b8767e59-833b-4e55-a19c-e7f9a1f48dd4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"99853150-03af-45d5-ae45-182cefcf001c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"e15bab05-6ad7-49e7-999c-6fbb6fb16d33","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T04:21:03.606 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-17T04:21:03.606 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-17T04:21:03.728 INFO:tasks.ceph.osd.4.trial040.stderr:2026-02-17T04:21:03.725+0000 7f04c4c38780 -1 Falling back to public interface 2026-02-17T04:21:03.736 INFO:tasks.ceph.osd.0.trial040.stderr:2026-02-17T04:21:03.734+0000 7f2c5240c780 -1 Falling back to public interface 2026-02-17T04:21:03.755 INFO:tasks.ceph.osd.1.trial040.stderr:2026-02-17T04:21:03.753+0000 7f0887a2d780 -1 Falling back to public interface 2026-02-17T04:21:03.756 INFO:tasks.ceph.osd.5.trial040.stderr:2026-02-17T04:21:03.754+0000 7f2da5635780 -1 Falling back to public interface 2026-02-17T04:21:03.759 INFO:tasks.ceph.osd.2.trial040.stderr:2026-02-17T04:21:03.757+0000 7fef69a3b780 -1 Falling back to public interface 2026-02-17T04:21:03.764 INFO:tasks.ceph.osd.3.trial040.stderr:2026-02-17T04:21:03.762+0000 7f99f5271780 -1 Falling back to public interface 2026-02-17T04:21:03.764 INFO:tasks.ceph.osd.8.trial040.stderr:2026-02-17T04:21:03.762+0000 7f4da7462780 -1 Falling back to public interface 2026-02-17T04:21:03.768 INFO:tasks.ceph.osd.6.trial040.stderr:2026-02-17T04:21:03.766+0000 7f3685bd8780 -1 Falling back to public interface 2026-02-17T04:21:03.768 INFO:tasks.ceph.osd.7.trial040.stderr:2026-02-17T04:21:03.766+0000 7fcabf24f780 -1 Falling back to public interface 2026-02-17T04:21:03.784 INFO:tasks.ceph.osd.9.trial040.stderr:2026-02-17T04:21:03.782+0000 7fb214a2f780 -1 Falling back to public interface 2026-02-17T04:21:04.126 INFO:tasks.ceph.osd.4.trial040.stderr:2026-02-17T04:21:04.124+0000 7f04c4c38780 -1 osd.4 0 log_to_monitors true 2026-02-17T04:21:04.138 INFO:tasks.ceph.osd.0.trial040.stderr:2026-02-17T04:21:04.136+0000 7f2c5240c780 -1 osd.0 0 log_to_monitors true 2026-02-17T04:21:04.139 INFO:tasks.ceph.osd.5.trial040.stderr:2026-02-17T04:21:04.136+0000 7f2da5635780 -1 osd.5 0 log_to_monitors true 2026-02-17T04:21:04.143 INFO:tasks.ceph.osd.2.trial040.stderr:2026-02-17T04:21:04.140+0000 7fef69a3b780 -1 osd.2 0 log_to_monitors true 2026-02-17T04:21:04.147 INFO:tasks.ceph.osd.3.trial040.stderr:2026-02-17T04:21:04.145+0000 7f99f5271780 -1 osd.3 0 log_to_monitors true 2026-02-17T04:21:04.168 INFO:tasks.ceph.osd.8.trial040.stderr:2026-02-17T04:21:04.166+0000 7f4da7462780 -1 osd.8 0 log_to_monitors true 2026-02-17T04:21:04.169 INFO:tasks.ceph.osd.7.trial040.stderr:2026-02-17T04:21:04.166+0000 7fcabf24f780 -1 osd.7 0 log_to_monitors true 2026-02-17T04:21:04.173 INFO:tasks.ceph.osd.9.trial040.stderr:2026-02-17T04:21:04.171+0000 7fb214a2f780 -1 osd.9 0 log_to_monitors true 2026-02-17T04:21:04.183 INFO:tasks.ceph.osd.6.trial040.stderr:2026-02-17T04:21:04.181+0000 7f3685bd8780 -1 osd.6 0 log_to_monitors true 2026-02-17T04:21:04.194 INFO:tasks.ceph.osd.1.trial040.stderr:2026-02-17T04:21:04.192+0000 7f0887a2d780 -1 osd.1 0 log_to_monitors true 2026-02-17T04:21:04.612 DEBUG:teuthology.orchestra.run.trial040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T04:21:04.705 INFO:teuthology.misc.health.trial040.stdout: 2026-02-17T04:21:04.705 INFO:teuthology.misc.health.trial040.stdout:{"epoch":12,"fsid":"1c4f66e4-59c5-4536-b735-09464fcda99a","created":"2026-02-17T04:21:01.447252+0000","modified":"2026-02-17T04:21:03.458211+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T04:21:03.458211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":10,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9b681887-684b-44e0-acf6-e5d30335ecb8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e9ffe230-1fbf-4cb0-a60b-04616c81fb04","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f7462c2d-bfc0-425b-9f80-6e1ba496c5eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"883cff36-bdc9-42b5-a441-2c41cbcaa436","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f064d240-a32d-4fc5-b325-b1ee001ae26a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ed482956-372f-4226-958c-90e7cfb56aa2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7452861a-0234-4f3c-a239-d8b337b95edd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b8767e59-833b-4e55-a19c-e7f9a1f48dd4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"99853150-03af-45d5-ae45-182cefcf001c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"e15bab05-6ad7-49e7-999c-6fbb6fb16d33","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T04:21:04.711 DEBUG:teuthology.misc:0 of 10 OSDs are up 2026-02-17T04:21:04.808 INFO:tasks.ceph.mgr.x.trial040.stderr:2026-02-17T04:21:04.806+0000 7f0c1ae87640 -1 mgr.server handle_report got status from non-daemon mon.a 2026-02-17T04:21:05.828 INFO:tasks.ceph.osd.0.trial040.stderr:2026-02-17T04:21:05.826+0000 7f2c4d7f7640 -1 osd.0 0 waiting for initial osdmap 2026-02-17T04:21:05.828 INFO:tasks.ceph.osd.5.trial040.stderr:2026-02-17T04:21:05.826+0000 7f2da05f7640 -1 osd.5 0 waiting for initial osdmap 2026-02-17T04:21:05.828 INFO:tasks.ceph.osd.4.trial040.stderr:2026-02-17T04:21:05.826+0000 7f04bfbf7640 -1 osd.4 0 waiting for initial osdmap 2026-02-17T04:21:05.828 INFO:tasks.ceph.osd.2.trial040.stderr:2026-02-17T04:21:05.826+0000 7fef649f7640 -1 osd.2 0 waiting for initial osdmap 2026-02-17T04:21:05.829 INFO:tasks.ceph.osd.7.trial040.stderr:2026-02-17T04:21:05.826+0000 7fcaba5f7640 -1 osd.7 0 waiting for initial osdmap 2026-02-17T04:21:05.829 INFO:tasks.ceph.osd.3.trial040.stderr:2026-02-17T04:21:05.826+0000 7f99f05f7640 -1 osd.3 0 waiting for initial osdmap 2026-02-17T04:21:05.829 INFO:tasks.ceph.osd.9.trial040.stderr:2026-02-17T04:21:05.826+0000 7fb20f9f7640 -1 osd.9 0 waiting for initial osdmap 2026-02-17T04:21:05.829 INFO:tasks.ceph.osd.8.trial040.stderr:2026-02-17T04:21:05.826+0000 7f4da27f7640 -1 osd.8 0 waiting for initial osdmap 2026-02-17T04:21:05.829 INFO:tasks.ceph.osd.6.trial040.stderr:2026-02-17T04:21:05.827+0000 7f36811f7640 -1 osd.6 0 waiting for initial osdmap 2026-02-17T04:21:05.829 INFO:tasks.ceph.osd.1.trial040.stderr:2026-02-17T04:21:05.827+0000 7f08829f7640 -1 osd.1 0 waiting for initial osdmap 2026-02-17T04:21:05.830 INFO:tasks.ceph.osd.0.trial040.stderr:2026-02-17T04:21:05.828+0000 7f2c457e7640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T04:21:05.830 INFO:tasks.ceph.osd.5.trial040.stderr:2026-02-17T04:21:05.828+0000 7f2d985e7640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T04:21:05.830 INFO:tasks.ceph.osd.2.trial040.stderr:2026-02-17T04:21:05.828+0000 7fef609ef640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T04:21:05.830 INFO:tasks.ceph.osd.3.trial040.stderr:2026-02-17T04:21:05.828+0000 7f99ec532640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T04:21:05.831 INFO:tasks.ceph.osd.4.trial040.stderr:2026-02-17T04:21:05.828+0000 7f04bbbef640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T04:21:05.831 INFO:tasks.ceph.osd.9.trial040.stderr:2026-02-17T04:21:05.829+0000 7fb20b9ef640 -1 osd.9 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T04:21:05.831 INFO:tasks.ceph.osd.8.trial040.stderr:2026-02-17T04:21:05.829+0000 7f4d9e7ef640 -1 osd.8 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T04:21:05.831 INFO:tasks.ceph.osd.7.trial040.stderr:2026-02-17T04:21:05.829+0000 7fcab25e7640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T04:21:05.831 INFO:tasks.ceph.osd.6.trial040.stderr:2026-02-17T04:21:05.829+0000 7f367912a640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T04:21:05.831 INFO:tasks.ceph.osd.1.trial040.stderr:2026-02-17T04:21:05.829+0000 7f087a9e7640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T04:21:11.716 DEBUG:teuthology.orchestra.run.trial040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T04:21:11.886 INFO:teuthology.misc.health.trial040.stdout: 2026-02-17T04:21:11.886 INFO:teuthology.misc.health.trial040.stdout:{"epoch":15,"fsid":"1c4f66e4-59c5-4536-b735-09464fcda99a","created":"2026-02-17T04:21:01.447252+0000","modified":"2026-02-17T04:21:06.824957+0000","last_up_change":"2026-02-17T04:21:06.824957+0000","last_in_change":"2026-02-17T04:21:03.458211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":10,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9b681887-684b-44e0-acf6-e5d30335ecb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6808","nonce":4283234326},{"type":"v1","addr":"10.20.193.40:6809","nonce":4283234326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6810","nonce":4283234326},{"type":"v1","addr":"10.20.193.40:6811","nonce":4283234326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6814","nonce":4283234326},{"type":"v1","addr":"10.20.193.40:6815","nonce":4283234326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6812","nonce":4283234326},{"type":"v1","addr":"10.20.193.40:6813","nonce":4283234326}]},"public_addr":"10.20.193.40:6809/4283234326","cluster_addr":"10.20.193.40:6811/4283234326","heartbeat_back_addr":"10.20.193.40:6815/4283234326","heartbeat_front_addr":"10.20.193.40:6813/4283234326","state":["exists","up"]},{"osd":1,"uuid":"e9ffe230-1fbf-4cb0-a60b-04616c81fb04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6816","nonce":3385366208},{"type":"v1","addr":"10.20.193.40:6817","nonce":3385366208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6818","nonce":3385366208},{"type":"v1","addr":"10.20.193.40:6820","nonce":3385366208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6826","nonce":3385366208},{"type":"v1","addr":"10.20.193.40:6828","nonce":3385366208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6822","nonce":3385366208},{"type":"v1","addr":"10.20.193.40:6824","nonce":3385366208}]},"public_addr":"10.20.193.40:6817/3385366208","cluster_addr":"10.20.193.40:6820/3385366208","heartbeat_back_addr":"10.20.193.40:6828/3385366208","heartbeat_front_addr":"10.20.193.40:6824/3385366208","state":["exists","up"]},{"osd":2,"uuid":"f7462c2d-bfc0-425b-9f80-6e1ba496c5eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6831","nonce":2181329830},{"type":"v1","addr":"10.20.193.40:6833","nonce":2181329830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6834","nonce":2181329830},{"type":"v1","addr":"10.20.193.40:6835","nonce":2181329830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6838","nonce":2181329830},{"type":"v1","addr":"10.20.193.40:6839","nonce":2181329830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6836","nonce":2181329830},{"type":"v1","addr":"10.20.193.40:6837","nonce":2181329830}]},"public_addr":"10.20.193.40:6833/2181329830","cluster_addr":"10.20.193.40:6835/2181329830","heartbeat_back_addr":"10.20.193.40:6839/2181329830","heartbeat_front_addr":"10.20.193.40:6837/2181329830","state":["exists","up"]},{"osd":3,"uuid":"883cff36-bdc9-42b5-a441-2c41cbcaa436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6840","nonce":1295939956},{"type":"v1","addr":"10.20.193.40:6842","nonce":1295939956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6844","nonce":1295939956},{"type":"v1","addr":"10.20.193.40:6846","nonce":1295939956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6854","nonce":1295939956},{"type":"v1","addr":"10.20.193.40:6856","nonce":1295939956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6848","nonce":1295939956},{"type":"v1","addr":"10.20.193.40:6850","nonce":1295939956}]},"public_addr":"10.20.193.40:6842/1295939956","cluster_addr":"10.20.193.40:6846/1295939956","heartbeat_back_addr":"10.20.193.40:6856/1295939956","heartbeat_front_addr":"10.20.193.40:6850/1295939956","state":["exists","up"]},{"osd":4,"uuid":"f064d240-a32d-4fc5-b325-b1ee001ae26a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6800","nonce":638920431},{"type":"v1","addr":"10.20.193.40:6801","nonce":638920431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6802","nonce":638920431},{"type":"v1","addr":"10.20.193.40:6803","nonce":638920431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6806","nonce":638920431},{"type":"v1","addr":"10.20.193.40:6807","nonce":638920431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6804","nonce":638920431},{"type":"v1","addr":"10.20.193.40:6805","nonce":638920431}]},"public_addr":"10.20.193.40:6801/638920431","cluster_addr":"10.20.193.40:6803/638920431","heartbeat_back_addr":"10.20.193.40:6807/638920431","heartbeat_front_addr":"10.20.193.40:6805/638920431","state":["exists","up"]},{"osd":5,"uuid":"ed482956-372f-4226-958c-90e7cfb56aa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6819","nonce":1934147018},{"type":"v1","addr":"10.20.193.40:6821","nonce":1934147018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6823","nonce":1934147018},{"type":"v1","addr":"10.20.193.40:6825","nonce":1934147018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6830","nonce":1934147018},{"type":"v1","addr":"10.20.193.40:6832","nonce":1934147018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6827","nonce":1934147018},{"type":"v1","addr":"10.20.193.40:6829","nonce":1934147018}]},"public_addr":"10.20.193.40:6821/1934147018","cluster_addr":"10.20.193.40:6825/1934147018","heartbeat_back_addr":"10.20.193.40:6832/1934147018","heartbeat_front_addr":"10.20.193.40:6829/1934147018","state":["exists","up"]},{"osd":6,"uuid":"7452861a-0234-4f3c-a239-d8b337b95edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6852","nonce":2694185867},{"type":"v1","addr":"10.20.193.40:6858","nonce":2694185867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6861","nonce":2694185867},{"type":"v1","addr":"10.20.193.40:6863","nonce":2694185867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6868","nonce":2694185867},{"type":"v1","addr":"10.20.193.40:6870","nonce":2694185867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6865","nonce":2694185867},{"type":"v1","addr":"10.20.193.40:6867","nonce":2694185867}]},"public_addr":"10.20.193.40:6858/2694185867","cluster_addr":"10.20.193.40:6863/2694185867","heartbeat_back_addr":"10.20.193.40:6870/2694185867","heartbeat_front_addr":"10.20.193.40:6867/2694185867","state":["exists","up"]},{"osd":7,"uuid":"b8767e59-833b-4e55-a19c-e7f9a1f48dd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6853","nonce":2830531925},{"type":"v1","addr":"10.20.193.40:6857","nonce":2830531925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6860","nonce":2830531925},{"type":"v1","addr":"10.20.193.40:6862","nonce":2830531925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6869","nonce":2830531925},{"type":"v1","addr":"10.20.193.40:6871","nonce":2830531925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6864","nonce":2830531925},{"type":"v1","addr":"10.20.193.40:6866","nonce":2830531925}]},"public_addr":"10.20.193.40:6857/2830531925","cluster_addr":"10.20.193.40:6862/2830531925","heartbeat_back_addr":"10.20.193.40:6871/2830531925","heartbeat_front_addr":"10.20.193.40:6866/2830531925","state":["exists","up"]},{"osd":8,"uuid":"99853150-03af-45d5-ae45-182cefcf001c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6841","nonce":4097151982},{"type":"v1","addr":"10.20.193.40:6843","nonce":4097151982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6845","nonce":4097151982},{"type":"v1","addr":"10.20.193.40:6847","nonce":4097151982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6855","nonce":4097151982},{"type":"v1","addr":"10.20.193.40:6859","nonce":4097151982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6849","nonce":4097151982},{"type":"v1","addr":"10.20.193.40:6851","nonce":4097151982}]},"public_addr":"10.20.193.40:6843/4097151982","cluster_addr":"10.20.193.40:6847/4097151982","heartbeat_back_addr":"10.20.193.40:6859/4097151982","heartbeat_front_addr":"10.20.193.40:6851/4097151982","state":["exists","up"]},{"osd":9,"uuid":"e15bab05-6ad7-49e7-999c-6fbb6fb16d33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6872","nonce":389288580},{"type":"v1","addr":"10.20.193.40:6873","nonce":389288580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6874","nonce":389288580},{"type":"v1","addr":"10.20.193.40:6875","nonce":389288580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6878","nonce":389288580},{"type":"v1","addr":"10.20.193.40:6879","nonce":389288580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6876","nonce":389288580},{"type":"v1","addr":"10.20.193.40:6877","nonce":389288580}]},"public_addr":"10.20.193.40:6873/389288580","cluster_addr":"10.20.193.40:6875/389288580","heartbeat_back_addr":"10.20.193.40:6879/389288580","heartbeat_front_addr":"10.20.193.40:6877/389288580","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T04:21:11.893 DEBUG:teuthology.misc:10 of 10 OSDs are up 2026-02-17T04:21:11.894 INFO:tasks.ceph:Creating RBD pool 2026-02-17T04:21:11.894 DEBUG:teuthology.orchestra.run.trial040:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-17T04:21:12.847 INFO:teuthology.orchestra.run.trial040.stderr:pool 'rbd' created 2026-02-17T04:21:12.858 DEBUG:teuthology.orchestra.run.trial040:> rbd --cluster ceph pool init rbd 2026-02-17T04:21:15.860 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-17T04:21:15.861 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2026-02-17T04:21:15.861 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-17T04:21:16.037 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:21:16.045 INFO:teuthology.orchestra.run.trial040.stdout:[{"version":2,"timestamp":"2026-02-17T04:21:01.489621+0000","name":"","changes":[{"name":"mgr/mgr_pool","new_value":"false"}]}] 2026-02-17T04:21:16.046 INFO:tasks.ceph_manager:config epoch is 2 2026-02-17T04:21:16.046 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-17T04:21:16.046 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-17T04:21:16.046 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-17T04:21:16.253 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:21:16.261 INFO:teuthology.orchestra.run.trial040.stdout:{"epoch":4,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6880","nonce":3147197246},{"type":"v1","addr":"10.20.193.40:6881","nonce":3147197246}]},"active_addr":"10.20.193.40:6881/3147197246","active_change":"2026-02-17T04:21:03.803275+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[],"modules":["iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.40:0","nonce":4109809122}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.40:0","nonce":4098112521}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.40:0","nonce":703184035}]}]} 2026-02-17T04:21:16.265 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-17T04:21:16.265 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-17T04:21:16.265 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T04:21:16.439 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:21:16.439 INFO:teuthology.orchestra.run.trial040.stdout:{"epoch":19,"fsid":"1c4f66e4-59c5-4536-b735-09464fcda99a","created":"2026-02-17T04:21:01.447252+0000","modified":"2026-02-17T04:21:15.850629+0000","last_up_change":"2026-02-17T04:21:06.824957+0000","last_in_change":"2026-02-17T04:21:03.458211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":10,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-17T04:21:12.070856+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":0.89999997615814209,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1.0000001192092896,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b681887-684b-44e0-acf6-e5d30335ecb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6808","nonce":4283234326},{"type":"v1","addr":"10.20.193.40:6809","nonce":4283234326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6810","nonce":4283234326},{"type":"v1","addr":"10.20.193.40:6811","nonce":4283234326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6814","nonce":4283234326},{"type":"v1","addr":"10.20.193.40:6815","nonce":4283234326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6812","nonce":4283234326},{"type":"v1","addr":"10.20.193.40:6813","nonce":4283234326}]},"public_addr":"10.20.193.40:6809/4283234326","cluster_addr":"10.20.193.40:6811/4283234326","heartbeat_back_addr":"10.20.193.40:6815/4283234326","heartbeat_front_addr":"10.20.193.40:6813/4283234326","state":["exists","up"]},{"osd":1,"uuid":"e9ffe230-1fbf-4cb0-a60b-04616c81fb04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6816","nonce":3385366208},{"type":"v1","addr":"10.20.193.40:6817","nonce":3385366208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6818","nonce":3385366208},{"type":"v1","addr":"10.20.193.40:6820","nonce":3385366208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6826","nonce":3385366208},{"type":"v1","addr":"10.20.193.40:6828","nonce":3385366208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6822","nonce":3385366208},{"type":"v1","addr":"10.20.193.40:6824","nonce":3385366208}]},"public_addr":"10.20.193.40:6817/3385366208","cluster_addr":"10.20.193.40:6820/3385366208","heartbeat_back_addr":"10.20.193.40:6828/3385366208","heartbeat_front_addr":"10.20.193.40:6824/3385366208","state":["exists","up"]},{"osd":2,"uuid":"f7462c2d-bfc0-425b-9f80-6e1ba496c5eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6831","nonce":2181329830},{"type":"v1","addr":"10.20.193.40:6833","nonce":2181329830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6834","nonce":2181329830},{"type":"v1","addr":"10.20.193.40:6835","nonce":2181329830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6838","nonce":2181329830},{"type":"v1","addr":"10.20.193.40:6839","nonce":2181329830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6836","nonce":2181329830},{"type":"v1","addr":"10.20.193.40:6837","nonce":2181329830}]},"public_addr":"10.20.193.40:6833/2181329830","cluster_addr":"10.20.193.40:6835/2181329830","heartbeat_back_addr":"10.20.193.40:6839/2181329830","heartbeat_front_addr":"10.20.193.40:6837/2181329830","state":["exists","up"]},{"osd":3,"uuid":"883cff36-bdc9-42b5-a441-2c41cbcaa436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6840","nonce":1295939956},{"type":"v1","addr":"10.20.193.40:6842","nonce":1295939956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6844","nonce":1295939956},{"type":"v1","addr":"10.20.193.40:6846","nonce":1295939956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6854","nonce":1295939956},{"type":"v1","addr":"10.20.193.40:6856","nonce":1295939956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6848","nonce":1295939956},{"type":"v1","addr":"10.20.193.40:6850","nonce":1295939956}]},"public_addr":"10.20.193.40:6842/1295939956","cluster_addr":"10.20.193.40:6846/1295939956","heartbeat_back_addr":"10.20.193.40:6856/1295939956","heartbeat_front_addr":"10.20.193.40:6850/1295939956","state":["exists","up"]},{"osd":4,"uuid":"f064d240-a32d-4fc5-b325-b1ee001ae26a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6800","nonce":638920431},{"type":"v1","addr":"10.20.193.40:6801","nonce":638920431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6802","nonce":638920431},{"type":"v1","addr":"10.20.193.40:6803","nonce":638920431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6806","nonce":638920431},{"type":"v1","addr":"10.20.193.40:6807","nonce":638920431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6804","nonce":638920431},{"type":"v1","addr":"10.20.193.40:6805","nonce":638920431}]},"public_addr":"10.20.193.40:6801/638920431","cluster_addr":"10.20.193.40:6803/638920431","heartbeat_back_addr":"10.20.193.40:6807/638920431","heartbeat_front_addr":"10.20.193.40:6805/638920431","state":["exists","up"]},{"osd":5,"uuid":"ed482956-372f-4226-958c-90e7cfb56aa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6819","nonce":1934147018},{"type":"v1","addr":"10.20.193.40:6821","nonce":1934147018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6823","nonce":1934147018},{"type":"v1","addr":"10.20.193.40:6825","nonce":1934147018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6830","nonce":1934147018},{"type":"v1","addr":"10.20.193.40:6832","nonce":1934147018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6827","nonce":1934147018},{"type":"v1","addr":"10.20.193.40:6829","nonce":1934147018}]},"public_addr":"10.20.193.40:6821/1934147018","cluster_addr":"10.20.193.40:6825/1934147018","heartbeat_back_addr":"10.20.193.40:6832/1934147018","heartbeat_front_addr":"10.20.193.40:6829/1934147018","state":["exists","up"]},{"osd":6,"uuid":"7452861a-0234-4f3c-a239-d8b337b95edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6852","nonce":2694185867},{"type":"v1","addr":"10.20.193.40:6858","nonce":2694185867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6861","nonce":2694185867},{"type":"v1","addr":"10.20.193.40:6863","nonce":2694185867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6868","nonce":2694185867},{"type":"v1","addr":"10.20.193.40:6870","nonce":2694185867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6865","nonce":2694185867},{"type":"v1","addr":"10.20.193.40:6867","nonce":2694185867}]},"public_addr":"10.20.193.40:6858/2694185867","cluster_addr":"10.20.193.40:6863/2694185867","heartbeat_back_addr":"10.20.193.40:6870/2694185867","heartbeat_front_addr":"10.20.193.40:6867/2694185867","state":["exists","up"]},{"osd":7,"uuid":"b8767e59-833b-4e55-a19c-e7f9a1f48dd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6853","nonce":2830531925},{"type":"v1","addr":"10.20.193.40:6857","nonce":2830531925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6860","nonce":2830531925},{"type":"v1","addr":"10.20.193.40:6862","nonce":2830531925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6869","nonce":2830531925},{"type":"v1","addr":"10.20.193.40:6871","nonce":2830531925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6864","nonce":2830531925},{"type":"v1","addr":"10.20.193.40:6866","nonce":2830531925}]},"public_addr":"10.20.193.40:6857/2830531925","cluster_addr":"10.20.193.40:6862/2830531925","heartbeat_back_addr":"10.20.193.40:6871/2830531925","heartbeat_front_addr":"10.20.193.40:6866/2830531925","state":["exists","up"]},{"osd":8,"uuid":"99853150-03af-45d5-ae45-182cefcf001c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6841","nonce":4097151982},{"type":"v1","addr":"10.20.193.40:6843","nonce":4097151982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6845","nonce":4097151982},{"type":"v1","addr":"10.20.193.40:6847","nonce":4097151982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6855","nonce":4097151982},{"type":"v1","addr":"10.20.193.40:6859","nonce":4097151982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6849","nonce":4097151982},{"type":"v1","addr":"10.20.193.40:6851","nonce":4097151982}]},"public_addr":"10.20.193.40:6843/4097151982","cluster_addr":"10.20.193.40:6847/4097151982","heartbeat_back_addr":"10.20.193.40:6859/4097151982","heartbeat_front_addr":"10.20.193.40:6851/4097151982","state":["exists","up"]},{"osd":9,"uuid":"e15bab05-6ad7-49e7-999c-6fbb6fb16d33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6872","nonce":389288580},{"type":"v1","addr":"10.20.193.40:6873","nonce":389288580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6874","nonce":389288580},{"type":"v1","addr":"10.20.193.40:6875","nonce":389288580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6878","nonce":389288580},{"type":"v1","addr":"10.20.193.40:6879","nonce":389288580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6876","nonce":389288580},{"type":"v1","addr":"10.20.193.40:6877","nonce":389288580}]},"public_addr":"10.20.193.40:6873/389288580","cluster_addr":"10.20.193.40:6875/389288580","heartbeat_back_addr":"10.20.193.40:6879/389288580","heartbeat_front_addr":"10.20.193.40:6877/389288580","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T04:21:16.448 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-17T04:21:16.448 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T04:21:16.625 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:21:16.625 INFO:teuthology.orchestra.run.trial040.stdout:{"epoch":19,"fsid":"1c4f66e4-59c5-4536-b735-09464fcda99a","created":"2026-02-17T04:21:01.447252+0000","modified":"2026-02-17T04:21:15.850629+0000","last_up_change":"2026-02-17T04:21:06.824957+0000","last_in_change":"2026-02-17T04:21:03.458211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":10,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-17T04:21:12.070856+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":0.89999997615814209,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1.0000001192092896,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b681887-684b-44e0-acf6-e5d30335ecb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6808","nonce":4283234326},{"type":"v1","addr":"10.20.193.40:6809","nonce":4283234326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6810","nonce":4283234326},{"type":"v1","addr":"10.20.193.40:6811","nonce":4283234326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6814","nonce":4283234326},{"type":"v1","addr":"10.20.193.40:6815","nonce":4283234326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6812","nonce":4283234326},{"type":"v1","addr":"10.20.193.40:6813","nonce":4283234326}]},"public_addr":"10.20.193.40:6809/4283234326","cluster_addr":"10.20.193.40:6811/4283234326","heartbeat_back_addr":"10.20.193.40:6815/4283234326","heartbeat_front_addr":"10.20.193.40:6813/4283234326","state":["exists","up"]},{"osd":1,"uuid":"e9ffe230-1fbf-4cb0-a60b-04616c81fb04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6816","nonce":3385366208},{"type":"v1","addr":"10.20.193.40:6817","nonce":3385366208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6818","nonce":3385366208},{"type":"v1","addr":"10.20.193.40:6820","nonce":3385366208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6826","nonce":3385366208},{"type":"v1","addr":"10.20.193.40:6828","nonce":3385366208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6822","nonce":3385366208},{"type":"v1","addr":"10.20.193.40:6824","nonce":3385366208}]},"public_addr":"10.20.193.40:6817/3385366208","cluster_addr":"10.20.193.40:6820/3385366208","heartbeat_back_addr":"10.20.193.40:6828/3385366208","heartbeat_front_addr":"10.20.193.40:6824/3385366208","state":["exists","up"]},{"osd":2,"uuid":"f7462c2d-bfc0-425b-9f80-6e1ba496c5eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6831","nonce":2181329830},{"type":"v1","addr":"10.20.193.40:6833","nonce":2181329830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6834","nonce":2181329830},{"type":"v1","addr":"10.20.193.40:6835","nonce":2181329830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6838","nonce":2181329830},{"type":"v1","addr":"10.20.193.40:6839","nonce":2181329830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6836","nonce":2181329830},{"type":"v1","addr":"10.20.193.40:6837","nonce":2181329830}]},"public_addr":"10.20.193.40:6833/2181329830","cluster_addr":"10.20.193.40:6835/2181329830","heartbeat_back_addr":"10.20.193.40:6839/2181329830","heartbeat_front_addr":"10.20.193.40:6837/2181329830","state":["exists","up"]},{"osd":3,"uuid":"883cff36-bdc9-42b5-a441-2c41cbcaa436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6840","nonce":1295939956},{"type":"v1","addr":"10.20.193.40:6842","nonce":1295939956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6844","nonce":1295939956},{"type":"v1","addr":"10.20.193.40:6846","nonce":1295939956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6854","nonce":1295939956},{"type":"v1","addr":"10.20.193.40:6856","nonce":1295939956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6848","nonce":1295939956},{"type":"v1","addr":"10.20.193.40:6850","nonce":1295939956}]},"public_addr":"10.20.193.40:6842/1295939956","cluster_addr":"10.20.193.40:6846/1295939956","heartbeat_back_addr":"10.20.193.40:6856/1295939956","heartbeat_front_addr":"10.20.193.40:6850/1295939956","state":["exists","up"]},{"osd":4,"uuid":"f064d240-a32d-4fc5-b325-b1ee001ae26a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6800","nonce":638920431},{"type":"v1","addr":"10.20.193.40:6801","nonce":638920431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6802","nonce":638920431},{"type":"v1","addr":"10.20.193.40:6803","nonce":638920431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6806","nonce":638920431},{"type":"v1","addr":"10.20.193.40:6807","nonce":638920431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6804","nonce":638920431},{"type":"v1","addr":"10.20.193.40:6805","nonce":638920431}]},"public_addr":"10.20.193.40:6801/638920431","cluster_addr":"10.20.193.40:6803/638920431","heartbeat_back_addr":"10.20.193.40:6807/638920431","heartbeat_front_addr":"10.20.193.40:6805/638920431","state":["exists","up"]},{"osd":5,"uuid":"ed482956-372f-4226-958c-90e7cfb56aa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6819","nonce":1934147018},{"type":"v1","addr":"10.20.193.40:6821","nonce":1934147018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6823","nonce":1934147018},{"type":"v1","addr":"10.20.193.40:6825","nonce":1934147018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6830","nonce":1934147018},{"type":"v1","addr":"10.20.193.40:6832","nonce":1934147018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6827","nonce":1934147018},{"type":"v1","addr":"10.20.193.40:6829","nonce":1934147018}]},"public_addr":"10.20.193.40:6821/1934147018","cluster_addr":"10.20.193.40:6825/1934147018","heartbeat_back_addr":"10.20.193.40:6832/1934147018","heartbeat_front_addr":"10.20.193.40:6829/1934147018","state":["exists","up"]},{"osd":6,"uuid":"7452861a-0234-4f3c-a239-d8b337b95edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6852","nonce":2694185867},{"type":"v1","addr":"10.20.193.40:6858","nonce":2694185867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6861","nonce":2694185867},{"type":"v1","addr":"10.20.193.40:6863","nonce":2694185867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6868","nonce":2694185867},{"type":"v1","addr":"10.20.193.40:6870","nonce":2694185867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6865","nonce":2694185867},{"type":"v1","addr":"10.20.193.40:6867","nonce":2694185867}]},"public_addr":"10.20.193.40:6858/2694185867","cluster_addr":"10.20.193.40:6863/2694185867","heartbeat_back_addr":"10.20.193.40:6870/2694185867","heartbeat_front_addr":"10.20.193.40:6867/2694185867","state":["exists","up"]},{"osd":7,"uuid":"b8767e59-833b-4e55-a19c-e7f9a1f48dd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6853","nonce":2830531925},{"type":"v1","addr":"10.20.193.40:6857","nonce":2830531925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6860","nonce":2830531925},{"type":"v1","addr":"10.20.193.40:6862","nonce":2830531925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6869","nonce":2830531925},{"type":"v1","addr":"10.20.193.40:6871","nonce":2830531925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6864","nonce":2830531925},{"type":"v1","addr":"10.20.193.40:6866","nonce":2830531925}]},"public_addr":"10.20.193.40:6857/2830531925","cluster_addr":"10.20.193.40:6862/2830531925","heartbeat_back_addr":"10.20.193.40:6871/2830531925","heartbeat_front_addr":"10.20.193.40:6866/2830531925","state":["exists","up"]},{"osd":8,"uuid":"99853150-03af-45d5-ae45-182cefcf001c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6841","nonce":4097151982},{"type":"v1","addr":"10.20.193.40:6843","nonce":4097151982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6845","nonce":4097151982},{"type":"v1","addr":"10.20.193.40:6847","nonce":4097151982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6855","nonce":4097151982},{"type":"v1","addr":"10.20.193.40:6859","nonce":4097151982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6849","nonce":4097151982},{"type":"v1","addr":"10.20.193.40:6851","nonce":4097151982}]},"public_addr":"10.20.193.40:6843/4097151982","cluster_addr":"10.20.193.40:6847/4097151982","heartbeat_back_addr":"10.20.193.40:6859/4097151982","heartbeat_front_addr":"10.20.193.40:6851/4097151982","state":["exists","up"]},{"osd":9,"uuid":"e15bab05-6ad7-49e7-999c-6fbb6fb16d33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6872","nonce":389288580},{"type":"v1","addr":"10.20.193.40:6873","nonce":389288580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6874","nonce":389288580},{"type":"v1","addr":"10.20.193.40:6875","nonce":389288580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6878","nonce":389288580},{"type":"v1","addr":"10.20.193.40:6879","nonce":389288580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6876","nonce":389288580},{"type":"v1","addr":"10.20.193.40:6877","nonce":389288580}]},"public_addr":"10.20.193.40:6873/389288580","cluster_addr":"10.20.193.40:6875/389288580","heartbeat_back_addr":"10.20.193.40:6879/389288580","heartbeat_front_addr":"10.20.193.40:6877/389288580","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T04:21:16.633 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T04:21:16.634 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T04:21:16.634 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T04:21:16.634 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T04:21:16.634 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2026-02-17T04:21:16.634 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2026-02-17T04:21:16.635 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2026-02-17T04:21:16.635 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2026-02-17T04:21:16.635 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 flush_pg_stats 2026-02-17T04:21:16.635 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 flush_pg_stats 2026-02-17T04:21:16.729 INFO:teuthology.orchestra.run.trial040.stdout:64424509443 2026-02-17T04:21:16.730 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T04:21:16.734 INFO:teuthology.orchestra.run.trial040.stdout:64424509444 2026-02-17T04:21:16.734 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T04:21:16.737 INFO:teuthology.orchestra.run.trial040.stdout:64424509444 2026-02-17T04:21:16.738 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2026-02-17T04:21:16.739 INFO:teuthology.orchestra.run.trial040.stdout:64424509444 2026-02-17T04:21:16.739 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-17T04:21:16.740 INFO:teuthology.orchestra.run.trial040.stdout:64424509443 2026-02-17T04:21:16.741 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T04:21:16.742 INFO:teuthology.orchestra.run.trial040.stdout:64424509443 2026-02-17T04:21:16.742 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-17T04:21:16.743 INFO:teuthology.orchestra.run.trial040.stdout:64424509444 2026-02-17T04:21:16.744 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2026-02-17T04:21:16.745 INFO:teuthology.orchestra.run.trial040.stdout:64424509444 2026-02-17T04:21:16.746 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2026-02-17T04:21:16.747 INFO:teuthology.orchestra.run.trial040.stdout:64424509444 2026-02-17T04:21:16.747 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2026-02-17T04:21:16.748 INFO:teuthology.orchestra.run.trial040.stdout:64424509443 2026-02-17T04:21:16.749 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T04:21:16.918 INFO:teuthology.orchestra.run.trial040.stdout:64424509442 2026-02-17T04:21:16.922 INFO:teuthology.orchestra.run.trial040.stdout:64424509443 2026-02-17T04:21:16.930 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509442 for osd.0 2026-02-17T04:21:16.935 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.1 2026-02-17T04:21:16.979 INFO:teuthology.orchestra.run.trial040.stdout:64424509443 2026-02-17T04:21:16.983 INFO:teuthology.orchestra.run.trial040.stdout:64424509442 2026-02-17T04:21:16.986 INFO:teuthology.orchestra.run.trial040.stdout:64424509442 2026-02-17T04:21:16.990 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.5 2026-02-17T04:21:16.991 INFO:teuthology.orchestra.run.trial040.stdout:64424509443 2026-02-17T04:21:16.994 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509442 for osd.3 2026-02-17T04:21:16.997 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509442 for osd.4 2026-02-17T04:21:17.001 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.6 2026-02-17T04:21:17.022 INFO:teuthology.orchestra.run.trial040.stdout:64424509443 2026-02-17T04:21:17.022 INFO:teuthology.orchestra.run.trial040.stdout:64424509443 2026-02-17T04:21:17.026 INFO:teuthology.orchestra.run.trial040.stdout:64424509443 2026-02-17T04:21:17.027 INFO:teuthology.orchestra.run.trial040.stdout:64424509442 2026-02-17T04:21:17.033 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.7 2026-02-17T04:21:17.034 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.8 2026-02-17T04:21:17.037 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.9 2026-02-17T04:21:17.039 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509442 for osd.2 2026-02-17T04:21:17.930 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T04:21:17.936 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T04:21:17.992 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-17T04:21:17.994 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T04:21:17.997 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-17T04:21:18.002 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2026-02-17T04:21:18.034 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2026-02-17T04:21:18.035 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2026-02-17T04:21:18.038 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2026-02-17T04:21:18.040 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T04:21:18.119 INFO:teuthology.orchestra.run.trial040.stdout:64424509444 2026-02-17T04:21:18.132 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509444 for osd.0 2026-02-17T04:21:18.133 DEBUG:teuthology.parallel:result is None 2026-02-17T04:21:18.164 INFO:teuthology.orchestra.run.trial040.stdout:64424509445 2026-02-17T04:21:18.176 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509445 for osd.1 2026-02-17T04:21:18.177 DEBUG:teuthology.parallel:result is None 2026-02-17T04:21:18.209 INFO:teuthology.orchestra.run.trial040.stdout:64424509444 2026-02-17T04:21:18.211 INFO:teuthology.orchestra.run.trial040.stdout:64424509445 2026-02-17T04:21:18.214 INFO:teuthology.orchestra.run.trial040.stdout:64424509445 2026-02-17T04:21:18.215 INFO:teuthology.orchestra.run.trial040.stdout:64424509444 2026-02-17T04:21:18.220 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509444 for osd.4 2026-02-17T04:21:18.220 DEBUG:teuthology.parallel:result is None 2026-02-17T04:21:18.222 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509445 for osd.5 2026-02-17T04:21:18.223 DEBUG:teuthology.parallel:result is None 2026-02-17T04:21:18.225 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509445 for osd.6 2026-02-17T04:21:18.226 DEBUG:teuthology.parallel:result is None 2026-02-17T04:21:18.227 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509444 for osd.3 2026-02-17T04:21:18.228 DEBUG:teuthology.parallel:result is None 2026-02-17T04:21:18.249 INFO:teuthology.orchestra.run.trial040.stdout:64424509445 2026-02-17T04:21:18.252 INFO:teuthology.orchestra.run.trial040.stdout:64424509445 2026-02-17T04:21:18.255 INFO:teuthology.orchestra.run.trial040.stdout:64424509445 2026-02-17T04:21:18.256 INFO:teuthology.orchestra.run.trial040.stdout:64424509444 2026-02-17T04:21:18.259 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509445 for osd.7 2026-02-17T04:21:18.260 DEBUG:teuthology.parallel:result is None 2026-02-17T04:21:18.263 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509445 for osd.9 2026-02-17T04:21:18.264 DEBUG:teuthology.parallel:result is None 2026-02-17T04:21:18.266 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509445 for osd.8 2026-02-17T04:21:18.266 DEBUG:teuthology.parallel:result is None 2026-02-17T04:21:18.267 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509444 for osd.2 2026-02-17T04:21:18.267 DEBUG:teuthology.parallel:result is None 2026-02-17T04:21:18.267 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-17T04:21:18.268 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T04:21:18.483 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:21:18.484 INFO:teuthology.orchestra.run.trial040.stderr:dumped all 2026-02-17T04:21:18.491 INFO:teuthology.orchestra.run.trial040.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2026-02-17T04:21:17.810164+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":9,"kb":1048576000,"kb_used":271348,"kb_used_data":1748,"kb_used_omap":60,"kb_used_meta":269379,"kb_avail":1048304652,"statfs":{"total":1073741824000,"available":1073463963648,"internally_reserved":0,"allocated":1789952,"data_stored":565683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":61715,"internal_metadata":275844845},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T04:21:16.271420+0000","last_change":"2026-02-17T04:21:16.271420+0000","last_active":"2026-02-17T04:21:16.271420+0000","last_peered":"2026-02-17T04:21:16.271420+0000","last_clean":"2026-02-17T04:21:16.271420+0000","last_became_active":"2026-02-17T04:21:13.851597+0000","last_became_peered":"2026-02-17T04:21:13.851597+0000","last_unstale":"2026-02-17T04:21:16.271420+0000","last_undegraded":"2026-02-17T04:21:16.271420+0000","last_fullsized":"2026-02-17T04:21:16.271420+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T04:43:33.049231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025232899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T04:21:16.271451+0000","last_change":"2026-02-17T04:21:16.271451+0000","last_active":"2026-02-17T04:21:16.271451+0000","last_peered":"2026-02-17T04:21:16.271451+0000","last_clean":"2026-02-17T04:21:16.271451+0000","last_became_active":"2026-02-17T04:21:14.114691+0000","last_became_peered":"2026-02-17T04:21:14.114691+0000","last_unstale":"2026-02-17T04:21:16.271451+0000","last_undegraded":"2026-02-17T04:21:16.271451+0000","last_fullsized":"2026-02-17T04:21:16.271451+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:20:46.722530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028003000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9],"acting":[6,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T04:21:16.271311+0000","last_change":"2026-02-17T04:21:16.271311+0000","last_active":"2026-02-17T04:21:16.271311+0000","last_peered":"2026-02-17T04:21:16.271311+0000","last_clean":"2026-02-17T04:21:16.271311+0000","last_became_active":"2026-02-17T04:21:13.851446+0000","last_became_peered":"2026-02-17T04:21:13.851446+0000","last_unstale":"2026-02-17T04:21:16.271311+0000","last_undegraded":"2026-02-17T04:21:16.271311+0000","last_fullsized":"2026-02-17T04:21:16.271311+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:07:54.794434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017771,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T04:21:15.852799+0000","last_change":"2026-02-17T04:21:15.852799+0000","last_active":"2026-02-17T04:21:15.852799+0000","last_peered":"2026-02-17T04:21:15.852799+0000","last_clean":"2026-02-17T04:21:15.852799+0000","last_became_active":"2026-02-17T04:21:13.851332+0000","last_became_peered":"2026-02-17T04:21:13.851332+0000","last_unstale":"2026-02-17T04:21:15.852799+0000","last_undegraded":"2026-02-17T04:21:15.852799+0000","last_fullsized":"2026-02-17T04:21:15.852799+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T10:10:09.264092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027657400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.3","version":"17'1","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T04:21:16.271308+0000","last_change":"2026-02-17T04:21:16.271308+0000","last_active":"2026-02-17T04:21:16.271308+0000","last_peered":"2026-02-17T04:21:16.271308+0000","last_clean":"2026-02-17T04:21:16.271308+0000","last_became_active":"2026-02-17T04:21:14.279339+0000","last_became_peered":"2026-02-17T04:21:14.279339+0000","last_unstale":"2026-02-17T04:21:16.271308+0000","last_undegraded":"2026-02-17T04:21:16.271308+0000","last_fullsized":"2026-02-17T04:21:16.271308+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T07:13:03.817857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00019194599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.2","version":"19'2","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T04:21:15.854402+0000","last_change":"2026-02-17T04:21:15.854080+0000","last_active":"2026-02-17T04:21:15.854402+0000","last_peered":"2026-02-17T04:21:15.854402+0000","last_clean":"2026-02-17T04:21:15.854402+0000","last_became_active":"2026-02-17T04:21:13.851608+0000","last_became_peered":"2026-02-17T04:21:13.851608+0000","last_unstale":"2026-02-17T04:21:15.854402+0000","last_undegraded":"2026-02-17T04:21:15.854402+0000","last_fullsized":"2026-02-17T04:21:15.854402+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:46:07.583370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066248200000000004,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.1","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T04:21:16.271318+0000","last_change":"2026-02-17T04:21:16.271318+0000","last_active":"2026-02-17T04:21:16.271318+0000","last_peered":"2026-02-17T04:21:16.271318+0000","last_clean":"2026-02-17T04:21:16.271318+0000","last_became_active":"2026-02-17T04:21:13.851437+0000","last_became_peered":"2026-02-17T04:21:13.851437+0000","last_unstale":"2026-02-17T04:21:16.271318+0000","last_undegraded":"2026-02-17T04:21:16.271318+0000","last_fullsized":"2026-02-17T04:21:16.271318+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T07:11:41.051599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000203418,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8],"acting":[5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T04:21:16.271404+0000","last_change":"2026-02-17T04:21:16.271404+0000","last_active":"2026-02-17T04:21:16.271404+0000","last_peered":"2026-02-17T04:21:16.271404+0000","last_clean":"2026-02-17T04:21:16.271404+0000","last_became_active":"2026-02-17T04:21:13.851600+0000","last_became_peered":"2026-02-17T04:21:13.851600+0000","last_unstale":"2026-02-17T04:21:16.271404+0000","last_undegraded":"2026-02-17T04:21:16.271404+0000","last_fullsized":"2026-02-17T04:21:16.271404+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T10:10:09.264092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017854200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27128,"kb_used_data":168,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830472,"statfs":{"total":107374182400,"available":107346403328,"internally_reserved":0,"allocated":172032,"data_stored":53465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6173,"internal_metadata":27584483},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27128,"kb_used_data":168,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830472,"statfs":{"total":107374182400,"available":107346403328,"internally_reserved":0,"allocated":172032,"data_stored":53465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6168,"internal_metadata":27584488},"hb_peers":[0,1,2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27144,"kb_used_data":184,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830456,"statfs":{"total":107374182400,"available":107346386944,"internally_reserved":0,"allocated":188416,"data_stored":59683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6820,"internal_metadata":27583836},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27128,"kb_used_data":168,"kb_used_omap":4,"kb_used_meta":26939,"kb_avail":104830472,"statfs":{"total":107374182400,"available":107346403328,"internally_reserved":0,"allocated":172032,"data_stored":53465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4220,"internal_metadata":27586436},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27128,"kb_used_data":168,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830472,"statfs":{"total":107374182400,"available":107346403328,"internally_reserved":0,"allocated":172032,"data_stored":53465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6168,"internal_metadata":27584488},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27140,"kb_used_data":180,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830460,"statfs":{"total":107374182400,"available":107346391040,"internally_reserved":0,"allocated":184320,"data_stored":59664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6175,"internal_metadata":27584481},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27140,"kb_used_data":180,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830460,"statfs":{"total":107374182400,"available":107346391040,"internally_reserved":0,"allocated":184320,"data_stored":59664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6823,"internal_metadata":27583833},"hb_peers":[0,1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27128,"kb_used_data":168,"kb_used_omap":5,"kb_used_meta":26938,"kb_avail":104830472,"statfs":{"total":107374182400,"available":107346403328,"internally_reserved":0,"allocated":172032,"data_stored":53465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5519,"internal_metadata":27585137},"hb_peers":[0,1,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27140,"kb_used_data":180,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830460,"statfs":{"total":107374182400,"available":107346391040,"internally_reserved":0,"allocated":184320,"data_stored":59664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6824,"internal_metadata":27583832},"hb_peers":[0,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27144,"kb_used_data":184,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830456,"statfs":{"total":107374182400,"available":107346386944,"internally_reserved":0,"allocated":188416,"data_stored":59683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6825,"internal_metadata":27583831},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T04:21:18.493 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T04:21:18.669 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:21:18.669 INFO:teuthology.orchestra.run.trial040.stderr:dumped all 2026-02-17T04:21:18.678 INFO:teuthology.orchestra.run.trial040.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2026-02-17T04:21:17.810164+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":9,"kb":1048576000,"kb_used":271348,"kb_used_data":1748,"kb_used_omap":60,"kb_used_meta":269379,"kb_avail":1048304652,"statfs":{"total":1073741824000,"available":1073463963648,"internally_reserved":0,"allocated":1789952,"data_stored":565683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":61715,"internal_metadata":275844845},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T04:21:16.271420+0000","last_change":"2026-02-17T04:21:16.271420+0000","last_active":"2026-02-17T04:21:16.271420+0000","last_peered":"2026-02-17T04:21:16.271420+0000","last_clean":"2026-02-17T04:21:16.271420+0000","last_became_active":"2026-02-17T04:21:13.851597+0000","last_became_peered":"2026-02-17T04:21:13.851597+0000","last_unstale":"2026-02-17T04:21:16.271420+0000","last_undegraded":"2026-02-17T04:21:16.271420+0000","last_fullsized":"2026-02-17T04:21:16.271420+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T04:43:33.049231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025232899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T04:21:16.271451+0000","last_change":"2026-02-17T04:21:16.271451+0000","last_active":"2026-02-17T04:21:16.271451+0000","last_peered":"2026-02-17T04:21:16.271451+0000","last_clean":"2026-02-17T04:21:16.271451+0000","last_became_active":"2026-02-17T04:21:14.114691+0000","last_became_peered":"2026-02-17T04:21:14.114691+0000","last_unstale":"2026-02-17T04:21:16.271451+0000","last_undegraded":"2026-02-17T04:21:16.271451+0000","last_fullsized":"2026-02-17T04:21:16.271451+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:20:46.722530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028003000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9],"acting":[6,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T04:21:16.271311+0000","last_change":"2026-02-17T04:21:16.271311+0000","last_active":"2026-02-17T04:21:16.271311+0000","last_peered":"2026-02-17T04:21:16.271311+0000","last_clean":"2026-02-17T04:21:16.271311+0000","last_became_active":"2026-02-17T04:21:13.851446+0000","last_became_peered":"2026-02-17T04:21:13.851446+0000","last_unstale":"2026-02-17T04:21:16.271311+0000","last_undegraded":"2026-02-17T04:21:16.271311+0000","last_fullsized":"2026-02-17T04:21:16.271311+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:07:54.794434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017771,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T04:21:15.852799+0000","last_change":"2026-02-17T04:21:15.852799+0000","last_active":"2026-02-17T04:21:15.852799+0000","last_peered":"2026-02-17T04:21:15.852799+0000","last_clean":"2026-02-17T04:21:15.852799+0000","last_became_active":"2026-02-17T04:21:13.851332+0000","last_became_peered":"2026-02-17T04:21:13.851332+0000","last_unstale":"2026-02-17T04:21:15.852799+0000","last_undegraded":"2026-02-17T04:21:15.852799+0000","last_fullsized":"2026-02-17T04:21:15.852799+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T10:10:09.264092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027657400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.3","version":"17'1","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T04:21:16.271308+0000","last_change":"2026-02-17T04:21:16.271308+0000","last_active":"2026-02-17T04:21:16.271308+0000","last_peered":"2026-02-17T04:21:16.271308+0000","last_clean":"2026-02-17T04:21:16.271308+0000","last_became_active":"2026-02-17T04:21:14.279339+0000","last_became_peered":"2026-02-17T04:21:14.279339+0000","last_unstale":"2026-02-17T04:21:16.271308+0000","last_undegraded":"2026-02-17T04:21:16.271308+0000","last_fullsized":"2026-02-17T04:21:16.271308+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T07:13:03.817857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00019194599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.2","version":"19'2","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T04:21:15.854402+0000","last_change":"2026-02-17T04:21:15.854080+0000","last_active":"2026-02-17T04:21:15.854402+0000","last_peered":"2026-02-17T04:21:15.854402+0000","last_clean":"2026-02-17T04:21:15.854402+0000","last_became_active":"2026-02-17T04:21:13.851608+0000","last_became_peered":"2026-02-17T04:21:13.851608+0000","last_unstale":"2026-02-17T04:21:15.854402+0000","last_undegraded":"2026-02-17T04:21:15.854402+0000","last_fullsized":"2026-02-17T04:21:15.854402+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:46:07.583370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066248200000000004,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.1","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T04:21:16.271318+0000","last_change":"2026-02-17T04:21:16.271318+0000","last_active":"2026-02-17T04:21:16.271318+0000","last_peered":"2026-02-17T04:21:16.271318+0000","last_clean":"2026-02-17T04:21:16.271318+0000","last_became_active":"2026-02-17T04:21:13.851437+0000","last_became_peered":"2026-02-17T04:21:13.851437+0000","last_unstale":"2026-02-17T04:21:16.271318+0000","last_undegraded":"2026-02-17T04:21:16.271318+0000","last_fullsized":"2026-02-17T04:21:16.271318+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T07:11:41.051599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000203418,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8],"acting":[5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T04:21:16.271404+0000","last_change":"2026-02-17T04:21:16.271404+0000","last_active":"2026-02-17T04:21:16.271404+0000","last_peered":"2026-02-17T04:21:16.271404+0000","last_clean":"2026-02-17T04:21:16.271404+0000","last_became_active":"2026-02-17T04:21:13.851600+0000","last_became_peered":"2026-02-17T04:21:13.851600+0000","last_unstale":"2026-02-17T04:21:16.271404+0000","last_undegraded":"2026-02-17T04:21:16.271404+0000","last_fullsized":"2026-02-17T04:21:16.271404+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T10:10:09.264092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017854200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27128,"kb_used_data":168,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830472,"statfs":{"total":107374182400,"available":107346403328,"internally_reserved":0,"allocated":172032,"data_stored":53465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6173,"internal_metadata":27584483},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27128,"kb_used_data":168,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830472,"statfs":{"total":107374182400,"available":107346403328,"internally_reserved":0,"allocated":172032,"data_stored":53465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6168,"internal_metadata":27584488},"hb_peers":[0,1,2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27144,"kb_used_data":184,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830456,"statfs":{"total":107374182400,"available":107346386944,"internally_reserved":0,"allocated":188416,"data_stored":59683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6820,"internal_metadata":27583836},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27128,"kb_used_data":168,"kb_used_omap":4,"kb_used_meta":26939,"kb_avail":104830472,"statfs":{"total":107374182400,"available":107346403328,"internally_reserved":0,"allocated":172032,"data_stored":53465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4220,"internal_metadata":27586436},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27128,"kb_used_data":168,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830472,"statfs":{"total":107374182400,"available":107346403328,"internally_reserved":0,"allocated":172032,"data_stored":53465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6168,"internal_metadata":27584488},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27140,"kb_used_data":180,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830460,"statfs":{"total":107374182400,"available":107346391040,"internally_reserved":0,"allocated":184320,"data_stored":59664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6175,"internal_metadata":27584481},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27140,"kb_used_data":180,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830460,"statfs":{"total":107374182400,"available":107346391040,"internally_reserved":0,"allocated":184320,"data_stored":59664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6823,"internal_metadata":27583833},"hb_peers":[0,1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27128,"kb_used_data":168,"kb_used_omap":5,"kb_used_meta":26938,"kb_avail":104830472,"statfs":{"total":107374182400,"available":107346403328,"internally_reserved":0,"allocated":172032,"data_stored":53465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5519,"internal_metadata":27585137},"hb_peers":[0,1,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27140,"kb_used_data":180,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830460,"statfs":{"total":107374182400,"available":107346391040,"internally_reserved":0,"allocated":184320,"data_stored":59664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6824,"internal_metadata":27583832},"hb_peers":[0,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27144,"kb_used_data":184,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830456,"statfs":{"total":107374182400,"available":107346386944,"internally_reserved":0,"allocated":188416,"data_stored":59683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6825,"internal_metadata":27583831},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T04:21:18.679 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-17T04:21:18.680 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-17T04:21:18.680 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-17T04:21:18.680 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T04:21:18.887 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:21:18.888 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-17T04:21:18.897 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-17T04:21:18.897 INFO:teuthology.run_tasks:Running task workunit... 2026-02-17T04:21:18.929 INFO:tasks.workunit:Pulling workunits from ref 325850157d309f65985eea9ec9bb9f1d56726fee 2026-02-17T04:21:18.929 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-17T04:21:18.929 INFO:tasks.workunit:timeout=3h 2026-02-17T04:21:18.929 INFO:tasks.workunit:cleanup=True 2026-02-17T04:21:18.930 DEBUG:teuthology.orchestra.run.trial040:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-17T04:21:18.946 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T04:21:18.947 INFO:teuthology.orchestra.run.trial040.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-17T04:21:18.947 DEBUG:teuthology.orchestra.run.trial040:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-17T04:21:19.004 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-17T04:21:19.004 DEBUG:teuthology.orchestra.run.trial040:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-17T04:21:19.062 DEBUG:teuthology.orchestra.run.trial040:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 325850157d309f65985eea9ec9bb9f1d56726fee 2026-02-17T04:21:19.126 INFO:tasks.workunit.client.0.trial040.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-17T04:21:39.398 INFO:tasks.workunit.client.0.trial040.stderr:Note: switching to '325850157d309f65985eea9ec9bb9f1d56726fee'. 2026-02-17T04:21:39.398 INFO:tasks.workunit.client.0.trial040.stderr: 2026-02-17T04:21:39.398 INFO:tasks.workunit.client.0.trial040.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-17T04:21:39.398 INFO:tasks.workunit.client.0.trial040.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-17T04:21:39.398 INFO:tasks.workunit.client.0.trial040.stderr:state without impacting any branches by switching back to a branch. 2026-02-17T04:21:39.398 INFO:tasks.workunit.client.0.trial040.stderr: 2026-02-17T04:21:39.398 INFO:tasks.workunit.client.0.trial040.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-17T04:21:39.399 INFO:tasks.workunit.client.0.trial040.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-17T04:21:39.399 INFO:tasks.workunit.client.0.trial040.stderr: 2026-02-17T04:21:39.399 INFO:tasks.workunit.client.0.trial040.stderr: git switch -c 2026-02-17T04:21:39.399 INFO:tasks.workunit.client.0.trial040.stderr: 2026-02-17T04:21:39.399 INFO:tasks.workunit.client.0.trial040.stderr:Or undo this operation with: 2026-02-17T04:21:39.399 INFO:tasks.workunit.client.0.trial040.stderr: 2026-02-17T04:21:39.399 INFO:tasks.workunit.client.0.trial040.stderr: git switch - 2026-02-17T04:21:39.399 INFO:tasks.workunit.client.0.trial040.stderr: 2026-02-17T04:21:39.399 INFO:tasks.workunit.client.0.trial040.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-17T04:21:39.399 INFO:tasks.workunit.client.0.trial040.stderr: 2026-02-17T04:21:39.399 INFO:tasks.workunit.client.0.trial040.stderr:HEAD is now at 325850157d3 Merge branch 'issue73891' of https://github.com/bill-scales/ceph into wip-bharath18-testing-2026-02-13-0856 2026-02-17T04:21:39.405 DEBUG:teuthology.orchestra.run.trial040:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-17T04:21:39.463 INFO:tasks.workunit.client.0.trial040.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2026-02-17T04:21:39.465 INFO:tasks.workunit.client.0.trial040.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-17T04:21:39.465 INFO:tasks.workunit.client.0.trial040.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2026-02-17T04:21:39.553 INFO:tasks.workunit.client.0.trial040.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2026-02-17T04:21:39.584 INFO:tasks.workunit.client.0.trial040.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2026-02-17T04:21:39.609 INFO:tasks.workunit.client.0.trial040.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-17T04:21:39.611 INFO:tasks.workunit.client.0.trial040.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-17T04:21:39.611 INFO:tasks.workunit.client.0.trial040.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2026-02-17T04:21:39.637 INFO:tasks.workunit.client.0.trial040.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-17T04:21:39.640 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T04:21:39.641 DEBUG:teuthology.orchestra.run.trial040:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-17T04:21:39.696 INFO:tasks.workunit:Running workunits matching rados/test_health_warnings.sh on client.0... 2026-02-17T04:21:39.697 INFO:tasks.workunit:Running workunit rados/test_health_warnings.sh... 2026-02-17T04:21:39.697 DEBUG:teuthology.orchestra.run.trial040:workunit test rados/test_health_warnings.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=325850157d309f65985eea9ec9bb9f1d56726fee TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_health_warnings.sh 2026-02-17T04:21:39.757 INFO:tasks.workunit.client.0.trial040.stderr:+ crushtool -o crushmap --build --num_osds 10 host straw 2 rack straw 2 row straw 2 root straw 0 2026-02-17T04:21:39.766 INFO:tasks.workunit.client.0.trial040.stderr:+ ceph osd setcrushmap -i crushmap 2026-02-17T04:21:41.457 INFO:tasks.workunit.client.0.trial040.stderr:6 2026-02-17T04:21:41.466 INFO:tasks.workunit.client.0.trial040.stderr:+ ceph osd tree 2026-02-17T04:21:41.676 INFO:tasks.workunit.client.0.trial040.stdout:ID CLASS WEIGHT TYPE NAME STATUS REWEIGHT PRI-AFF 2026-02-17T04:21:41.676 INFO:tasks.workunit.client.0.trial040.stdout:-11 10.00000 root root 2026-02-17T04:21:41.676 INFO:tasks.workunit.client.0.trial040.stdout: -9 8.00000 row row0 2026-02-17T04:21:41.676 INFO:tasks.workunit.client.0.trial040.stdout: -6 4.00000 rack rack0 2026-02-17T04:21:41.676 INFO:tasks.workunit.client.0.trial040.stdout: -1 2.00000 host host0 2026-02-17T04:21:41.676 INFO:tasks.workunit.client.0.trial040.stdout: 0 1.00000 osd.0 up 1.00000 1.00000 2026-02-17T04:21:41.676 INFO:tasks.workunit.client.0.trial040.stdout: 1 1.00000 osd.1 up 1.00000 1.00000 2026-02-17T04:21:41.676 INFO:tasks.workunit.client.0.trial040.stdout: -2 2.00000 host host1 2026-02-17T04:21:41.677 INFO:tasks.workunit.client.0.trial040.stdout: 2 1.00000 osd.2 up 1.00000 1.00000 2026-02-17T04:21:41.677 INFO:tasks.workunit.client.0.trial040.stdout: 3 1.00000 osd.3 up 1.00000 1.00000 2026-02-17T04:21:41.677 INFO:tasks.workunit.client.0.trial040.stdout: -7 4.00000 rack rack1 2026-02-17T04:21:41.677 INFO:tasks.workunit.client.0.trial040.stdout: -3 2.00000 host host2 2026-02-17T04:21:41.677 INFO:tasks.workunit.client.0.trial040.stdout: 4 1.00000 osd.4 up 1.00000 1.00000 2026-02-17T04:21:41.677 INFO:tasks.workunit.client.0.trial040.stdout: 5 1.00000 osd.5 up 1.00000 1.00000 2026-02-17T04:21:41.677 INFO:tasks.workunit.client.0.trial040.stdout: -4 2.00000 host host3 2026-02-17T04:21:41.677 INFO:tasks.workunit.client.0.trial040.stdout: 6 1.00000 osd.6 up 1.00000 1.00000 2026-02-17T04:21:41.677 INFO:tasks.workunit.client.0.trial040.stdout: 7 1.00000 osd.7 up 1.00000 1.00000 2026-02-17T04:21:41.677 INFO:tasks.workunit.client.0.trial040.stdout:-10 2.00000 row row1 2026-02-17T04:21:41.677 INFO:tasks.workunit.client.0.trial040.stdout: -8 2.00000 rack rack2 2026-02-17T04:21:41.677 INFO:tasks.workunit.client.0.trial040.stdout: -5 2.00000 host host4 2026-02-17T04:21:41.678 INFO:tasks.workunit.client.0.trial040.stdout: 8 1.00000 osd.8 up 1.00000 1.00000 2026-02-17T04:21:41.678 INFO:tasks.workunit.client.0.trial040.stdout: 9 1.00000 osd.9 up 1.00000 1.00000 2026-02-17T04:21:41.682 INFO:tasks.workunit.client.0.trial040.stderr:+ ceph tell 'osd.*' injectargs --osd_max_markdown_count 1024 --osd_max_markdown_period 1 2026-02-17T04:21:41.745 INFO:tasks.workunit.client.0.trial040.stdout:osd.0: {} 2026-02-17T04:21:41.761 INFO:tasks.workunit.client.0.trial040.stdout:osd.1: {} 2026-02-17T04:21:41.778 INFO:tasks.workunit.client.0.trial040.stdout:osd.2: {} 2026-02-17T04:21:41.795 INFO:tasks.workunit.client.0.trial040.stdout:osd.3: {} 2026-02-17T04:21:41.812 INFO:tasks.workunit.client.0.trial040.stdout:osd.4: {} 2026-02-17T04:21:41.828 INFO:tasks.workunit.client.0.trial040.stdout:osd.5: {} 2026-02-17T04:21:41.845 INFO:tasks.workunit.client.0.trial040.stdout:osd.6: {} 2026-02-17T04:21:41.862 INFO:tasks.workunit.client.0.trial040.stdout:osd.7: {} 2026-02-17T04:21:41.878 INFO:tasks.workunit.client.0.trial040.stdout:osd.8: {} 2026-02-17T04:21:41.894 INFO:tasks.workunit.client.0.trial040.stdout:osd.9: {} 2026-02-17T04:21:41.900 INFO:tasks.workunit.client.0.trial040.stderr:+ ceph osd set noout 2026-02-17T04:21:43.463 INFO:tasks.workunit.client.0.trial040.stderr:noout is set 2026-02-17T04:21:43.472 INFO:tasks.workunit.client.0.trial040.stderr:+ test_mark_two_osds_same_host_down 2026-02-17T04:21:43.472 INFO:tasks.workunit.client.0.trial040.stderr:+ ceph osd set noup 2026-02-17T04:21:45.465 INFO:tasks.workunit.client.0.trial040.stderr:noup is set 2026-02-17T04:21:45.474 INFO:tasks.workunit.client.0.trial040.stderr:+ ceph osd down osd.0 osd.1 2026-02-17T04:21:45.630 INFO:tasks.ceph.mon.a.trial040.stderr:2026-02-17T04:21:45.629+0000 7f308cff1640 -1 mon.a@0(leader).osd e27 definitely_dead 0 2026-02-17T04:21:46.529 INFO:tasks.ceph.mon.a.trial040.stderr:2026-02-17T04:21:46.528+0000 7f308cff1640 -1 mon.a@0(leader).osd e28 definitely_dead 0 2026-02-17T04:21:46.529 INFO:tasks.workunit.client.0.trial040.stderr:osd.0 is already down. osd.1 is already down. 2026-02-17T04:21:46.537 INFO:tasks.workunit.client.0.trial040.stderr:+ ceph health detail 2026-02-17T04:21:46.835 INFO:tasks.workunit.client.0.trial040.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down 2026-02-17T04:21:46.835 INFO:tasks.workunit.client.0.trial040.stdout:[WRN] OSDMAP_FLAGS: noup,noout flag(s) set 2026-02-17T04:21:46.835 INFO:tasks.workunit.client.0.trial040.stdout:[WRN] OSD_DOWN: 2 osds down 2026-02-17T04:21:46.835 INFO:tasks.workunit.client.0.trial040.stdout: osd.0 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-17T04:21:46.836 INFO:tasks.workunit.client.0.trial040.stdout: osd.1 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-17T04:21:46.836 INFO:tasks.workunit.client.0.trial040.stdout:[WRN] OSD_HOST_DOWN: 1 host (2 osds) down 2026-02-17T04:21:46.836 INFO:tasks.workunit.client.0.trial040.stdout: host host0 (root=root,row=row0,rack=rack0) (2 osds) is down 2026-02-17T04:21:46.844 INFO:tasks.workunit.client.0.trial040.stderr:+ ceph health 2026-02-17T04:21:46.844 INFO:tasks.workunit.client.0.trial040.stderr:+ grep '1 host' 2026-02-17T04:21:47.120 INFO:tasks.workunit.client.0.trial040.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down 2026-02-17T04:21:47.121 INFO:tasks.workunit.client.0.trial040.stderr:+ ceph health 2026-02-17T04:21:47.121 INFO:tasks.workunit.client.0.trial040.stderr:+ grep '2 osds' 2026-02-17T04:21:47.392 INFO:tasks.workunit.client.0.trial040.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down 2026-02-17T04:21:47.393 INFO:tasks.workunit.client.0.trial040.stderr:+ ceph health detail 2026-02-17T04:21:47.393 INFO:tasks.workunit.client.0.trial040.stderr:+ grep osd.0 2026-02-17T04:21:47.701 INFO:tasks.workunit.client.0.trial040.stdout: osd.0 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-17T04:21:47.702 INFO:tasks.workunit.client.0.trial040.stderr:+ ceph health detail 2026-02-17T04:21:47.702 INFO:tasks.workunit.client.0.trial040.stderr:+ grep osd.1 2026-02-17T04:21:47.964 INFO:tasks.ceph.osd.1.trial040.stderr:2026-02-17T04:21:47.963+0000 7f08831f8640 -1 osd.1 29 osdmap NOUP flag is set, waiting for it to clear 2026-02-17T04:21:48.009 INFO:tasks.workunit.client.0.trial040.stdout: osd.1 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-17T04:21:48.009 INFO:tasks.workunit.client.0.trial040.stderr:+ ceph osd unset noup 2026-02-17T04:21:48.473 INFO:tasks.ceph.osd.1.trial040.stderr:2026-02-17T04:21:48.472+0000 7f087a9e7640 -1 osd.1 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T04:21:48.848 INFO:tasks.ceph.osd.0.trial040.stderr:2026-02-17T04:21:48.848+0000 7f2c457e7640 -1 osd.0 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T04:21:49.474 INFO:tasks.workunit.client.0.trial040.stderr:noup is unset 2026-02-17T04:21:49.483 INFO:tasks.workunit.client.0.trial040.stderr:+ wait_for_healthy 2026-02-17T04:21:49.483 INFO:tasks.workunit.client.0.trial040.stderr:+ ceph health 2026-02-17T04:21:49.484 INFO:tasks.workunit.client.0.trial040.stderr:+ grep down 2026-02-17T04:21:49.759 INFO:tasks.workunit.client.0.trial040.stderr:+ test_mark_two_osds_same_rack_down 2026-02-17T04:21:49.760 INFO:tasks.workunit.client.0.trial040.stderr:+ ceph osd set noup 2026-02-17T04:21:51.476 INFO:tasks.workunit.client.0.trial040.stderr:noup is set 2026-02-17T04:21:51.485 INFO:tasks.workunit.client.0.trial040.stderr:+ ceph osd down osd.8 osd.9 2026-02-17T04:21:51.642 INFO:tasks.ceph.mon.a.trial040.stderr:2026-02-17T04:21:51.640+0000 7f308cff1640 -1 mon.a@0(leader).osd e33 definitely_dead 0 2026-02-17T04:21:52.541 INFO:tasks.ceph.mon.a.trial040.stderr:2026-02-17T04:21:52.539+0000 7f308cff1640 -1 mon.a@0(leader).osd e34 definitely_dead 0 2026-02-17T04:21:52.541 INFO:tasks.workunit.client.0.trial040.stderr:osd.8 is already down. osd.9 is already down. 2026-02-17T04:21:52.549 INFO:tasks.workunit.client.0.trial040.stderr:+ ceph health detail 2026-02-17T04:21:52.843 INFO:tasks.workunit.client.0.trial040.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down; 1 rack (2 osds) down; 1 row (2 osds) down 2026-02-17T04:21:52.843 INFO:tasks.workunit.client.0.trial040.stdout:[WRN] OSDMAP_FLAGS: noup,noout flag(s) set 2026-02-17T04:21:52.843 INFO:tasks.workunit.client.0.trial040.stdout:[WRN] OSD_DOWN: 2 osds down 2026-02-17T04:21:52.843 INFO:tasks.workunit.client.0.trial040.stdout: osd.8 (root=root,row=row1,rack=rack2,host=host4) is down 2026-02-17T04:21:52.843 INFO:tasks.workunit.client.0.trial040.stdout: osd.9 (root=root,row=row1,rack=rack2,host=host4) is down 2026-02-17T04:21:52.844 INFO:tasks.workunit.client.0.trial040.stdout:[WRN] OSD_HOST_DOWN: 1 host (2 osds) down 2026-02-17T04:21:52.844 INFO:tasks.workunit.client.0.trial040.stdout: host host4 (root=root,row=row1,rack=rack2) (2 osds) is down 2026-02-17T04:21:52.844 INFO:tasks.workunit.client.0.trial040.stdout:[WRN] OSD_RACK_DOWN: 1 rack (2 osds) down 2026-02-17T04:21:52.844 INFO:tasks.workunit.client.0.trial040.stdout: rack rack2 (root=root,row=row1) (2 osds) is down 2026-02-17T04:21:52.844 INFO:tasks.workunit.client.0.trial040.stdout:[WRN] OSD_ROW_DOWN: 1 row (2 osds) down 2026-02-17T04:21:52.844 INFO:tasks.workunit.client.0.trial040.stdout: row row1 (root=root) (2 osds) is down 2026-02-17T04:21:52.850 INFO:tasks.workunit.client.0.trial040.stderr:+ ceph health 2026-02-17T04:21:52.850 INFO:tasks.workunit.client.0.trial040.stderr:+ grep '1 host' 2026-02-17T04:21:53.124 INFO:tasks.workunit.client.0.trial040.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down; 1 rack (2 osds) down; 1 row (2 osds) down 2026-02-17T04:21:53.124 INFO:tasks.workunit.client.0.trial040.stderr:+ ceph health 2026-02-17T04:21:53.125 INFO:tasks.workunit.client.0.trial040.stderr:+ grep '1 rack' 2026-02-17T04:21:53.395 INFO:tasks.workunit.client.0.trial040.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down; 1 rack (2 osds) down; 1 row (2 osds) down 2026-02-17T04:21:53.395 INFO:tasks.workunit.client.0.trial040.stderr:+ ceph health 2026-02-17T04:21:53.395 INFO:tasks.workunit.client.0.trial040.stderr:+ grep '1 row' 2026-02-17T04:21:53.680 INFO:tasks.workunit.client.0.trial040.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down; 1 rack (2 osds) down; 1 row (2 osds) down 2026-02-17T04:21:53.681 INFO:tasks.workunit.client.0.trial040.stderr:+ ceph health 2026-02-17T04:21:53.681 INFO:tasks.workunit.client.0.trial040.stderr:+ grep '2 osds' 2026-02-17T04:21:53.952 INFO:tasks.workunit.client.0.trial040.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down; 1 rack (2 osds) down; 1 row (2 osds) down 2026-02-17T04:21:53.952 INFO:tasks.workunit.client.0.trial040.stderr:+ ceph health detail 2026-02-17T04:21:53.952 INFO:tasks.workunit.client.0.trial040.stderr:+ grep osd.8 2026-02-17T04:21:54.134 INFO:tasks.ceph.osd.8.trial040.stderr:2026-02-17T04:21:54.132+0000 7f4da2ff8640 -1 osd.8 35 osdmap NOUP flag is set, waiting for it to clear 2026-02-17T04:21:54.256 INFO:tasks.workunit.client.0.trial040.stdout: osd.8 (root=root,row=row1,rack=rack2,host=host4) is down 2026-02-17T04:21:54.257 INFO:tasks.workunit.client.0.trial040.stderr:+ ceph health detail 2026-02-17T04:21:54.257 INFO:tasks.workunit.client.0.trial040.stderr:+ grep osd.9 2026-02-17T04:21:54.485 INFO:tasks.ceph.osd.8.trial040.stderr:2026-02-17T04:21:54.483+0000 7f4d96620640 -1 osd.8 36 osdmap NOUP flag is set, waiting for it to clear 2026-02-17T04:21:54.563 INFO:tasks.workunit.client.0.trial040.stdout: osd.9 (root=root,row=row1,rack=rack2,host=host4) is down 2026-02-17T04:21:54.563 INFO:tasks.workunit.client.0.trial040.stderr:+ ceph osd unset noup 2026-02-17T04:21:55.486 INFO:tasks.ceph.osd.8.trial040.stderr:2026-02-17T04:21:55.484+0000 7f4d9e7ef640 -1 osd.8 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T04:21:56.100 INFO:tasks.ceph.osd.9.trial040.stderr:2026-02-17T04:21:56.098+0000 7fb20b9ef640 -1 osd.9 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T04:21:56.485 INFO:tasks.workunit.client.0.trial040.stderr:noup is unset 2026-02-17T04:21:56.495 INFO:tasks.workunit.client.0.trial040.stderr:+ wait_for_healthy 2026-02-17T04:21:56.495 INFO:tasks.workunit.client.0.trial040.stderr:+ ceph health 2026-02-17T04:21:56.496 INFO:tasks.workunit.client.0.trial040.stderr:+ grep down 2026-02-17T04:21:56.764 INFO:tasks.workunit.client.0.trial040.stderr:+ test_mark_all_but_last_osds_down 2026-02-17T04:21:56.764 INFO:tasks.workunit.client.0.trial040.stderr:+ ceph osd set noup 2026-02-17T04:21:58.491 INFO:tasks.workunit.client.0.trial040.stderr:noup is set 2026-02-17T04:21:58.500 INFO:tasks.workunit.client.0.trial040.stderr:++ ceph osd ls 2026-02-17T04:21:58.500 INFO:tasks.workunit.client.0.trial040.stderr:++ sed '$d' 2026-02-17T04:21:58.721 INFO:tasks.workunit.client.0.trial040.stderr:+ ceph osd down 0 1 2 3 4 5 6 7 8 2026-02-17T04:21:58.882 INFO:tasks.ceph.mon.a.trial040.stderr:2026-02-17T04:21:58.881+0000 7f308cff1640 -1 mon.a@0(leader).osd e40 definitely_dead 0 2026-02-17T04:21:59.554 INFO:tasks.ceph.mon.a.trial040.stderr:2026-02-17T04:21:59.553+0000 7f308cff1640 -1 mon.a@0(leader).osd e41 definitely_dead 0 2026-02-17T04:21:59.555 INFO:tasks.workunit.client.0.trial040.stderr:osd.0 is already down. osd.1 is already down. osd.2 is already down. osd.3 is already down. osd.4 is already down. osd.5 is already down. osd.6 is already down. osd.7 is already down. osd.8 is already down. 2026-02-17T04:21:59.562 INFO:tasks.workunit.client.0.trial040.stderr:+ ceph health detail 2026-02-17T04:21:59.859 INFO:tasks.workunit.client.0.trial040.stdout:HEALTH_WARN noup,noout flag(s) set; 9 osds down; 4 hosts (8 osds) down; 2 racks (8 osds) down; 1 row (8 osds) down 2026-02-17T04:21:59.859 INFO:tasks.workunit.client.0.trial040.stdout:[WRN] OSDMAP_FLAGS: noup,noout flag(s) set 2026-02-17T04:21:59.859 INFO:tasks.workunit.client.0.trial040.stdout:[WRN] OSD_DOWN: 9 osds down 2026-02-17T04:21:59.859 INFO:tasks.workunit.client.0.trial040.stdout: osd.0 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-17T04:21:59.859 INFO:tasks.workunit.client.0.trial040.stdout: osd.1 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-17T04:21:59.859 INFO:tasks.workunit.client.0.trial040.stdout: osd.2 (root=root,row=row0,rack=rack0,host=host1) is down 2026-02-17T04:21:59.859 INFO:tasks.workunit.client.0.trial040.stdout: osd.3 (root=root,row=row0,rack=rack0,host=host1) is down 2026-02-17T04:21:59.859 INFO:tasks.workunit.client.0.trial040.stdout: osd.4 (root=root,row=row0,rack=rack1,host=host2) is down 2026-02-17T04:21:59.859 INFO:tasks.workunit.client.0.trial040.stdout: osd.5 (root=root,row=row0,rack=rack1,host=host2) is down 2026-02-17T04:21:59.859 INFO:tasks.workunit.client.0.trial040.stdout: osd.6 (root=root,row=row0,rack=rack1,host=host3) is down 2026-02-17T04:21:59.859 INFO:tasks.workunit.client.0.trial040.stdout: osd.7 (root=root,row=row0,rack=rack1,host=host3) is down 2026-02-17T04:21:59.860 INFO:tasks.workunit.client.0.trial040.stdout: osd.8 (root=root,row=row1,rack=rack2,host=host4) is down 2026-02-17T04:21:59.860 INFO:tasks.workunit.client.0.trial040.stdout:[WRN] OSD_HOST_DOWN: 4 hosts (8 osds) down 2026-02-17T04:21:59.860 INFO:tasks.workunit.client.0.trial040.stdout: host host0 (root=root,row=row0,rack=rack0) (2 osds) is down 2026-02-17T04:21:59.860 INFO:tasks.workunit.client.0.trial040.stdout: host host1 (root=root,row=row0,rack=rack0) (2 osds) is down 2026-02-17T04:21:59.860 INFO:tasks.workunit.client.0.trial040.stdout: host host2 (root=root,row=row0,rack=rack1) (2 osds) is down 2026-02-17T04:21:59.860 INFO:tasks.workunit.client.0.trial040.stdout: host host3 (root=root,row=row0,rack=rack1) (2 osds) is down 2026-02-17T04:21:59.860 INFO:tasks.workunit.client.0.trial040.stdout:[WRN] OSD_RACK_DOWN: 2 racks (8 osds) down 2026-02-17T04:21:59.860 INFO:tasks.workunit.client.0.trial040.stdout: rack rack0 (root=root,row=row0) (4 osds) is down 2026-02-17T04:21:59.860 INFO:tasks.workunit.client.0.trial040.stdout: rack rack1 (root=root,row=row0) (4 osds) is down 2026-02-17T04:21:59.860 INFO:tasks.workunit.client.0.trial040.stdout:[WRN] OSD_ROW_DOWN: 1 row (8 osds) down 2026-02-17T04:21:59.860 INFO:tasks.workunit.client.0.trial040.stdout: row row0 (root=root) (8 osds) is down 2026-02-17T04:21:59.866 INFO:tasks.workunit.client.0.trial040.stderr:+ ceph health 2026-02-17T04:21:59.866 INFO:tasks.workunit.client.0.trial040.stderr:+ grep '1 row' 2026-02-17T04:22:00.109 INFO:tasks.ceph.osd.8.trial040.stderr:2026-02-17T04:22:00.108+0000 7f4da27f7640 -1 osd.8 41 osdmap NOUP flag is set, waiting for it to clear 2026-02-17T04:22:00.135 INFO:tasks.workunit.client.0.trial040.stdout:HEALTH_WARN noup,noout flag(s) set; 9 osds down; 4 hosts (8 osds) down; 2 racks (8 osds) down; 1 row (8 osds) down 2026-02-17T04:22:00.136 INFO:tasks.workunit.client.0.trial040.stderr:+ ceph health 2026-02-17T04:22:00.136 INFO:tasks.workunit.client.0.trial040.stderr:+ grep '2 racks' 2026-02-17T04:22:00.200 INFO:tasks.ceph.osd.5.trial040.stderr:2026-02-17T04:22:00.199+0000 7f2da0df8640 -1 osd.5 41 osdmap NOUP flag is set, waiting for it to clear 2026-02-17T04:22:00.416 INFO:tasks.workunit.client.0.trial040.stdout:HEALTH_WARN noup,noout flag(s) set; 9 osds down; 4 hosts (8 osds) down; 2 racks (8 osds) down; 1 row (8 osds) down 2026-02-17T04:22:00.416 INFO:tasks.workunit.client.0.trial040.stderr:+ ceph health 2026-02-17T04:22:00.417 INFO:tasks.workunit.client.0.trial040.stderr:+ grep '4 hosts' 2026-02-17T04:22:00.496 INFO:tasks.ceph.osd.8.trial040.stderr:2026-02-17T04:22:00.494+0000 7f4d96620640 -1 osd.8 42 osdmap NOUP flag is set, waiting for it to clear 2026-02-17T04:22:00.496 INFO:tasks.ceph.osd.5.trial040.stderr:2026-02-17T04:22:00.495+0000 7f2d903e4640 -1 osd.5 42 osdmap NOUP flag is set, waiting for it to clear 2026-02-17T04:22:00.686 INFO:tasks.workunit.client.0.trial040.stdout:HEALTH_WARN noup,noout flag(s) set; 9 osds down; 4 hosts (8 osds) down; 2 racks (8 osds) down; 1 row (8 osds) down 2026-02-17T04:22:00.687 INFO:tasks.workunit.client.0.trial040.stderr:+ ceph health 2026-02-17T04:22:00.687 INFO:tasks.workunit.client.0.trial040.stderr:+ grep '9 osds' 2026-02-17T04:22:00.704 INFO:tasks.ceph.osd.7.trial040.stderr:2026-02-17T04:22:00.703+0000 7fcabadf8640 -1 osd.7 42 osdmap NOUP flag is set, waiting for it to clear 2026-02-17T04:22:00.964 INFO:tasks.workunit.client.0.trial040.stdout:HEALTH_WARN noup,noout flag(s) set; 9 osds down; 4 hosts (8 osds) down; 2 racks (8 osds) down; 1 row (8 osds) down 2026-02-17T04:22:00.964 INFO:tasks.workunit.client.0.trial040.stderr:+ ceph osd unset noup 2026-02-17T04:22:00.983 INFO:tasks.ceph.osd.1.trial040.stderr:2026-02-17T04:22:00.982+0000 7f08829f7640 -1 osd.1 42 osdmap NOUP flag is set, waiting for it to clear 2026-02-17T04:22:01.173 INFO:tasks.ceph.osd.6.trial040.stderr:2026-02-17T04:22:01.172+0000 7f36819f8640 -1 osd.6 42 osdmap NOUP flag is set, waiting for it to clear 2026-02-17T04:22:01.317 INFO:tasks.ceph.osd.4.trial040.stderr:2026-02-17T04:22:01.316+0000 7f04c03f8640 -1 osd.4 42 osdmap NOUP flag is set, waiting for it to clear 2026-02-17T04:22:01.406 INFO:tasks.ceph.osd.2.trial040.stderr:2026-02-17T04:22:01.404+0000 7fef651f8640 -1 osd.2 42 osdmap NOUP flag is set, waiting for it to clear 2026-02-17T04:22:01.499 INFO:tasks.ceph.osd.5.trial040.stderr:2026-02-17T04:22:01.497+0000 7f2d985e7640 -1 osd.5 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T04:22:01.499 INFO:tasks.ceph.osd.1.trial040.stderr:2026-02-17T04:22:01.497+0000 7f087a9e7640 -1 osd.1 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T04:22:01.500 INFO:tasks.ceph.osd.2.trial040.stderr:2026-02-17T04:22:01.497+0000 7fef609ef640 -1 osd.2 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T04:22:01.500 INFO:tasks.ceph.osd.4.trial040.stderr:2026-02-17T04:22:01.497+0000 7f04bbbef640 -1 osd.4 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T04:22:01.500 INFO:tasks.ceph.osd.6.trial040.stderr:2026-02-17T04:22:01.497+0000 7f367912a640 -1 osd.6 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T04:22:01.501 INFO:tasks.ceph.osd.7.trial040.stderr:2026-02-17T04:22:01.497+0000 7fcab25e7640 -1 osd.7 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T04:22:01.501 INFO:tasks.ceph.osd.8.trial040.stderr:2026-02-17T04:22:01.497+0000 7f4d9e7ef640 -1 osd.8 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T04:22:01.527 INFO:tasks.ceph.osd.3.trial040.stderr:2026-02-17T04:22:01.525+0000 7f99ec532640 -1 osd.3 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T04:22:01.859 INFO:tasks.ceph.osd.0.trial040.stderr:2026-02-17T04:22:01.858+0000 7f2c457e7640 -1 osd.0 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T04:22:02.499 INFO:tasks.workunit.client.0.trial040.stderr:noup is unset 2026-02-17T04:22:02.510 INFO:tasks.workunit.client.0.trial040.stderr:+ wait_for_healthy 2026-02-17T04:22:02.511 INFO:tasks.workunit.client.0.trial040.stderr:+ ceph health 2026-02-17T04:22:02.511 INFO:tasks.workunit.client.0.trial040.stderr:+ grep down 2026-02-17T04:22:02.784 INFO:tasks.workunit.client.0.trial040.stderr:+ test_mark_two_osds_same_host_down_with_classes 2026-02-17T04:22:02.784 INFO:tasks.workunit.client.0.trial040.stderr:+ ceph osd set noup 2026-02-17T04:22:03.816 INFO:tasks.ceph.mgr.x.trial040.stderr:2026-02-17T04:22:03.814+0000 7f0c1567c640 -1 calc_pg_upmaps abort due to max <= 0 2026-02-17T04:22:04.506 INFO:tasks.workunit.client.0.trial040.stderr:noup is set 2026-02-17T04:22:04.516 INFO:tasks.workunit.client.0.trial040.stderr:+ ceph osd crush set-device-class ssd osd.0 osd.2 osd.4 osd.6 osd.8 2026-02-17T04:22:06.510 INFO:tasks.workunit.client.0.trial040.stderr:osd.0 already set to class ssd. set-device-class item id 0 name 'osd.0' device_class 'ssd': no change. osd.2 already set to class ssd. set-device-class item id 2 name 'osd.2' device_class 'ssd': no change. osd.4 already set to class ssd. set-device-class item id 4 name 'osd.4' device_class 'ssd': no change. osd.6 already set to class ssd. set-device-class item id 6 name 'osd.6' device_class 'ssd': no change. osd.8 already set to class ssd. set-device-class item id 8 name 'osd.8' device_class 'ssd': no change. set osd(s) to class 'ssd' 2026-02-17T04:22:06.518 INFO:tasks.workunit.client.0.trial040.stderr:+ ceph osd crush set-device-class hdd osd.1 osd.3 osd.5 osd.7 osd.9 2026-02-17T04:22:08.514 INFO:tasks.workunit.client.0.trial040.stderr:osd.1 already set to class hdd. set-device-class item id 1 name 'osd.1' device_class 'hdd': no change. osd.3 already set to class hdd. set-device-class item id 3 name 'osd.3' device_class 'hdd': no change. osd.5 already set to class hdd. set-device-class item id 5 name 'osd.5' device_class 'hdd': no change. osd.7 already set to class hdd. set-device-class item id 7 name 'osd.7' device_class 'hdd': no change. osd.9 already set to class hdd. set-device-class item id 9 name 'osd.9' device_class 'hdd': no change. set osd(s) to class 'hdd' 2026-02-17T04:22:08.523 INFO:tasks.workunit.client.0.trial040.stderr:+ ceph osd down osd.0 osd.1 2026-02-17T04:22:08.680 INFO:tasks.ceph.mon.a.trial040.stderr:2026-02-17T04:22:08.679+0000 7f308cff1640 -1 mon.a@0(leader).osd e50 definitely_dead 0 2026-02-17T04:22:09.582 INFO:tasks.ceph.mon.a.trial040.stderr:2026-02-17T04:22:09.581+0000 7f308cff1640 -1 mon.a@0(leader).osd e51 definitely_dead 0 2026-02-17T04:22:09.583 INFO:tasks.workunit.client.0.trial040.stderr:osd.0 is already down. osd.1 is already down. 2026-02-17T04:22:09.591 INFO:tasks.workunit.client.0.trial040.stderr:+ ceph health detail 2026-02-17T04:22:09.838 INFO:tasks.ceph.osd.0.trial040.stderr:2026-02-17T04:22:09.837+0000 7f2c4dff8640 -1 osd.0 51 osdmap NOUP flag is set, waiting for it to clear 2026-02-17T04:22:09.887 INFO:tasks.workunit.client.0.trial040.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down 2026-02-17T04:22:09.887 INFO:tasks.workunit.client.0.trial040.stdout:[WRN] OSDMAP_FLAGS: noup,noout flag(s) set 2026-02-17T04:22:09.887 INFO:tasks.workunit.client.0.trial040.stdout:[WRN] OSD_DOWN: 2 osds down 2026-02-17T04:22:09.887 INFO:tasks.workunit.client.0.trial040.stdout: osd.0 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-17T04:22:09.887 INFO:tasks.workunit.client.0.trial040.stdout: osd.1 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-17T04:22:09.887 INFO:tasks.workunit.client.0.trial040.stdout:[WRN] OSD_HOST_DOWN: 1 host (2 osds) down 2026-02-17T04:22:09.887 INFO:tasks.workunit.client.0.trial040.stdout: host host0 (root=root,row=row0,rack=rack0) (2 osds) is down 2026-02-17T04:22:09.896 INFO:tasks.workunit.client.0.trial040.stderr:+ ceph health 2026-02-17T04:22:09.896 INFO:tasks.workunit.client.0.trial040.stderr:+ grep '1 host' 2026-02-17T04:22:09.979 INFO:tasks.ceph.osd.1.trial040.stderr:2026-02-17T04:22:09.978+0000 7f08831f8640 -1 osd.1 51 osdmap NOUP flag is set, waiting for it to clear 2026-02-17T04:22:10.181 INFO:tasks.workunit.client.0.trial040.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down 2026-02-17T04:22:10.182 INFO:tasks.workunit.client.0.trial040.stderr:+ ceph health 2026-02-17T04:22:10.182 INFO:tasks.workunit.client.0.trial040.stderr:+ grep '2 osds' 2026-02-17T04:22:10.467 INFO:tasks.workunit.client.0.trial040.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down 2026-02-17T04:22:10.468 INFO:tasks.workunit.client.0.trial040.stderr:+ ceph health detail 2026-02-17T04:22:10.468 INFO:tasks.workunit.client.0.trial040.stderr:+ grep osd.0 2026-02-17T04:22:10.520 INFO:tasks.ceph.osd.0.trial040.stderr:2026-02-17T04:22:10.519+0000 7f2c3d5e3640 -1 osd.0 52 osdmap NOUP flag is set, waiting for it to clear 2026-02-17T04:22:10.521 INFO:tasks.ceph.osd.1.trial040.stderr:2026-02-17T04:22:10.519+0000 7f08727b8640 -1 osd.1 52 osdmap NOUP flag is set, waiting for it to clear 2026-02-17T04:22:10.773 INFO:tasks.workunit.client.0.trial040.stdout: osd.0 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-17T04:22:10.774 INFO:tasks.workunit.client.0.trial040.stderr:+ ceph health detail 2026-02-17T04:22:10.774 INFO:tasks.workunit.client.0.trial040.stderr:+ grep osd.1 2026-02-17T04:22:11.078 INFO:tasks.workunit.client.0.trial040.stdout: osd.1 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-17T04:22:11.078 INFO:tasks.workunit.client.0.trial040.stderr:+ ceph osd unset noup 2026-02-17T04:22:11.522 INFO:tasks.ceph.osd.1.trial040.stderr:2026-02-17T04:22:11.520+0000 7f087a9e7640 -1 osd.1 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T04:22:11.522 INFO:tasks.ceph.osd.0.trial040.stderr:2026-02-17T04:22:11.520+0000 7f2c457e7640 -1 osd.0 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T04:22:12.521 INFO:tasks.workunit.client.0.trial040.stderr:noup is unset 2026-02-17T04:22:12.532 INFO:tasks.workunit.client.0.trial040.stderr:+ wait_for_healthy 2026-02-17T04:22:12.533 INFO:tasks.workunit.client.0.trial040.stderr:+ ceph health 2026-02-17T04:22:12.533 INFO:tasks.workunit.client.0.trial040.stderr:+ grep down 2026-02-17T04:22:12.806 INFO:tasks.workunit.client.0.trial040.stderr:+ exit 0 2026-02-17T04:22:12.806 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-17T04:22:12.806 DEBUG:teuthology.orchestra.run.trial040:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T04:22:12.872 INFO:tasks.workunit:Stopping ['rados/test_health_warnings.sh'] on client.0... 2026-02-17T04:22:12.873 DEBUG:teuthology.orchestra.run.trial040:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-17T04:22:13.227 DEBUG:teuthology.parallel:result is None 2026-02-17T04:22:13.228 DEBUG:teuthology.orchestra.run.trial040:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2026-02-17T04:22:13.252 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2026-02-17T04:22:13.252 DEBUG:teuthology.orchestra.run.trial040:> rmdir -- /home/ubuntu/cephtest/mnt.0 2026-02-17T04:22:13.309 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2026-02-17T04:22:13.309 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-17T04:22:13.384 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-17T04:22:13.384 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T04:22:13.565 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:22:13.565 INFO:teuthology.orchestra.run.trial040.stderr:dumped all 2026-02-17T04:22:13.575 INFO:teuthology.orchestra.run.trial040.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2026-02-17T04:22:13.527426+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":275368,"kb_used_data":5768,"kb_used_omap":240,"kb_used_meta":269199,"kb_avail":1048300632,"statfs":{"total":1073741824000,"available":1073459847168,"internally_reserved":0,"allocated":5906432,"data_stored":2791718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":246168,"internal_metadata":275660392},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.010460"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":67,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-17T04:22:11.520798+0000","last_change":"2026-02-17T04:22:03.505832+0000","last_active":"2026-02-17T04:22:11.520798+0000","last_peered":"2026-02-17T04:22:11.520798+0000","last_clean":"2026-02-17T04:22:11.520798+0000","last_became_active":"2026-02-17T04:22:03.505690+0000","last_became_peered":"2026-02-17T04:22:03.505690+0000","last_unstale":"2026-02-17T04:22:11.520798+0000","last_undegraded":"2026-02-17T04:22:11.520798+0000","last_fullsized":"2026-02-17T04:22:11.520798+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T08:19:43.881417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025232899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":91,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-17T04:22:11.739532+0000","last_change":"2026-02-17T04:22:03.505870+0000","last_active":"2026-02-17T04:22:11.739532+0000","last_peered":"2026-02-17T04:22:11.739532+0000","last_clean":"2026-02-17T04:22:11.739532+0000","last_became_active":"2026-02-17T04:22:03.505662+0000","last_became_peered":"2026-02-17T04:22:03.505662+0000","last_unstale":"2026-02-17T04:22:11.739532+0000","last_undegraded":"2026-02-17T04:22:11.739532+0000","last_fullsized":"2026-02-17T04:22:11.739532+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T07:53:41.824771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028003000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":93,"reported_epoch":53,"state":"active+undersized","last_fresh":"2026-02-17T04:22:11.520803+0000","last_change":"2026-02-17T04:22:10.521061+0000","last_active":"2026-02-17T04:22:11.520803+0000","last_peered":"2026-02-17T04:22:11.520803+0000","last_clean":"2026-02-17T04:22:08.883757+0000","last_became_active":"2026-02-17T04:22:10.521061+0000","last_became_peered":"2026-02-17T04:22:10.521061+0000","last_unstale":"2026-02-17T04:22:11.520803+0000","last_undegraded":"2026-02-17T04:22:11.520803+0000","last_fullsized":"2026-02-17T04:22:10.520855+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:18:17.660542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017771,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9],"acting":[9],"avail_no_missing":["9"],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+undersized","last_fresh":"2026-02-17T04:22:11.739574+0000","last_change":"2026-02-17T04:22:10.520580+0000","last_active":"2026-02-17T04:22:11.739574+0000","last_peered":"2026-02-17T04:22:11.739574+0000","last_clean":"2026-02-17T04:21:58.546710+0000","last_became_active":"2026-02-17T04:22:10.520580+0000","last_became_peered":"2026-02-17T04:22:10.520580+0000","last_unstale":"2026-02-17T04:22:11.739574+0000","last_undegraded":"2026-02-17T04:22:11.739574+0000","last_fullsized":"2026-02-17T04:22:10.520257+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T05:27:54.532402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6],"acting":[6],"avail_no_missing":["6"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.3","version":"17'1","reported_seq":82,"reported_epoch":53,"state":"active+undersized+degraded","last_fresh":"2026-02-17T04:22:11.520817+0000","last_change":"2026-02-17T04:22:10.521031+0000","last_active":"2026-02-17T04:22:11.520817+0000","last_peered":"2026-02-17T04:22:11.520817+0000","last_clean":"2026-02-17T04:22:09.518186+0000","last_became_active":"2026-02-17T04:22:10.521031+0000","last_became_peered":"2026-02-17T04:22:10.521031+0000","last_unstale":"2026-02-17T04:22:11.520817+0000","last_undegraded":"2026-02-17T04:22:10.520865+0000","last_fullsized":"2026-02-17T04:22:10.520831+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T09:23:22.377283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":1}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"19'2","reported_seq":89,"reported_epoch":53,"state":"active+undersized+degraded","last_fresh":"2026-02-17T04:22:11.739293+0000","last_change":"2026-02-17T04:22:10.521145+0000","last_active":"2026-02-17T04:22:11.739293+0000","last_peered":"2026-02-17T04:22:11.739293+0000","last_clean":"2026-02-17T04:22:09.848271+0000","last_became_active":"2026-02-17T04:22:10.521145+0000","last_became_peered":"2026-02-17T04:22:10.521145+0000","last_unstale":"2026-02-17T04:22:11.739293+0000","last_undegraded":"2026-02-17T04:22:10.520884+0000","last_fullsized":"2026-02-17T04:22:10.520843+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:15:24.711990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066248200000000004,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":1}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":67,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-17T04:22:11.739425+0000","last_change":"2026-02-17T04:22:03.505824+0000","last_active":"2026-02-17T04:22:11.739425+0000","last_peered":"2026-02-17T04:22:11.739425+0000","last_clean":"2026-02-17T04:22:11.739425+0000","last_became_active":"2026-02-17T04:22:03.505709+0000","last_became_peered":"2026-02-17T04:22:03.505709+0000","last_unstale":"2026-02-17T04:22:11.739425+0000","last_undegraded":"2026-02-17T04:22:11.739425+0000","last_fullsized":"2026-02-17T04:22:11.739425+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:34:03.058654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000203418,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":81,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-17T04:22:11.739533+0000","last_change":"2026-02-17T04:22:03.505939+0000","last_active":"2026-02-17T04:22:11.739533+0000","last_peered":"2026-02-17T04:22:11.739533+0000","last_clean":"2026-02-17T04:22:11.739533+0000","last_became_active":"2026-02-17T04:22:03.505839+0000","last_became_peered":"2026-02-17T04:22:03.505839+0000","last_unstale":"2026-02-17T04:22:11.739533+0000","last_undegraded":"2026-02-17T04:22:11.739533+0000","last_fullsized":"2026-02-17T04:22:11.739533+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T06:01:02.501503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":38,"seq":163208757264,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25794,"internal_metadata":27564862},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":44,"seq":188978561040,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25789,"internal_metadata":27564867},"hb_peers":[2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":44,"seq":188978561040,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":22,"kb_used_meta":26921,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23180,"internal_metadata":27567476},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561040,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25788,"internal_metadata":27564868},"hb_peers":[2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":44,"seq":188978561040,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27742,"internal_metadata":27562914},"hb_peers":[2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":44,"seq":188978561039,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27540,"kb_used_data":580,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":104830060,"statfs":{"total":107374182400,"available":107345981440,"internally_reserved":0,"allocated":593920,"data_stored":279187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27091,"internal_metadata":27563565},"hb_peers":[2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":44,"seq":188978561039,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":24,"kb_used_meta":26919,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25136,"internal_metadata":27565520},"hb_peers":[2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":44,"seq":188978561039,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26440,"internal_metadata":27564216},"hb_peers":[3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":0,"seq":16,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27540,"kb_used_data":580,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830060,"statfs":{"total":107374182400,"available":107345981440,"internally_reserved":0,"allocated":593920,"data_stored":279187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25788,"internal_metadata":27564868},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":0,"seq":15,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13420,"internal_metadata":27577236},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T04:22:13.576 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T04:22:13.753 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:22:13.754 INFO:teuthology.orchestra.run.trial040.stderr:dumped all 2026-02-17T04:22:13.762 INFO:teuthology.orchestra.run.trial040.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2026-02-17T04:22:13.527426+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":275368,"kb_used_data":5768,"kb_used_omap":240,"kb_used_meta":269199,"kb_avail":1048300632,"statfs":{"total":1073741824000,"available":1073459847168,"internally_reserved":0,"allocated":5906432,"data_stored":2791718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":246168,"internal_metadata":275660392},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.010460"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":67,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-17T04:22:11.520798+0000","last_change":"2026-02-17T04:22:03.505832+0000","last_active":"2026-02-17T04:22:11.520798+0000","last_peered":"2026-02-17T04:22:11.520798+0000","last_clean":"2026-02-17T04:22:11.520798+0000","last_became_active":"2026-02-17T04:22:03.505690+0000","last_became_peered":"2026-02-17T04:22:03.505690+0000","last_unstale":"2026-02-17T04:22:11.520798+0000","last_undegraded":"2026-02-17T04:22:11.520798+0000","last_fullsized":"2026-02-17T04:22:11.520798+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T08:19:43.881417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025232899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":91,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-17T04:22:11.739532+0000","last_change":"2026-02-17T04:22:03.505870+0000","last_active":"2026-02-17T04:22:11.739532+0000","last_peered":"2026-02-17T04:22:11.739532+0000","last_clean":"2026-02-17T04:22:11.739532+0000","last_became_active":"2026-02-17T04:22:03.505662+0000","last_became_peered":"2026-02-17T04:22:03.505662+0000","last_unstale":"2026-02-17T04:22:11.739532+0000","last_undegraded":"2026-02-17T04:22:11.739532+0000","last_fullsized":"2026-02-17T04:22:11.739532+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T07:53:41.824771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028003000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":93,"reported_epoch":53,"state":"active+undersized","last_fresh":"2026-02-17T04:22:11.520803+0000","last_change":"2026-02-17T04:22:10.521061+0000","last_active":"2026-02-17T04:22:11.520803+0000","last_peered":"2026-02-17T04:22:11.520803+0000","last_clean":"2026-02-17T04:22:08.883757+0000","last_became_active":"2026-02-17T04:22:10.521061+0000","last_became_peered":"2026-02-17T04:22:10.521061+0000","last_unstale":"2026-02-17T04:22:11.520803+0000","last_undegraded":"2026-02-17T04:22:11.520803+0000","last_fullsized":"2026-02-17T04:22:10.520855+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:18:17.660542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017771,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9],"acting":[9],"avail_no_missing":["9"],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+undersized","last_fresh":"2026-02-17T04:22:11.739574+0000","last_change":"2026-02-17T04:22:10.520580+0000","last_active":"2026-02-17T04:22:11.739574+0000","last_peered":"2026-02-17T04:22:11.739574+0000","last_clean":"2026-02-17T04:21:58.546710+0000","last_became_active":"2026-02-17T04:22:10.520580+0000","last_became_peered":"2026-02-17T04:22:10.520580+0000","last_unstale":"2026-02-17T04:22:11.739574+0000","last_undegraded":"2026-02-17T04:22:11.739574+0000","last_fullsized":"2026-02-17T04:22:10.520257+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T05:27:54.532402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6],"acting":[6],"avail_no_missing":["6"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.3","version":"17'1","reported_seq":82,"reported_epoch":53,"state":"active+undersized+degraded","last_fresh":"2026-02-17T04:22:11.520817+0000","last_change":"2026-02-17T04:22:10.521031+0000","last_active":"2026-02-17T04:22:11.520817+0000","last_peered":"2026-02-17T04:22:11.520817+0000","last_clean":"2026-02-17T04:22:09.518186+0000","last_became_active":"2026-02-17T04:22:10.521031+0000","last_became_peered":"2026-02-17T04:22:10.521031+0000","last_unstale":"2026-02-17T04:22:11.520817+0000","last_undegraded":"2026-02-17T04:22:10.520865+0000","last_fullsized":"2026-02-17T04:22:10.520831+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T09:23:22.377283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":1}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"19'2","reported_seq":89,"reported_epoch":53,"state":"active+undersized+degraded","last_fresh":"2026-02-17T04:22:11.739293+0000","last_change":"2026-02-17T04:22:10.521145+0000","last_active":"2026-02-17T04:22:11.739293+0000","last_peered":"2026-02-17T04:22:11.739293+0000","last_clean":"2026-02-17T04:22:09.848271+0000","last_became_active":"2026-02-17T04:22:10.521145+0000","last_became_peered":"2026-02-17T04:22:10.521145+0000","last_unstale":"2026-02-17T04:22:11.739293+0000","last_undegraded":"2026-02-17T04:22:10.520884+0000","last_fullsized":"2026-02-17T04:22:10.520843+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:15:24.711990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066248200000000004,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":1}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":67,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-17T04:22:11.739425+0000","last_change":"2026-02-17T04:22:03.505824+0000","last_active":"2026-02-17T04:22:11.739425+0000","last_peered":"2026-02-17T04:22:11.739425+0000","last_clean":"2026-02-17T04:22:11.739425+0000","last_became_active":"2026-02-17T04:22:03.505709+0000","last_became_peered":"2026-02-17T04:22:03.505709+0000","last_unstale":"2026-02-17T04:22:11.739425+0000","last_undegraded":"2026-02-17T04:22:11.739425+0000","last_fullsized":"2026-02-17T04:22:11.739425+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:34:03.058654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000203418,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":81,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-17T04:22:11.739533+0000","last_change":"2026-02-17T04:22:03.505939+0000","last_active":"2026-02-17T04:22:11.739533+0000","last_peered":"2026-02-17T04:22:11.739533+0000","last_clean":"2026-02-17T04:22:11.739533+0000","last_became_active":"2026-02-17T04:22:03.505839+0000","last_became_peered":"2026-02-17T04:22:03.505839+0000","last_unstale":"2026-02-17T04:22:11.739533+0000","last_undegraded":"2026-02-17T04:22:11.739533+0000","last_fullsized":"2026-02-17T04:22:11.739533+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T06:01:02.501503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":38,"seq":163208757264,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25794,"internal_metadata":27564862},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":44,"seq":188978561040,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25789,"internal_metadata":27564867},"hb_peers":[2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":44,"seq":188978561040,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":22,"kb_used_meta":26921,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23180,"internal_metadata":27567476},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561040,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25788,"internal_metadata":27564868},"hb_peers":[2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":44,"seq":188978561040,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27742,"internal_metadata":27562914},"hb_peers":[2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":44,"seq":188978561039,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27540,"kb_used_data":580,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":104830060,"statfs":{"total":107374182400,"available":107345981440,"internally_reserved":0,"allocated":593920,"data_stored":279187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27091,"internal_metadata":27563565},"hb_peers":[2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":44,"seq":188978561039,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":24,"kb_used_meta":26919,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25136,"internal_metadata":27565520},"hb_peers":[2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":44,"seq":188978561039,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26440,"internal_metadata":27564216},"hb_peers":[3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":0,"seq":16,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27540,"kb_used_data":580,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830060,"statfs":{"total":107374182400,"available":107345981440,"internally_reserved":0,"allocated":593920,"data_stored":279187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25788,"internal_metadata":27564868},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":0,"seq":15,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13420,"internal_metadata":27577236},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T04:22:13.764 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T04:22:13.944 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:22:13.944 INFO:teuthology.orchestra.run.trial040.stderr:dumped all 2026-02-17T04:22:13.953 INFO:teuthology.orchestra.run.trial040.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2026-02-17T04:22:13.816192+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":275368,"kb_used_data":5768,"kb_used_omap":240,"kb_used_meta":269199,"kb_avail":1048300632,"statfs":{"total":1073741824000,"available":1073459847168,"internally_reserved":0,"allocated":5906432,"data_stored":2791718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":246168,"internal_metadata":275660392},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000491"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":67,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-17T04:22:11.520798+0000","last_change":"2026-02-17T04:22:03.505832+0000","last_active":"2026-02-17T04:22:11.520798+0000","last_peered":"2026-02-17T04:22:11.520798+0000","last_clean":"2026-02-17T04:22:11.520798+0000","last_became_active":"2026-02-17T04:22:03.505690+0000","last_became_peered":"2026-02-17T04:22:03.505690+0000","last_unstale":"2026-02-17T04:22:11.520798+0000","last_undegraded":"2026-02-17T04:22:11.520798+0000","last_fullsized":"2026-02-17T04:22:11.520798+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T08:19:43.881417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025232899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":91,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-17T04:22:11.739532+0000","last_change":"2026-02-17T04:22:03.505870+0000","last_active":"2026-02-17T04:22:11.739532+0000","last_peered":"2026-02-17T04:22:11.739532+0000","last_clean":"2026-02-17T04:22:11.739532+0000","last_became_active":"2026-02-17T04:22:03.505662+0000","last_became_peered":"2026-02-17T04:22:03.505662+0000","last_unstale":"2026-02-17T04:22:11.739532+0000","last_undegraded":"2026-02-17T04:22:11.739532+0000","last_fullsized":"2026-02-17T04:22:11.739532+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T07:53:41.824771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028003000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":93,"reported_epoch":53,"state":"active+undersized","last_fresh":"2026-02-17T04:22:11.520803+0000","last_change":"2026-02-17T04:22:10.521061+0000","last_active":"2026-02-17T04:22:11.520803+0000","last_peered":"2026-02-17T04:22:11.520803+0000","last_clean":"2026-02-17T04:22:08.883757+0000","last_became_active":"2026-02-17T04:22:10.521061+0000","last_became_peered":"2026-02-17T04:22:10.521061+0000","last_unstale":"2026-02-17T04:22:11.520803+0000","last_undegraded":"2026-02-17T04:22:11.520803+0000","last_fullsized":"2026-02-17T04:22:10.520855+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:18:17.660542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017771,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9],"acting":[9],"avail_no_missing":["9"],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+undersized","last_fresh":"2026-02-17T04:22:11.739574+0000","last_change":"2026-02-17T04:22:10.520580+0000","last_active":"2026-02-17T04:22:11.739574+0000","last_peered":"2026-02-17T04:22:11.739574+0000","last_clean":"2026-02-17T04:21:58.546710+0000","last_became_active":"2026-02-17T04:22:10.520580+0000","last_became_peered":"2026-02-17T04:22:10.520580+0000","last_unstale":"2026-02-17T04:22:11.739574+0000","last_undegraded":"2026-02-17T04:22:11.739574+0000","last_fullsized":"2026-02-17T04:22:10.520257+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T05:27:54.532402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6],"acting":[6],"avail_no_missing":["6"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.3","version":"17'1","reported_seq":82,"reported_epoch":53,"state":"active+undersized+degraded","last_fresh":"2026-02-17T04:22:11.520817+0000","last_change":"2026-02-17T04:22:10.521031+0000","last_active":"2026-02-17T04:22:11.520817+0000","last_peered":"2026-02-17T04:22:11.520817+0000","last_clean":"2026-02-17T04:22:09.518186+0000","last_became_active":"2026-02-17T04:22:10.521031+0000","last_became_peered":"2026-02-17T04:22:10.521031+0000","last_unstale":"2026-02-17T04:22:11.520817+0000","last_undegraded":"2026-02-17T04:22:10.520865+0000","last_fullsized":"2026-02-17T04:22:10.520831+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T09:23:22.377283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":1}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"19'2","reported_seq":89,"reported_epoch":53,"state":"active+undersized+degraded","last_fresh":"2026-02-17T04:22:11.739293+0000","last_change":"2026-02-17T04:22:10.521145+0000","last_active":"2026-02-17T04:22:11.739293+0000","last_peered":"2026-02-17T04:22:11.739293+0000","last_clean":"2026-02-17T04:22:09.848271+0000","last_became_active":"2026-02-17T04:22:10.521145+0000","last_became_peered":"2026-02-17T04:22:10.521145+0000","last_unstale":"2026-02-17T04:22:11.739293+0000","last_undegraded":"2026-02-17T04:22:10.520884+0000","last_fullsized":"2026-02-17T04:22:10.520843+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:15:24.711990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066248200000000004,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":1}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":67,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-17T04:22:11.739425+0000","last_change":"2026-02-17T04:22:03.505824+0000","last_active":"2026-02-17T04:22:11.739425+0000","last_peered":"2026-02-17T04:22:11.739425+0000","last_clean":"2026-02-17T04:22:11.739425+0000","last_became_active":"2026-02-17T04:22:03.505709+0000","last_became_peered":"2026-02-17T04:22:03.505709+0000","last_unstale":"2026-02-17T04:22:11.739425+0000","last_undegraded":"2026-02-17T04:22:11.739425+0000","last_fullsized":"2026-02-17T04:22:11.739425+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:34:03.058654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000203418,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":81,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-17T04:22:11.739533+0000","last_change":"2026-02-17T04:22:03.505939+0000","last_active":"2026-02-17T04:22:11.739533+0000","last_peered":"2026-02-17T04:22:11.739533+0000","last_clean":"2026-02-17T04:22:11.739533+0000","last_became_active":"2026-02-17T04:22:03.505839+0000","last_became_peered":"2026-02-17T04:22:03.505839+0000","last_unstale":"2026-02-17T04:22:11.739533+0000","last_undegraded":"2026-02-17T04:22:11.739533+0000","last_fullsized":"2026-02-17T04:22:11.739533+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T06:01:02.501503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":38,"seq":163208757264,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25794,"internal_metadata":27564862},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":44,"seq":188978561040,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25789,"internal_metadata":27564867},"hb_peers":[2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":44,"seq":188978561040,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":22,"kb_used_meta":26921,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23180,"internal_metadata":27567476},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561040,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25788,"internal_metadata":27564868},"hb_peers":[2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":44,"seq":188978561040,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27742,"internal_metadata":27562914},"hb_peers":[2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":44,"seq":188978561039,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27540,"kb_used_data":580,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":104830060,"statfs":{"total":107374182400,"available":107345981440,"internally_reserved":0,"allocated":593920,"data_stored":279187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27091,"internal_metadata":27563565},"hb_peers":[2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":44,"seq":188978561039,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":24,"kb_used_meta":26919,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25136,"internal_metadata":27565520},"hb_peers":[2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":44,"seq":188978561039,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26440,"internal_metadata":27564216},"hb_peers":[3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":0,"seq":16,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27540,"kb_used_data":580,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830060,"statfs":{"total":107374182400,"available":107345981440,"internally_reserved":0,"allocated":593920,"data_stored":279187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25788,"internal_metadata":27564868},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":0,"seq":15,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13420,"internal_metadata":27577236},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T04:22:13.955 INFO:tasks.ceph.ceph_manager.ceph:PG 1.5 is not active+clean 2026-02-17T04:22:13.955 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '1.5', 'version': "0'0", 'reported_seq': 93, 'reported_epoch': 53, 'state': 'active+undersized', 'last_fresh': '2026-02-17T04:22:11.520803+0000', 'last_change': '2026-02-17T04:22:10.521061+0000', 'last_active': '2026-02-17T04:22:11.520803+0000', 'last_peered': '2026-02-17T04:22:11.520803+0000', 'last_clean': '2026-02-17T04:22:08.883757+0000', 'last_became_active': '2026-02-17T04:22:10.521061+0000', 'last_became_peered': '2026-02-17T04:22:10.521061+0000', 'last_unstale': '2026-02-17T04:22:11.520803+0000', 'last_undegraded': '2026-02-17T04:22:11.520803+0000', 'last_fullsized': '2026-02-17T04:22:10.520855+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 45, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-17T04:21:12.845335+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-17T04:21:12.845335+0000', 'last_clean_scrub_stamp': '2026-02-17T04:21:12.845335+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2026-02-18T13:18:17.660542+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0.00017771, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [9], 'acting': [9], 'avail_no_missing': ['9'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 9, 'acting_primary': 9, 'purged_snaps': []} 2026-02-17T04:22:13.955 INFO:tasks.ceph.ceph_manager.ceph:PG 1.4 is not active+clean 2026-02-17T04:22:13.955 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '1.4', 'version': "0'0", 'reported_seq': 57, 'reported_epoch': 53, 'state': 'active+undersized', 'last_fresh': '2026-02-17T04:22:11.739574+0000', 'last_change': '2026-02-17T04:22:10.520580+0000', 'last_active': '2026-02-17T04:22:11.739574+0000', 'last_peered': '2026-02-17T04:22:11.739574+0000', 'last_clean': '2026-02-17T04:21:58.546710+0000', 'last_became_active': '2026-02-17T04:22:10.520580+0000', 'last_became_peered': '2026-02-17T04:22:10.520580+0000', 'last_unstale': '2026-02-17T04:22:11.739574+0000', 'last_undegraded': '2026-02-17T04:22:11.739574+0000', 'last_fullsized': '2026-02-17T04:22:10.520257+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 45, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-17T04:21:12.845335+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-17T04:21:12.845335+0000', 'last_clean_scrub_stamp': '2026-02-17T04:21:12.845335+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2026-02-18T05:27:54.532402+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6], 'acting': [6], 'avail_no_missing': ['6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2026-02-17T04:22:13.955 INFO:tasks.ceph.ceph_manager.ceph:PG 1.3 is not active+clean 2026-02-17T04:22:13.955 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '1.3', 'version': "17'1", 'reported_seq': 82, 'reported_epoch': 53, 'state': 'active+undersized+degraded', 'last_fresh': '2026-02-17T04:22:11.520817+0000', 'last_change': '2026-02-17T04:22:10.521031+0000', 'last_active': '2026-02-17T04:22:11.520817+0000', 'last_peered': '2026-02-17T04:22:11.520817+0000', 'last_clean': '2026-02-17T04:22:09.518186+0000', 'last_became_active': '2026-02-17T04:22:10.521031+0000', 'last_became_peered': '2026-02-17T04:22:10.521031+0000', 'last_unstale': '2026-02-17T04:22:11.520817+0000', 'last_undegraded': '2026-02-17T04:22:10.520865+0000', 'last_fullsized': '2026-02-17T04:22:10.520831+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 45, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-17T04:21:12.845335+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-17T04:21:12.845335+0000', 'last_clean_scrub_stamp': '2026-02-17T04:21:12.845335+0000', 'objects_scrubbed': 0, 'log_size': 1, 'log_dups_size': 0, 'ondisk_log_size': 1, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2026-02-18T09:23:22.377283+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 1, 'num_object_clones': 0, 'num_object_copies': 2, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 1, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 1, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 1, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3], 'acting': [3], 'avail_no_missing': ['3'], 'object_location_counts': [{'shards': '3', 'objects': 1}], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2026-02-17T04:22:13.956 INFO:tasks.ceph.ceph_manager.ceph:PG 1.2 is not active+clean 2026-02-17T04:22:13.956 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '1.2', 'version': "19'2", 'reported_seq': 89, 'reported_epoch': 53, 'state': 'active+undersized+degraded', 'last_fresh': '2026-02-17T04:22:11.739293+0000', 'last_change': '2026-02-17T04:22:10.521145+0000', 'last_active': '2026-02-17T04:22:11.739293+0000', 'last_peered': '2026-02-17T04:22:11.739293+0000', 'last_clean': '2026-02-17T04:22:09.848271+0000', 'last_became_active': '2026-02-17T04:22:10.521145+0000', 'last_became_peered': '2026-02-17T04:22:10.521145+0000', 'last_unstale': '2026-02-17T04:22:11.739293+0000', 'last_undegraded': '2026-02-17T04:22:10.520884+0000', 'last_fullsized': '2026-02-17T04:22:10.520843+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 45, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-17T04:21:12.845335+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-17T04:21:12.845335+0000', 'last_clean_scrub_stamp': '2026-02-17T04:21:12.845335+0000', 'objects_scrubbed': 0, 'log_size': 2, 'log_dups_size': 0, 'ondisk_log_size': 2, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2026-02-18T15:15:24.711990+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0.000662482, 'stat_sum': {'num_bytes': 19, 'num_objects': 1, 'num_object_clones': 0, 'num_object_copies': 2, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 1, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 1, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 2, 'num_write_kb': 2, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 1, 'num_bytes_recovered': 19, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4], 'acting': [4], 'avail_no_missing': ['4'], 'object_location_counts': [{'shards': '4', 'objects': 1}], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2026-02-17T04:22:13.956 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2026-02-17T04:22:14.177 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:22:14.177 INFO:teuthology.orchestra.run.trial040.stdout:{"fsid":"1c4f66e4-59c5-4536-b735-09464fcda99a","health":{"status":"HEALTH_WARN","checks":{"OSDMAP_FLAGS":{"severity":"HEALTH_WARN","summary":{"message":"noout flag(s) set","count":5},"muted":false}},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":72,"monmap":{"epoch":1,"min_mon_release_name":"tentacle","num_mons":1},"osdmap":{"epoch":55,"num_osds":10,"num_up_osds":10,"osd_up_since":1771302132,"num_in_osds":10,"osd_in_since":1771302063,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":7},{"state_name":"stale+active+clean","count":1}],"num_pgs":8,"num_pools":1,"num_objects":2,"data_bytes":19,"bytes_used":281190400,"bytes_avail":1073460633600,"bytes_total":1073741824000},"fsmap":{"epoch":1,"btime":"2026-02-17T04:21:01:447113+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs"],"services":{}},"servicemap":{"epoch":3,"modified":"2026-02-17T04:22:07.815481+0000","services":{}},"progress_events":{}} 2026-02-17T04:22:14.186 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2026-02-17T04:22:14.187 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T04:22:14.364 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:22:14.365 INFO:teuthology.orchestra.run.trial040.stderr:dumped all 2026-02-17T04:22:14.373 INFO:teuthology.orchestra.run.trial040.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2026-02-17T04:22:13.816192+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":275368,"kb_used_data":5768,"kb_used_omap":240,"kb_used_meta":269199,"kb_avail":1048300632,"statfs":{"total":1073741824000,"available":1073459847168,"internally_reserved":0,"allocated":5906432,"data_stored":2791718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":246168,"internal_metadata":275660392},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000491"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":67,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-17T04:22:11.520798+0000","last_change":"2026-02-17T04:22:03.505832+0000","last_active":"2026-02-17T04:22:11.520798+0000","last_peered":"2026-02-17T04:22:11.520798+0000","last_clean":"2026-02-17T04:22:11.520798+0000","last_became_active":"2026-02-17T04:22:03.505690+0000","last_became_peered":"2026-02-17T04:22:03.505690+0000","last_unstale":"2026-02-17T04:22:11.520798+0000","last_undegraded":"2026-02-17T04:22:11.520798+0000","last_fullsized":"2026-02-17T04:22:11.520798+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T08:19:43.881417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025232899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":91,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-17T04:22:11.739532+0000","last_change":"2026-02-17T04:22:03.505870+0000","last_active":"2026-02-17T04:22:11.739532+0000","last_peered":"2026-02-17T04:22:11.739532+0000","last_clean":"2026-02-17T04:22:11.739532+0000","last_became_active":"2026-02-17T04:22:03.505662+0000","last_became_peered":"2026-02-17T04:22:03.505662+0000","last_unstale":"2026-02-17T04:22:11.739532+0000","last_undegraded":"2026-02-17T04:22:11.739532+0000","last_fullsized":"2026-02-17T04:22:11.739532+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T07:53:41.824771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028003000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":93,"reported_epoch":53,"state":"active+undersized","last_fresh":"2026-02-17T04:22:11.520803+0000","last_change":"2026-02-17T04:22:10.521061+0000","last_active":"2026-02-17T04:22:11.520803+0000","last_peered":"2026-02-17T04:22:11.520803+0000","last_clean":"2026-02-17T04:22:08.883757+0000","last_became_active":"2026-02-17T04:22:10.521061+0000","last_became_peered":"2026-02-17T04:22:10.521061+0000","last_unstale":"2026-02-17T04:22:11.520803+0000","last_undegraded":"2026-02-17T04:22:11.520803+0000","last_fullsized":"2026-02-17T04:22:10.520855+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:18:17.660542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017771,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9],"acting":[9],"avail_no_missing":["9"],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+undersized","last_fresh":"2026-02-17T04:22:11.739574+0000","last_change":"2026-02-17T04:22:10.520580+0000","last_active":"2026-02-17T04:22:11.739574+0000","last_peered":"2026-02-17T04:22:11.739574+0000","last_clean":"2026-02-17T04:21:58.546710+0000","last_became_active":"2026-02-17T04:22:10.520580+0000","last_became_peered":"2026-02-17T04:22:10.520580+0000","last_unstale":"2026-02-17T04:22:11.739574+0000","last_undegraded":"2026-02-17T04:22:11.739574+0000","last_fullsized":"2026-02-17T04:22:10.520257+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T05:27:54.532402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6],"acting":[6],"avail_no_missing":["6"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.3","version":"17'1","reported_seq":82,"reported_epoch":53,"state":"active+undersized+degraded","last_fresh":"2026-02-17T04:22:11.520817+0000","last_change":"2026-02-17T04:22:10.521031+0000","last_active":"2026-02-17T04:22:11.520817+0000","last_peered":"2026-02-17T04:22:11.520817+0000","last_clean":"2026-02-17T04:22:09.518186+0000","last_became_active":"2026-02-17T04:22:10.521031+0000","last_became_peered":"2026-02-17T04:22:10.521031+0000","last_unstale":"2026-02-17T04:22:11.520817+0000","last_undegraded":"2026-02-17T04:22:10.520865+0000","last_fullsized":"2026-02-17T04:22:10.520831+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T09:23:22.377283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":1}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"19'2","reported_seq":89,"reported_epoch":53,"state":"active+undersized+degraded","last_fresh":"2026-02-17T04:22:11.739293+0000","last_change":"2026-02-17T04:22:10.521145+0000","last_active":"2026-02-17T04:22:11.739293+0000","last_peered":"2026-02-17T04:22:11.739293+0000","last_clean":"2026-02-17T04:22:09.848271+0000","last_became_active":"2026-02-17T04:22:10.521145+0000","last_became_peered":"2026-02-17T04:22:10.521145+0000","last_unstale":"2026-02-17T04:22:11.739293+0000","last_undegraded":"2026-02-17T04:22:10.520884+0000","last_fullsized":"2026-02-17T04:22:10.520843+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:15:24.711990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066248200000000004,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":1}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":67,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-17T04:22:11.739425+0000","last_change":"2026-02-17T04:22:03.505824+0000","last_active":"2026-02-17T04:22:11.739425+0000","last_peered":"2026-02-17T04:22:11.739425+0000","last_clean":"2026-02-17T04:22:11.739425+0000","last_became_active":"2026-02-17T04:22:03.505709+0000","last_became_peered":"2026-02-17T04:22:03.505709+0000","last_unstale":"2026-02-17T04:22:11.739425+0000","last_undegraded":"2026-02-17T04:22:11.739425+0000","last_fullsized":"2026-02-17T04:22:11.739425+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:34:03.058654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000203418,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":81,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-17T04:22:11.739533+0000","last_change":"2026-02-17T04:22:03.505939+0000","last_active":"2026-02-17T04:22:11.739533+0000","last_peered":"2026-02-17T04:22:11.739533+0000","last_clean":"2026-02-17T04:22:11.739533+0000","last_became_active":"2026-02-17T04:22:03.505839+0000","last_became_peered":"2026-02-17T04:22:03.505839+0000","last_unstale":"2026-02-17T04:22:11.739533+0000","last_undegraded":"2026-02-17T04:22:11.739533+0000","last_fullsized":"2026-02-17T04:22:11.739533+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T06:01:02.501503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":38,"seq":163208757264,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25794,"internal_metadata":27564862},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":44,"seq":188978561040,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25789,"internal_metadata":27564867},"hb_peers":[2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":44,"seq":188978561040,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":22,"kb_used_meta":26921,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23180,"internal_metadata":27567476},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561040,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25788,"internal_metadata":27564868},"hb_peers":[2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":44,"seq":188978561040,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27742,"internal_metadata":27562914},"hb_peers":[2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":44,"seq":188978561039,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27540,"kb_used_data":580,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":104830060,"statfs":{"total":107374182400,"available":107345981440,"internally_reserved":0,"allocated":593920,"data_stored":279187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27091,"internal_metadata":27563565},"hb_peers":[2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":44,"seq":188978561039,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":24,"kb_used_meta":26919,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25136,"internal_metadata":27565520},"hb_peers":[2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":44,"seq":188978561039,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26440,"internal_metadata":27564216},"hb_peers":[3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":0,"seq":16,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27540,"kb_used_data":580,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830060,"statfs":{"total":107374182400,"available":107345981440,"internally_reserved":0,"allocated":593920,"data_stored":279187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25788,"internal_metadata":27564868},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":0,"seq":15,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13420,"internal_metadata":27577236},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T04:22:17.375 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T04:22:17.552 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:22:17.553 INFO:teuthology.orchestra.run.trial040.stderr:dumped all 2026-02-17T04:22:17.562 INFO:teuthology.orchestra.run.trial040.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2026-02-17T04:22:15.816440+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":275368,"kb_used_data":5768,"kb_used_omap":240,"kb_used_meta":269199,"kb_avail":1048300632,"statfs":{"total":1073741824000,"available":1073459847168,"internally_reserved":0,"allocated":5906432,"data_stored":2791718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":246168,"internal_metadata":275660392},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.296869"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":67,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-17T04:22:11.520798+0000","last_change":"2026-02-17T04:22:03.505832+0000","last_active":"2026-02-17T04:22:11.520798+0000","last_peered":"2026-02-17T04:22:11.520798+0000","last_clean":"2026-02-17T04:22:11.520798+0000","last_became_active":"2026-02-17T04:22:03.505690+0000","last_became_peered":"2026-02-17T04:22:03.505690+0000","last_unstale":"2026-02-17T04:22:11.520798+0000","last_undegraded":"2026-02-17T04:22:11.520798+0000","last_fullsized":"2026-02-17T04:22:11.520798+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T08:19:43.881417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025232899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":91,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-17T04:22:11.739532+0000","last_change":"2026-02-17T04:22:03.505870+0000","last_active":"2026-02-17T04:22:11.739532+0000","last_peered":"2026-02-17T04:22:11.739532+0000","last_clean":"2026-02-17T04:22:11.739532+0000","last_became_active":"2026-02-17T04:22:03.505662+0000","last_became_peered":"2026-02-17T04:22:03.505662+0000","last_unstale":"2026-02-17T04:22:11.739532+0000","last_undegraded":"2026-02-17T04:22:11.739532+0000","last_fullsized":"2026-02-17T04:22:11.739532+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T07:53:41.824771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028003000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":93,"reported_epoch":53,"state":"active+undersized","last_fresh":"2026-02-17T04:22:11.520803+0000","last_change":"2026-02-17T04:22:10.521061+0000","last_active":"2026-02-17T04:22:11.520803+0000","last_peered":"2026-02-17T04:22:11.520803+0000","last_clean":"2026-02-17T04:22:08.883757+0000","last_became_active":"2026-02-17T04:22:10.521061+0000","last_became_peered":"2026-02-17T04:22:10.521061+0000","last_unstale":"2026-02-17T04:22:11.520803+0000","last_undegraded":"2026-02-17T04:22:11.520803+0000","last_fullsized":"2026-02-17T04:22:10.520855+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:18:17.660542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017771,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9],"acting":[9],"avail_no_missing":["9"],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+undersized","last_fresh":"2026-02-17T04:22:11.739574+0000","last_change":"2026-02-17T04:22:10.520580+0000","last_active":"2026-02-17T04:22:11.739574+0000","last_peered":"2026-02-17T04:22:11.739574+0000","last_clean":"2026-02-17T04:21:58.546710+0000","last_became_active":"2026-02-17T04:22:10.520580+0000","last_became_peered":"2026-02-17T04:22:10.520580+0000","last_unstale":"2026-02-17T04:22:11.739574+0000","last_undegraded":"2026-02-17T04:22:11.739574+0000","last_fullsized":"2026-02-17T04:22:10.520257+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T05:27:54.532402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6],"acting":[6],"avail_no_missing":["6"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.3","version":"17'1","reported_seq":82,"reported_epoch":53,"state":"active+undersized+degraded","last_fresh":"2026-02-17T04:22:11.520817+0000","last_change":"2026-02-17T04:22:10.521031+0000","last_active":"2026-02-17T04:22:11.520817+0000","last_peered":"2026-02-17T04:22:11.520817+0000","last_clean":"2026-02-17T04:22:09.518186+0000","last_became_active":"2026-02-17T04:22:10.521031+0000","last_became_peered":"2026-02-17T04:22:10.521031+0000","last_unstale":"2026-02-17T04:22:11.520817+0000","last_undegraded":"2026-02-17T04:22:10.520865+0000","last_fullsized":"2026-02-17T04:22:10.520831+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T09:23:22.377283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":1}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"19'2","reported_seq":89,"reported_epoch":53,"state":"active+undersized+degraded","last_fresh":"2026-02-17T04:22:11.739293+0000","last_change":"2026-02-17T04:22:10.521145+0000","last_active":"2026-02-17T04:22:11.739293+0000","last_peered":"2026-02-17T04:22:11.739293+0000","last_clean":"2026-02-17T04:22:09.848271+0000","last_became_active":"2026-02-17T04:22:10.521145+0000","last_became_peered":"2026-02-17T04:22:10.521145+0000","last_unstale":"2026-02-17T04:22:11.739293+0000","last_undegraded":"2026-02-17T04:22:10.520884+0000","last_fullsized":"2026-02-17T04:22:10.520843+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:15:24.711990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066248200000000004,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":1}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":67,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-17T04:22:11.739425+0000","last_change":"2026-02-17T04:22:03.505824+0000","last_active":"2026-02-17T04:22:11.739425+0000","last_peered":"2026-02-17T04:22:11.739425+0000","last_clean":"2026-02-17T04:22:11.739425+0000","last_became_active":"2026-02-17T04:22:03.505709+0000","last_became_peered":"2026-02-17T04:22:03.505709+0000","last_unstale":"2026-02-17T04:22:11.739425+0000","last_undegraded":"2026-02-17T04:22:11.739425+0000","last_fullsized":"2026-02-17T04:22:11.739425+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:34:03.058654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000203418,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":81,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-17T04:22:11.739533+0000","last_change":"2026-02-17T04:22:03.505939+0000","last_active":"2026-02-17T04:22:11.739533+0000","last_peered":"2026-02-17T04:22:11.739533+0000","last_clean":"2026-02-17T04:22:11.739533+0000","last_became_active":"2026-02-17T04:22:03.505839+0000","last_became_peered":"2026-02-17T04:22:03.505839+0000","last_unstale":"2026-02-17T04:22:11.739533+0000","last_undegraded":"2026-02-17T04:22:11.739533+0000","last_fullsized":"2026-02-17T04:22:11.739533+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T06:01:02.501503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":38,"seq":163208757264,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25794,"internal_metadata":27564862},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":44,"seq":188978561040,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25789,"internal_metadata":27564867},"hb_peers":[2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":44,"seq":188978561040,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":22,"kb_used_meta":26921,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23180,"internal_metadata":27567476},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561040,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25788,"internal_metadata":27564868},"hb_peers":[2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":44,"seq":188978561040,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27742,"internal_metadata":27562914},"hb_peers":[2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":44,"seq":188978561039,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27540,"kb_used_data":580,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":104830060,"statfs":{"total":107374182400,"available":107345981440,"internally_reserved":0,"allocated":593920,"data_stored":279187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27091,"internal_metadata":27563565},"hb_peers":[2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":44,"seq":188978561039,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":24,"kb_used_meta":26919,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25136,"internal_metadata":27565520},"hb_peers":[2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":44,"seq":188978561039,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26440,"internal_metadata":27564216},"hb_peers":[3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":0,"seq":16,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27540,"kb_used_data":580,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830060,"statfs":{"total":107374182400,"available":107345981440,"internally_reserved":0,"allocated":593920,"data_stored":279187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25788,"internal_metadata":27564868},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":0,"seq":15,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13420,"internal_metadata":27577236},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T04:22:17.563 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T04:22:17.738 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:22:17.739 INFO:teuthology.orchestra.run.trial040.stderr:dumped all 2026-02-17T04:22:17.747 INFO:teuthology.orchestra.run.trial040.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2026-02-17T04:22:15.816440+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":275368,"kb_used_data":5768,"kb_used_omap":240,"kb_used_meta":269199,"kb_avail":1048300632,"statfs":{"total":1073741824000,"available":1073459847168,"internally_reserved":0,"allocated":5906432,"data_stored":2791718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":246168,"internal_metadata":275660392},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.296869"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":67,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-17T04:22:11.520798+0000","last_change":"2026-02-17T04:22:03.505832+0000","last_active":"2026-02-17T04:22:11.520798+0000","last_peered":"2026-02-17T04:22:11.520798+0000","last_clean":"2026-02-17T04:22:11.520798+0000","last_became_active":"2026-02-17T04:22:03.505690+0000","last_became_peered":"2026-02-17T04:22:03.505690+0000","last_unstale":"2026-02-17T04:22:11.520798+0000","last_undegraded":"2026-02-17T04:22:11.520798+0000","last_fullsized":"2026-02-17T04:22:11.520798+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T08:19:43.881417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025232899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":91,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-17T04:22:11.739532+0000","last_change":"2026-02-17T04:22:03.505870+0000","last_active":"2026-02-17T04:22:11.739532+0000","last_peered":"2026-02-17T04:22:11.739532+0000","last_clean":"2026-02-17T04:22:11.739532+0000","last_became_active":"2026-02-17T04:22:03.505662+0000","last_became_peered":"2026-02-17T04:22:03.505662+0000","last_unstale":"2026-02-17T04:22:11.739532+0000","last_undegraded":"2026-02-17T04:22:11.739532+0000","last_fullsized":"2026-02-17T04:22:11.739532+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T07:53:41.824771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028003000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":93,"reported_epoch":53,"state":"active+undersized","last_fresh":"2026-02-17T04:22:11.520803+0000","last_change":"2026-02-17T04:22:10.521061+0000","last_active":"2026-02-17T04:22:11.520803+0000","last_peered":"2026-02-17T04:22:11.520803+0000","last_clean":"2026-02-17T04:22:08.883757+0000","last_became_active":"2026-02-17T04:22:10.521061+0000","last_became_peered":"2026-02-17T04:22:10.521061+0000","last_unstale":"2026-02-17T04:22:11.520803+0000","last_undegraded":"2026-02-17T04:22:11.520803+0000","last_fullsized":"2026-02-17T04:22:10.520855+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:18:17.660542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017771,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9],"acting":[9],"avail_no_missing":["9"],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+undersized","last_fresh":"2026-02-17T04:22:11.739574+0000","last_change":"2026-02-17T04:22:10.520580+0000","last_active":"2026-02-17T04:22:11.739574+0000","last_peered":"2026-02-17T04:22:11.739574+0000","last_clean":"2026-02-17T04:21:58.546710+0000","last_became_active":"2026-02-17T04:22:10.520580+0000","last_became_peered":"2026-02-17T04:22:10.520580+0000","last_unstale":"2026-02-17T04:22:11.739574+0000","last_undegraded":"2026-02-17T04:22:11.739574+0000","last_fullsized":"2026-02-17T04:22:10.520257+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T05:27:54.532402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6],"acting":[6],"avail_no_missing":["6"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.3","version":"17'1","reported_seq":82,"reported_epoch":53,"state":"active+undersized+degraded","last_fresh":"2026-02-17T04:22:11.520817+0000","last_change":"2026-02-17T04:22:10.521031+0000","last_active":"2026-02-17T04:22:11.520817+0000","last_peered":"2026-02-17T04:22:11.520817+0000","last_clean":"2026-02-17T04:22:09.518186+0000","last_became_active":"2026-02-17T04:22:10.521031+0000","last_became_peered":"2026-02-17T04:22:10.521031+0000","last_unstale":"2026-02-17T04:22:11.520817+0000","last_undegraded":"2026-02-17T04:22:10.520865+0000","last_fullsized":"2026-02-17T04:22:10.520831+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T09:23:22.377283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":1}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"19'2","reported_seq":89,"reported_epoch":53,"state":"active+undersized+degraded","last_fresh":"2026-02-17T04:22:11.739293+0000","last_change":"2026-02-17T04:22:10.521145+0000","last_active":"2026-02-17T04:22:11.739293+0000","last_peered":"2026-02-17T04:22:11.739293+0000","last_clean":"2026-02-17T04:22:09.848271+0000","last_became_active":"2026-02-17T04:22:10.521145+0000","last_became_peered":"2026-02-17T04:22:10.521145+0000","last_unstale":"2026-02-17T04:22:11.739293+0000","last_undegraded":"2026-02-17T04:22:10.520884+0000","last_fullsized":"2026-02-17T04:22:10.520843+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:15:24.711990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066248200000000004,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":1}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":67,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-17T04:22:11.739425+0000","last_change":"2026-02-17T04:22:03.505824+0000","last_active":"2026-02-17T04:22:11.739425+0000","last_peered":"2026-02-17T04:22:11.739425+0000","last_clean":"2026-02-17T04:22:11.739425+0000","last_became_active":"2026-02-17T04:22:03.505709+0000","last_became_peered":"2026-02-17T04:22:03.505709+0000","last_unstale":"2026-02-17T04:22:11.739425+0000","last_undegraded":"2026-02-17T04:22:11.739425+0000","last_fullsized":"2026-02-17T04:22:11.739425+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:34:03.058654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000203418,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":81,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-17T04:22:11.739533+0000","last_change":"2026-02-17T04:22:03.505939+0000","last_active":"2026-02-17T04:22:11.739533+0000","last_peered":"2026-02-17T04:22:11.739533+0000","last_clean":"2026-02-17T04:22:11.739533+0000","last_became_active":"2026-02-17T04:22:03.505839+0000","last_became_peered":"2026-02-17T04:22:03.505839+0000","last_unstale":"2026-02-17T04:22:11.739533+0000","last_undegraded":"2026-02-17T04:22:11.739533+0000","last_fullsized":"2026-02-17T04:22:11.739533+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T06:01:02.501503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":38,"seq":163208757264,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25794,"internal_metadata":27564862},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":44,"seq":188978561040,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25789,"internal_metadata":27564867},"hb_peers":[2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":44,"seq":188978561040,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":22,"kb_used_meta":26921,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23180,"internal_metadata":27567476},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561040,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25788,"internal_metadata":27564868},"hb_peers":[2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":44,"seq":188978561040,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27742,"internal_metadata":27562914},"hb_peers":[2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":44,"seq":188978561039,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27540,"kb_used_data":580,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":104830060,"statfs":{"total":107374182400,"available":107345981440,"internally_reserved":0,"allocated":593920,"data_stored":279187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27091,"internal_metadata":27563565},"hb_peers":[2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":44,"seq":188978561039,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":24,"kb_used_meta":26919,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25136,"internal_metadata":27565520},"hb_peers":[2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":44,"seq":188978561039,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26440,"internal_metadata":27564216},"hb_peers":[3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":0,"seq":16,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27540,"kb_used_data":580,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830060,"statfs":{"total":107374182400,"available":107345981440,"internally_reserved":0,"allocated":593920,"data_stored":279187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25788,"internal_metadata":27564868},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":0,"seq":15,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13420,"internal_metadata":27577236},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T04:22:17.748 INFO:tasks.ceph.ceph_manager.ceph:PG 1.5 is not active+clean 2026-02-17T04:22:17.749 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '1.5', 'version': "0'0", 'reported_seq': 93, 'reported_epoch': 53, 'state': 'active+undersized', 'last_fresh': '2026-02-17T04:22:11.520803+0000', 'last_change': '2026-02-17T04:22:10.521061+0000', 'last_active': '2026-02-17T04:22:11.520803+0000', 'last_peered': '2026-02-17T04:22:11.520803+0000', 'last_clean': '2026-02-17T04:22:08.883757+0000', 'last_became_active': '2026-02-17T04:22:10.521061+0000', 'last_became_peered': '2026-02-17T04:22:10.521061+0000', 'last_unstale': '2026-02-17T04:22:11.520803+0000', 'last_undegraded': '2026-02-17T04:22:11.520803+0000', 'last_fullsized': '2026-02-17T04:22:10.520855+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 45, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-17T04:21:12.845335+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-17T04:21:12.845335+0000', 'last_clean_scrub_stamp': '2026-02-17T04:21:12.845335+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2026-02-18T13:18:17.660542+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0.00017771, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [9], 'acting': [9], 'avail_no_missing': ['9'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 9, 'acting_primary': 9, 'purged_snaps': []} 2026-02-17T04:22:17.749 INFO:tasks.ceph.ceph_manager.ceph:PG 1.4 is not active+clean 2026-02-17T04:22:17.749 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '1.4', 'version': "0'0", 'reported_seq': 57, 'reported_epoch': 53, 'state': 'active+undersized', 'last_fresh': '2026-02-17T04:22:11.739574+0000', 'last_change': '2026-02-17T04:22:10.520580+0000', 'last_active': '2026-02-17T04:22:11.739574+0000', 'last_peered': '2026-02-17T04:22:11.739574+0000', 'last_clean': '2026-02-17T04:21:58.546710+0000', 'last_became_active': '2026-02-17T04:22:10.520580+0000', 'last_became_peered': '2026-02-17T04:22:10.520580+0000', 'last_unstale': '2026-02-17T04:22:11.739574+0000', 'last_undegraded': '2026-02-17T04:22:11.739574+0000', 'last_fullsized': '2026-02-17T04:22:10.520257+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 45, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-17T04:21:12.845335+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-17T04:21:12.845335+0000', 'last_clean_scrub_stamp': '2026-02-17T04:21:12.845335+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2026-02-18T05:27:54.532402+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6], 'acting': [6], 'avail_no_missing': ['6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2026-02-17T04:22:17.749 INFO:tasks.ceph.ceph_manager.ceph:PG 1.3 is not active+clean 2026-02-17T04:22:17.749 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '1.3', 'version': "17'1", 'reported_seq': 82, 'reported_epoch': 53, 'state': 'active+undersized+degraded', 'last_fresh': '2026-02-17T04:22:11.520817+0000', 'last_change': '2026-02-17T04:22:10.521031+0000', 'last_active': '2026-02-17T04:22:11.520817+0000', 'last_peered': '2026-02-17T04:22:11.520817+0000', 'last_clean': '2026-02-17T04:22:09.518186+0000', 'last_became_active': '2026-02-17T04:22:10.521031+0000', 'last_became_peered': '2026-02-17T04:22:10.521031+0000', 'last_unstale': '2026-02-17T04:22:11.520817+0000', 'last_undegraded': '2026-02-17T04:22:10.520865+0000', 'last_fullsized': '2026-02-17T04:22:10.520831+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 45, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-17T04:21:12.845335+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-17T04:21:12.845335+0000', 'last_clean_scrub_stamp': '2026-02-17T04:21:12.845335+0000', 'objects_scrubbed': 0, 'log_size': 1, 'log_dups_size': 0, 'ondisk_log_size': 1, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2026-02-18T09:23:22.377283+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 1, 'num_object_clones': 0, 'num_object_copies': 2, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 1, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 1, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 1, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3], 'acting': [3], 'avail_no_missing': ['3'], 'object_location_counts': [{'shards': '3', 'objects': 1}], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2026-02-17T04:22:17.749 INFO:tasks.ceph.ceph_manager.ceph:PG 1.2 is not active+clean 2026-02-17T04:22:17.750 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '1.2', 'version': "19'2", 'reported_seq': 89, 'reported_epoch': 53, 'state': 'active+undersized+degraded', 'last_fresh': '2026-02-17T04:22:11.739293+0000', 'last_change': '2026-02-17T04:22:10.521145+0000', 'last_active': '2026-02-17T04:22:11.739293+0000', 'last_peered': '2026-02-17T04:22:11.739293+0000', 'last_clean': '2026-02-17T04:22:09.848271+0000', 'last_became_active': '2026-02-17T04:22:10.521145+0000', 'last_became_peered': '2026-02-17T04:22:10.521145+0000', 'last_unstale': '2026-02-17T04:22:11.739293+0000', 'last_undegraded': '2026-02-17T04:22:10.520884+0000', 'last_fullsized': '2026-02-17T04:22:10.520843+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 45, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-17T04:21:12.845335+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-17T04:21:12.845335+0000', 'last_clean_scrub_stamp': '2026-02-17T04:21:12.845335+0000', 'objects_scrubbed': 0, 'log_size': 2, 'log_dups_size': 0, 'ondisk_log_size': 2, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2026-02-18T15:15:24.711990+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0.000662482, 'stat_sum': {'num_bytes': 19, 'num_objects': 1, 'num_object_clones': 0, 'num_object_copies': 2, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 1, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 1, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 2, 'num_write_kb': 2, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 1, 'num_bytes_recovered': 19, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4], 'acting': [4], 'avail_no_missing': ['4'], 'object_location_counts': [{'shards': '4', 'objects': 1}], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2026-02-17T04:22:17.750 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2026-02-17T04:22:17.967 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:22:17.967 INFO:teuthology.orchestra.run.trial040.stdout:{"fsid":"1c4f66e4-59c5-4536-b735-09464fcda99a","health":{"status":"HEALTH_WARN","checks":{"OSDMAP_FLAGS":{"severity":"HEALTH_WARN","summary":{"message":"noout flag(s) set","count":5},"muted":false},"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 2/4 objects degraded (50.000%), 2 pgs degraded","count":2},"muted":false}},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":76,"monmap":{"epoch":1,"min_mon_release_name":"tentacle","num_mons":1},"osdmap":{"epoch":55,"num_osds":10,"num_up_osds":10,"osd_up_since":1771302132,"num_in_osds":10,"osd_in_since":1771302063,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":4},{"state_name":"active+undersized+degraded","count":2},{"state_name":"active+undersized","count":2}],"num_pgs":8,"num_pools":1,"num_objects":2,"data_bytes":19,"bytes_used":281976832,"bytes_avail":1073459847168,"bytes_total":1073741824000,"degraded_objects":2,"degraded_total":4,"degraded_ratio":0.5},"fsmap":{"epoch":1,"btime":"2026-02-17T04:21:01:447113+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs"],"services":{}},"servicemap":{"epoch":3,"modified":"2026-02-17T04:22:07.815481+0000","services":{}},"progress_events":{}} 2026-02-17T04:22:17.977 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2026-02-17T04:22:17.977 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T04:22:18.156 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:22:18.157 INFO:teuthology.orchestra.run.trial040.stderr:dumped all 2026-02-17T04:22:18.165 INFO:teuthology.orchestra.run.trial040.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2026-02-17T04:22:17.816680+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":275728,"kb_used_data":6128,"kb_used_omap":254,"kb_used_meta":269185,"kb_avail":1048300272,"statfs":{"total":1073741824000,"available":1073459478528,"internally_reserved":0,"allocated":6275072,"data_stored":3029458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":260490,"internal_metadata":275646070},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.296405"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":71,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T04:22:13.528699+0000","last_change":"2026-02-17T04:22:03.505832+0000","last_active":"2026-02-17T04:22:13.528699+0000","last_peered":"2026-02-17T04:22:13.528699+0000","last_clean":"2026-02-17T04:22:13.528699+0000","last_became_active":"2026-02-17T04:22:03.505690+0000","last_became_peered":"2026-02-17T04:22:03.505690+0000","last_unstale":"2026-02-17T04:22:13.528699+0000","last_undegraded":"2026-02-17T04:22:13.528699+0000","last_fullsized":"2026-02-17T04:22:13.528699+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T08:19:43.881417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025232899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":95,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T04:22:13.639518+0000","last_change":"2026-02-17T04:22:03.505870+0000","last_active":"2026-02-17T04:22:13.639518+0000","last_peered":"2026-02-17T04:22:13.639518+0000","last_clean":"2026-02-17T04:22:13.639518+0000","last_became_active":"2026-02-17T04:22:03.505662+0000","last_became_peered":"2026-02-17T04:22:03.505662+0000","last_unstale":"2026-02-17T04:22:13.639518+0000","last_undegraded":"2026-02-17T04:22:13.639518+0000","last_fullsized":"2026-02-17T04:22:13.639518+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T07:53:41.824771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028003000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":103,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T04:22:14.197882+0000","last_change":"2026-02-17T04:22:14.197815+0000","last_active":"2026-02-17T04:22:14.197882+0000","last_peered":"2026-02-17T04:22:14.197882+0000","last_clean":"2026-02-17T04:22:14.197882+0000","last_became_active":"2026-02-17T04:22:14.197701+0000","last_became_peered":"2026-02-17T04:22:14.197701+0000","last_unstale":"2026-02-17T04:22:14.197882+0000","last_undegraded":"2026-02-17T04:22:14.197882+0000","last_fullsized":"2026-02-17T04:22:14.197882+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T09:38:48.807342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017771,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":77,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T04:22:13.640356+0000","last_change":"2026-02-17T04:22:13.640312+0000","last_active":"2026-02-17T04:22:13.640356+0000","last_peered":"2026-02-17T04:22:13.640356+0000","last_clean":"2026-02-17T04:22:13.640356+0000","last_became_active":"2026-02-17T04:22:13.640187+0000","last_became_peered":"2026-02-17T04:22:13.640187+0000","last_unstale":"2026-02-17T04:22:13.640356+0000","last_undegraded":"2026-02-17T04:22:13.640356+0000","last_fullsized":"2026-02-17T04:22:13.640356+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:57:15.928726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"17'1","reported_seq":92,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T04:22:13.529575+0000","last_change":"2026-02-17T04:22:13.529541+0000","last_active":"2026-02-17T04:22:13.529575+0000","last_peered":"2026-02-17T04:22:13.529575+0000","last_clean":"2026-02-17T04:22:13.529575+0000","last_became_active":"2026-02-17T04:22:13.529434+0000","last_became_peered":"2026-02-17T04:22:13.529434+0000","last_unstale":"2026-02-17T04:22:13.529575+0000","last_undegraded":"2026-02-17T04:22:13.529575+0000","last_fullsized":"2026-02-17T04:22:13.529575+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T09:47:30.119461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"19'2","reported_seq":99,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T04:22:13.529509+0000","last_change":"2026-02-17T04:22:13.529473+0000","last_active":"2026-02-17T04:22:13.529509+0000","last_peered":"2026-02-17T04:22:13.529509+0000","last_clean":"2026-02-17T04:22:13.529509+0000","last_became_active":"2026-02-17T04:22:13.529367+0000","last_became_peered":"2026-02-17T04:22:13.529367+0000","last_unstale":"2026-02-17T04:22:13.529509+0000","last_undegraded":"2026-02-17T04:22:13.529509+0000","last_fullsized":"2026-02-17T04:22:13.529509+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T10:58:31.526102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066248200000000004,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":70,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T04:22:13.639722+0000","last_change":"2026-02-17T04:22:03.505824+0000","last_active":"2026-02-17T04:22:13.639722+0000","last_peered":"2026-02-17T04:22:13.639722+0000","last_clean":"2026-02-17T04:22:13.639722+0000","last_became_active":"2026-02-17T04:22:03.505709+0000","last_became_peered":"2026-02-17T04:22:03.505709+0000","last_unstale":"2026-02-17T04:22:13.639722+0000","last_undegraded":"2026-02-17T04:22:13.639722+0000","last_fullsized":"2026-02-17T04:22:13.639722+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:34:03.058654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000203418,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":84,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T04:22:13.639737+0000","last_change":"2026-02-17T04:22:03.505939+0000","last_active":"2026-02-17T04:22:13.639737+0000","last_peered":"2026-02-17T04:22:13.639737+0000","last_clean":"2026-02-17T04:22:13.639737+0000","last_became_active":"2026-02-17T04:22:03.505839+0000","last_became_peered":"2026-02-17T04:22:03.505839+0000","last_unstale":"2026-02-17T04:22:13.639737+0000","last_undegraded":"2026-02-17T04:22:13.639737+0000","last_fullsized":"2026-02-17T04:22:13.639737+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T06:01:02.501503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":38,"seq":163208757265,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":302942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27747,"internal_metadata":27562909},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":44,"seq":188978561041,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":302942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27091,"internal_metadata":27563565},"hb_peers":[0,1,2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":44,"seq":188978561041,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":22,"kb_used_meta":26921,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":302942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23180,"internal_metadata":27567476},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561041,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":302942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27741,"internal_metadata":27562915},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":44,"seq":188978561041,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":302942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29044,"internal_metadata":27561612},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":44,"seq":188978561040,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27576,"kb_used_data":616,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104830024,"statfs":{"total":107374182400,"available":107345944576,"internally_reserved":0,"allocated":630784,"data_stored":302961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29044,"internal_metadata":27561612},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":44,"seq":188978561040,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":302942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27089,"internal_metadata":27563567},"hb_peers":[0,1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":44,"seq":188978561040,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":302942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28393,"internal_metadata":27562263},"hb_peers":[3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":54,"seq":231928234001,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27576,"kb_used_data":616,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830024,"statfs":{"total":107374182400,"available":107345944576,"internally_reserved":0,"allocated":630784,"data_stored":302961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27741,"internal_metadata":27562915},"hb_peers":[0,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":54,"seq":231928234000,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":302942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13420,"internal_metadata":27577236},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T04:22:21.168 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T04:22:21.342 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:22:21.343 INFO:teuthology.orchestra.run.trial040.stderr:dumped all 2026-02-17T04:22:21.351 INFO:teuthology.orchestra.run.trial040.stdout:{"pg_ready":true,"pg_map":{"version":83,"stamp":"2026-02-17T04:22:19.816926+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":275728,"kb_used_data":6128,"kb_used_omap":254,"kb_used_meta":269185,"kb_avail":1048300272,"statfs":{"total":1073741824000,"available":1073459478528,"internally_reserved":0,"allocated":6275072,"data_stored":3029458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":260490,"internal_metadata":275646070},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.000970"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":71,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T04:22:13.528699+0000","last_change":"2026-02-17T04:22:03.505832+0000","last_active":"2026-02-17T04:22:13.528699+0000","last_peered":"2026-02-17T04:22:13.528699+0000","last_clean":"2026-02-17T04:22:13.528699+0000","last_became_active":"2026-02-17T04:22:03.505690+0000","last_became_peered":"2026-02-17T04:22:03.505690+0000","last_unstale":"2026-02-17T04:22:13.528699+0000","last_undegraded":"2026-02-17T04:22:13.528699+0000","last_fullsized":"2026-02-17T04:22:13.528699+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T08:19:43.881417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025232899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":95,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T04:22:13.639518+0000","last_change":"2026-02-17T04:22:03.505870+0000","last_active":"2026-02-17T04:22:13.639518+0000","last_peered":"2026-02-17T04:22:13.639518+0000","last_clean":"2026-02-17T04:22:13.639518+0000","last_became_active":"2026-02-17T04:22:03.505662+0000","last_became_peered":"2026-02-17T04:22:03.505662+0000","last_unstale":"2026-02-17T04:22:13.639518+0000","last_undegraded":"2026-02-17T04:22:13.639518+0000","last_fullsized":"2026-02-17T04:22:13.639518+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T07:53:41.824771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028003000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":103,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T04:22:14.197882+0000","last_change":"2026-02-17T04:22:14.197815+0000","last_active":"2026-02-17T04:22:14.197882+0000","last_peered":"2026-02-17T04:22:14.197882+0000","last_clean":"2026-02-17T04:22:14.197882+0000","last_became_active":"2026-02-17T04:22:14.197701+0000","last_became_peered":"2026-02-17T04:22:14.197701+0000","last_unstale":"2026-02-17T04:22:14.197882+0000","last_undegraded":"2026-02-17T04:22:14.197882+0000","last_fullsized":"2026-02-17T04:22:14.197882+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T09:38:48.807342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017771,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":77,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T04:22:13.640356+0000","last_change":"2026-02-17T04:22:13.640312+0000","last_active":"2026-02-17T04:22:13.640356+0000","last_peered":"2026-02-17T04:22:13.640356+0000","last_clean":"2026-02-17T04:22:13.640356+0000","last_became_active":"2026-02-17T04:22:13.640187+0000","last_became_peered":"2026-02-17T04:22:13.640187+0000","last_unstale":"2026-02-17T04:22:13.640356+0000","last_undegraded":"2026-02-17T04:22:13.640356+0000","last_fullsized":"2026-02-17T04:22:13.640356+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:57:15.928726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"17'1","reported_seq":92,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T04:22:13.529575+0000","last_change":"2026-02-17T04:22:13.529541+0000","last_active":"2026-02-17T04:22:13.529575+0000","last_peered":"2026-02-17T04:22:13.529575+0000","last_clean":"2026-02-17T04:22:13.529575+0000","last_became_active":"2026-02-17T04:22:13.529434+0000","last_became_peered":"2026-02-17T04:22:13.529434+0000","last_unstale":"2026-02-17T04:22:13.529575+0000","last_undegraded":"2026-02-17T04:22:13.529575+0000","last_fullsized":"2026-02-17T04:22:13.529575+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T09:47:30.119461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"19'2","reported_seq":99,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T04:22:13.529509+0000","last_change":"2026-02-17T04:22:13.529473+0000","last_active":"2026-02-17T04:22:13.529509+0000","last_peered":"2026-02-17T04:22:13.529509+0000","last_clean":"2026-02-17T04:22:13.529509+0000","last_became_active":"2026-02-17T04:22:13.529367+0000","last_became_peered":"2026-02-17T04:22:13.529367+0000","last_unstale":"2026-02-17T04:22:13.529509+0000","last_undegraded":"2026-02-17T04:22:13.529509+0000","last_fullsized":"2026-02-17T04:22:13.529509+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T10:58:31.526102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066248200000000004,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":70,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T04:22:13.639722+0000","last_change":"2026-02-17T04:22:03.505824+0000","last_active":"2026-02-17T04:22:13.639722+0000","last_peered":"2026-02-17T04:22:13.639722+0000","last_clean":"2026-02-17T04:22:13.639722+0000","last_became_active":"2026-02-17T04:22:03.505709+0000","last_became_peered":"2026-02-17T04:22:03.505709+0000","last_unstale":"2026-02-17T04:22:13.639722+0000","last_undegraded":"2026-02-17T04:22:13.639722+0000","last_fullsized":"2026-02-17T04:22:13.639722+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:34:03.058654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000203418,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":84,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T04:22:13.639737+0000","last_change":"2026-02-17T04:22:03.505939+0000","last_active":"2026-02-17T04:22:13.639737+0000","last_peered":"2026-02-17T04:22:13.639737+0000","last_clean":"2026-02-17T04:22:13.639737+0000","last_became_active":"2026-02-17T04:22:03.505839+0000","last_became_peered":"2026-02-17T04:22:03.505839+0000","last_unstale":"2026-02-17T04:22:13.639737+0000","last_undegraded":"2026-02-17T04:22:13.639737+0000","last_fullsized":"2026-02-17T04:22:13.639737+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T06:01:02.501503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":38,"seq":163208757265,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":302942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27747,"internal_metadata":27562909},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":44,"seq":188978561041,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":302942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27091,"internal_metadata":27563565},"hb_peers":[0,1,2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":44,"seq":188978561041,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":22,"kb_used_meta":26921,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":302942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23180,"internal_metadata":27567476},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561041,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":302942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27741,"internal_metadata":27562915},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":44,"seq":188978561041,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":302942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29044,"internal_metadata":27561612},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":44,"seq":188978561040,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27576,"kb_used_data":616,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104830024,"statfs":{"total":107374182400,"available":107345944576,"internally_reserved":0,"allocated":630784,"data_stored":302961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29044,"internal_metadata":27561612},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":44,"seq":188978561040,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":302942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27089,"internal_metadata":27563567},"hb_peers":[0,1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":44,"seq":188978561040,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":302942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28393,"internal_metadata":27562263},"hb_peers":[3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":54,"seq":231928234001,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27576,"kb_used_data":616,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830024,"statfs":{"total":107374182400,"available":107345944576,"internally_reserved":0,"allocated":630784,"data_stored":302961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27741,"internal_metadata":27562915},"hb_peers":[0,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":54,"seq":231928234000,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":302942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13420,"internal_metadata":27577236},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T04:22:21.352 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-17T04:22:21.353 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T04:22:21.529 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:22:21.529 INFO:teuthology.orchestra.run.trial040.stderr:dumped all 2026-02-17T04:22:21.538 INFO:teuthology.orchestra.run.trial040.stdout:{"pg_ready":true,"pg_map":{"version":83,"stamp":"2026-02-17T04:22:19.816926+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":275728,"kb_used_data":6128,"kb_used_omap":254,"kb_used_meta":269185,"kb_avail":1048300272,"statfs":{"total":1073741824000,"available":1073459478528,"internally_reserved":0,"allocated":6275072,"data_stored":3029458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":260490,"internal_metadata":275646070},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.000970"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":71,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T04:22:13.528699+0000","last_change":"2026-02-17T04:22:03.505832+0000","last_active":"2026-02-17T04:22:13.528699+0000","last_peered":"2026-02-17T04:22:13.528699+0000","last_clean":"2026-02-17T04:22:13.528699+0000","last_became_active":"2026-02-17T04:22:03.505690+0000","last_became_peered":"2026-02-17T04:22:03.505690+0000","last_unstale":"2026-02-17T04:22:13.528699+0000","last_undegraded":"2026-02-17T04:22:13.528699+0000","last_fullsized":"2026-02-17T04:22:13.528699+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T08:19:43.881417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025232899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":95,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T04:22:13.639518+0000","last_change":"2026-02-17T04:22:03.505870+0000","last_active":"2026-02-17T04:22:13.639518+0000","last_peered":"2026-02-17T04:22:13.639518+0000","last_clean":"2026-02-17T04:22:13.639518+0000","last_became_active":"2026-02-17T04:22:03.505662+0000","last_became_peered":"2026-02-17T04:22:03.505662+0000","last_unstale":"2026-02-17T04:22:13.639518+0000","last_undegraded":"2026-02-17T04:22:13.639518+0000","last_fullsized":"2026-02-17T04:22:13.639518+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T07:53:41.824771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028003000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":103,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T04:22:14.197882+0000","last_change":"2026-02-17T04:22:14.197815+0000","last_active":"2026-02-17T04:22:14.197882+0000","last_peered":"2026-02-17T04:22:14.197882+0000","last_clean":"2026-02-17T04:22:14.197882+0000","last_became_active":"2026-02-17T04:22:14.197701+0000","last_became_peered":"2026-02-17T04:22:14.197701+0000","last_unstale":"2026-02-17T04:22:14.197882+0000","last_undegraded":"2026-02-17T04:22:14.197882+0000","last_fullsized":"2026-02-17T04:22:14.197882+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T09:38:48.807342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017771,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":77,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T04:22:13.640356+0000","last_change":"2026-02-17T04:22:13.640312+0000","last_active":"2026-02-17T04:22:13.640356+0000","last_peered":"2026-02-17T04:22:13.640356+0000","last_clean":"2026-02-17T04:22:13.640356+0000","last_became_active":"2026-02-17T04:22:13.640187+0000","last_became_peered":"2026-02-17T04:22:13.640187+0000","last_unstale":"2026-02-17T04:22:13.640356+0000","last_undegraded":"2026-02-17T04:22:13.640356+0000","last_fullsized":"2026-02-17T04:22:13.640356+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:57:15.928726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"17'1","reported_seq":92,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T04:22:13.529575+0000","last_change":"2026-02-17T04:22:13.529541+0000","last_active":"2026-02-17T04:22:13.529575+0000","last_peered":"2026-02-17T04:22:13.529575+0000","last_clean":"2026-02-17T04:22:13.529575+0000","last_became_active":"2026-02-17T04:22:13.529434+0000","last_became_peered":"2026-02-17T04:22:13.529434+0000","last_unstale":"2026-02-17T04:22:13.529575+0000","last_undegraded":"2026-02-17T04:22:13.529575+0000","last_fullsized":"2026-02-17T04:22:13.529575+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T09:47:30.119461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"19'2","reported_seq":99,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T04:22:13.529509+0000","last_change":"2026-02-17T04:22:13.529473+0000","last_active":"2026-02-17T04:22:13.529509+0000","last_peered":"2026-02-17T04:22:13.529509+0000","last_clean":"2026-02-17T04:22:13.529509+0000","last_became_active":"2026-02-17T04:22:13.529367+0000","last_became_peered":"2026-02-17T04:22:13.529367+0000","last_unstale":"2026-02-17T04:22:13.529509+0000","last_undegraded":"2026-02-17T04:22:13.529509+0000","last_fullsized":"2026-02-17T04:22:13.529509+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T10:58:31.526102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066248200000000004,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":70,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T04:22:13.639722+0000","last_change":"2026-02-17T04:22:03.505824+0000","last_active":"2026-02-17T04:22:13.639722+0000","last_peered":"2026-02-17T04:22:13.639722+0000","last_clean":"2026-02-17T04:22:13.639722+0000","last_became_active":"2026-02-17T04:22:03.505709+0000","last_became_peered":"2026-02-17T04:22:03.505709+0000","last_unstale":"2026-02-17T04:22:13.639722+0000","last_undegraded":"2026-02-17T04:22:13.639722+0000","last_fullsized":"2026-02-17T04:22:13.639722+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:34:03.058654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000203418,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":84,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T04:22:13.639737+0000","last_change":"2026-02-17T04:22:03.505939+0000","last_active":"2026-02-17T04:22:13.639737+0000","last_peered":"2026-02-17T04:22:13.639737+0000","last_clean":"2026-02-17T04:22:13.639737+0000","last_became_active":"2026-02-17T04:22:03.505839+0000","last_became_peered":"2026-02-17T04:22:03.505839+0000","last_unstale":"2026-02-17T04:22:13.639737+0000","last_undegraded":"2026-02-17T04:22:13.639737+0000","last_fullsized":"2026-02-17T04:22:13.639737+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T06:01:02.501503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":38,"seq":163208757265,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":302942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27747,"internal_metadata":27562909},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":44,"seq":188978561041,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":302942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27091,"internal_metadata":27563565},"hb_peers":[0,1,2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":44,"seq":188978561041,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":22,"kb_used_meta":26921,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":302942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23180,"internal_metadata":27567476},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561041,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":302942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27741,"internal_metadata":27562915},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":44,"seq":188978561041,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":302942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29044,"internal_metadata":27561612},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":44,"seq":188978561040,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27576,"kb_used_data":616,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104830024,"statfs":{"total":107374182400,"available":107345944576,"internally_reserved":0,"allocated":630784,"data_stored":302961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29044,"internal_metadata":27561612},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":44,"seq":188978561040,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":302942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27089,"internal_metadata":27563567},"hb_peers":[0,1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":44,"seq":188978561040,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":302942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28393,"internal_metadata":27562263},"hb_peers":[3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":54,"seq":231928234001,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27576,"kb_used_data":616,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830024,"statfs":{"total":107374182400,"available":107345944576,"internally_reserved":0,"allocated":630784,"data_stored":302961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27741,"internal_metadata":27562915},"hb_peers":[0,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":54,"seq":231928234000,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":302942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13420,"internal_metadata":27577236},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T04:22:21.539 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T04:22:21.718 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:22:21.718 INFO:teuthology.orchestra.run.trial040.stdout:{"epoch":55,"fsid":"1c4f66e4-59c5-4536-b735-09464fcda99a","created":"2026-02-17T04:21:01.447252+0000","modified":"2026-02-17T04:22:13.524561+0000","last_up_change":"2026-02-17T04:22:12.519985+0000","last_in_change":"2026-02-17T04:21:03.458211+0000","flags":"noout,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5800064,"flags_set":["noout","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":10,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":10,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-17T04:21:12.070856+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":0.80000001192092896,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1.0000001192092896,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b681887-684b-44e0-acf6-e5d30335ecb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":53,"up_from":54,"up_thru":34,"down_at":51,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6808","nonce":4283234326},{"type":"v1","addr":"10.20.193.40:6809","nonce":4283234326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6882","nonce":4286234326},{"type":"v1","addr":"10.20.193.40:6883","nonce":4286234326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6814","nonce":4283234326},{"type":"v1","addr":"10.20.193.40:6815","nonce":4283234326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6812","nonce":4283234326},{"type":"v1","addr":"10.20.193.40:6813","nonce":4283234326}]},"public_addr":"10.20.193.40:6809/4283234326","cluster_addr":"10.20.193.40:6883/4286234326","heartbeat_back_addr":"10.20.193.40:6815/4283234326","heartbeat_front_addr":"10.20.193.40:6813/4283234326","state":["exists","up"]},{"osd":1,"uuid":"e9ffe230-1fbf-4cb0-a60b-04616c81fb04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":53,"up_from":54,"up_thru":54,"down_at":51,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6816","nonce":3385366208},{"type":"v1","addr":"10.20.193.40:6817","nonce":3385366208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6803","nonce":3388366208},{"type":"v1","addr":"10.20.193.40:6811","nonce":3388366208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6826","nonce":3385366208},{"type":"v1","addr":"10.20.193.40:6828","nonce":3385366208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6822","nonce":3385366208},{"type":"v1","addr":"10.20.193.40:6824","nonce":3385366208}]},"public_addr":"10.20.193.40:6817/3385366208","cluster_addr":"10.20.193.40:6811/3388366208","heartbeat_back_addr":"10.20.193.40:6828/3385366208","heartbeat_front_addr":"10.20.193.40:6824/3385366208","state":["exists","up"]},{"osd":2,"uuid":"f7462c2d-bfc0-425b-9f80-6e1ba496c5eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":43,"up_from":44,"up_thru":0,"down_at":41,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6831","nonce":2181329830},{"type":"v1","addr":"10.20.193.40:6833","nonce":2181329830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6820","nonce":2182329830},{"type":"v1","addr":"10.20.193.40:6846","nonce":2182329830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6838","nonce":2181329830},{"type":"v1","addr":"10.20.193.40:6839","nonce":2181329830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6836","nonce":2181329830},{"type":"v1","addr":"10.20.193.40:6837","nonce":2181329830}]},"public_addr":"10.20.193.40:6833/2181329830","cluster_addr":"10.20.193.40:6846/2182329830","heartbeat_back_addr":"10.20.193.40:6839/2181329830","heartbeat_front_addr":"10.20.193.40:6837/2181329830","state":["exists","up"]},{"osd":3,"uuid":"883cff36-bdc9-42b5-a441-2c41cbcaa436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":43,"up_from":44,"up_thru":54,"down_at":41,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6840","nonce":1295939956},{"type":"v1","addr":"10.20.193.40:6842","nonce":1295939956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6861","nonce":1296939956},{"type":"v1","addr":"10.20.193.40:6863","nonce":1296939956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6854","nonce":1295939956},{"type":"v1","addr":"10.20.193.40:6856","nonce":1295939956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6848","nonce":1295939956},{"type":"v1","addr":"10.20.193.40:6850","nonce":1295939956}]},"public_addr":"10.20.193.40:6842/1295939956","cluster_addr":"10.20.193.40:6863/1296939956","heartbeat_back_addr":"10.20.193.40:6856/1295939956","heartbeat_front_addr":"10.20.193.40:6850/1295939956","state":["exists","up"]},{"osd":4,"uuid":"f064d240-a32d-4fc5-b325-b1ee001ae26a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":43,"up_from":44,"up_thru":54,"down_at":41,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6800","nonce":638920431},{"type":"v1","addr":"10.20.193.40:6801","nonce":638920431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6834","nonce":639920431},{"type":"v1","addr":"10.20.193.40:6862","nonce":639920431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6806","nonce":638920431},{"type":"v1","addr":"10.20.193.40:6807","nonce":638920431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6804","nonce":638920431},{"type":"v1","addr":"10.20.193.40:6805","nonce":638920431}]},"public_addr":"10.20.193.40:6801/638920431","cluster_addr":"10.20.193.40:6862/639920431","heartbeat_back_addr":"10.20.193.40:6807/638920431","heartbeat_front_addr":"10.20.193.40:6805/638920431","state":["exists","up"]},{"osd":5,"uuid":"ed482956-372f-4226-958c-90e7cfb56aa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":43,"up_from":44,"up_thru":44,"down_at":41,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6819","nonce":1934147018},{"type":"v1","addr":"10.20.193.40:6821","nonce":1934147018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6860","nonce":1935147018},{"type":"v1","addr":"10.20.193.40:6810","nonce":1935147018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6830","nonce":1934147018},{"type":"v1","addr":"10.20.193.40:6832","nonce":1934147018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6827","nonce":1934147018},{"type":"v1","addr":"10.20.193.40:6829","nonce":1934147018}]},"public_addr":"10.20.193.40:6821/1934147018","cluster_addr":"10.20.193.40:6810/1935147018","heartbeat_back_addr":"10.20.193.40:6832/1934147018","heartbeat_front_addr":"10.20.193.40:6829/1934147018","state":["exists","up"]},{"osd":6,"uuid":"7452861a-0234-4f3c-a239-d8b337b95edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":43,"up_from":44,"up_thru":51,"down_at":41,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6852","nonce":2694185867},{"type":"v1","addr":"10.20.193.40:6858","nonce":2694185867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6802","nonce":2695185867},{"type":"v1","addr":"10.20.193.40:6835","nonce":2695185867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6868","nonce":2694185867},{"type":"v1","addr":"10.20.193.40:6870","nonce":2694185867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6865","nonce":2694185867},{"type":"v1","addr":"10.20.193.40:6867","nonce":2694185867}]},"public_addr":"10.20.193.40:6858/2694185867","cluster_addr":"10.20.193.40:6835/2695185867","heartbeat_back_addr":"10.20.193.40:6870/2694185867","heartbeat_front_addr":"10.20.193.40:6867/2694185867","state":["exists","up"]},{"osd":7,"uuid":"b8767e59-833b-4e55-a19c-e7f9a1f48dd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":43,"up_from":44,"up_thru":44,"down_at":41,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6853","nonce":2830531925},{"type":"v1","addr":"10.20.193.40:6857","nonce":2830531925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6874","nonce":2831531925},{"type":"v1","addr":"10.20.193.40:6875","nonce":2831531925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6869","nonce":2830531925},{"type":"v1","addr":"10.20.193.40:6871","nonce":2830531925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6864","nonce":2830531925},{"type":"v1","addr":"10.20.193.40:6866","nonce":2830531925}]},"public_addr":"10.20.193.40:6857/2830531925","cluster_addr":"10.20.193.40:6875/2831531925","heartbeat_back_addr":"10.20.193.40:6871/2830531925","heartbeat_front_addr":"10.20.193.40:6866/2830531925","state":["exists","up"]},{"osd":8,"uuid":"99853150-03af-45d5-ae45-182cefcf001c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":43,"up_from":44,"up_thru":16,"down_at":41,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6841","nonce":4097151982},{"type":"v1","addr":"10.20.193.40:6843","nonce":4097151982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6823","nonce":4099151982},{"type":"v1","addr":"10.20.193.40:6825","nonce":4099151982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6855","nonce":4097151982},{"type":"v1","addr":"10.20.193.40:6859","nonce":4097151982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6849","nonce":4097151982},{"type":"v1","addr":"10.20.193.40:6851","nonce":4097151982}]},"public_addr":"10.20.193.40:6843/4097151982","cluster_addr":"10.20.193.40:6825/4099151982","heartbeat_back_addr":"10.20.193.40:6859/4097151982","heartbeat_front_addr":"10.20.193.40:6851/4097151982","state":["exists","up"]},{"osd":9,"uuid":"e15bab05-6ad7-49e7-999c-6fbb6fb16d33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":37,"up_from":38,"up_thru":54,"down_at":34,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6872","nonce":389288580},{"type":"v1","addr":"10.20.193.40:6873","nonce":389288580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6845","nonce":390288580},{"type":"v1","addr":"10.20.193.40:6847","nonce":390288580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6878","nonce":389288580},{"type":"v1","addr":"10.20.193.40:6879","nonce":389288580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6876","nonce":389288580},{"type":"v1","addr":"10.20.193.40:6877","nonce":389288580}]},"public_addr":"10.20.193.40:6873/389288580","cluster_addr":"10.20.193.40:6847/390288580","heartbeat_back_addr":"10.20.193.40:6879/389288580","heartbeat_front_addr":"10.20.193.40:6877/389288580","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"2026-02-17T04:22:09.513800+0000","laggy_probability":0.65700000524520874,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T04:21:05.094937+0000","dead_epoch":51},{"osd":1,"down_stamp":"2026-02-17T04:22:09.513800+0000","laggy_probability":0.65700000524520874,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T04:21:05.243773+0000","dead_epoch":51},{"osd":2,"down_stamp":"2026-02-17T04:21:59.490567+0000","laggy_probability":0.30000001192092896,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T04:21:05.130417+0000","dead_epoch":42},{"osd":3,"down_stamp":"2026-02-17T04:21:59.490567+0000","laggy_probability":0.30000001192092896,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T04:21:05.117077+0000","dead_epoch":42},{"osd":4,"down_stamp":"2026-02-17T04:21:59.490567+0000","laggy_probability":0.30000001192092896,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T04:21:05.117648+0000","dead_epoch":42},{"osd":5,"down_stamp":"2026-02-17T04:21:59.490567+0000","laggy_probability":0.30000001192092896,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T04:21:05.157662+0000","dead_epoch":41},{"osd":6,"down_stamp":"2026-02-17T04:21:59.490567+0000","laggy_probability":0.30000001192092896,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T04:21:05.174084+0000","dead_epoch":42},{"osd":7,"down_stamp":"2026-02-17T04:21:59.490567+0000","laggy_probability":0.30000001192092896,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T04:21:05.164426+0000","dead_epoch":41},{"osd":8,"down_stamp":"2026-02-17T04:21:59.490567+0000","laggy_probability":0.50999999046325684,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T04:21:05.139982+0000","dead_epoch":41},{"osd":9,"down_stamp":"2026-02-17T04:21:52.477065+0000","laggy_probability":0.30000001192092896,"laggy_interval":1,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T04:21:05.171249+0000","dead_epoch":37}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T04:22:22.728 INFO:tasks.ceph:Scrubbing osd.0 2026-02-17T04:22:22.728 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-17T04:22:22.809 INFO:teuthology.orchestra.run.trial040.stdout:{ 2026-02-17T04:22:22.809 INFO:teuthology.orchestra.run.trial040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T04:22:22.809 INFO:teuthology.orchestra.run.trial040.stdout:} 2026-02-17T04:22:22.814 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-17T04:22:22.990 INFO:teuthology.orchestra.run.trial040.stderr:instructed osd(s) 0 to deep-scrub 2026-02-17T04:22:22.999 INFO:tasks.ceph:Scrubbing osd.1 2026-02-17T04:22:22.999 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-17T04:22:23.081 INFO:teuthology.orchestra.run.trial040.stdout:{ 2026-02-17T04:22:23.081 INFO:teuthology.orchestra.run.trial040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T04:22:23.081 INFO:teuthology.orchestra.run.trial040.stdout:} 2026-02-17T04:22:23.089 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-17T04:22:23.265 INFO:teuthology.orchestra.run.trial040.stderr:instructed osd(s) 1 to deep-scrub 2026-02-17T04:22:23.274 INFO:tasks.ceph:Scrubbing osd.2 2026-02-17T04:22:23.275 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-17T04:22:23.358 INFO:teuthology.orchestra.run.trial040.stdout:{ 2026-02-17T04:22:23.358 INFO:teuthology.orchestra.run.trial040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T04:22:23.358 INFO:teuthology.orchestra.run.trial040.stdout:} 2026-02-17T04:22:23.364 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-17T04:22:23.543 INFO:teuthology.orchestra.run.trial040.stderr:instructed osd(s) 2 to deep-scrub 2026-02-17T04:22:23.553 INFO:tasks.ceph:Scrubbing osd.3 2026-02-17T04:22:23.554 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2026-02-17T04:22:23.636 INFO:teuthology.orchestra.run.trial040.stdout:{ 2026-02-17T04:22:23.636 INFO:teuthology.orchestra.run.trial040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T04:22:23.636 INFO:teuthology.orchestra.run.trial040.stdout:} 2026-02-17T04:22:23.642 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2026-02-17T04:22:23.821 INFO:teuthology.orchestra.run.trial040.stderr:instructed osd(s) 3 to deep-scrub 2026-02-17T04:22:23.830 INFO:tasks.ceph:Scrubbing osd.4 2026-02-17T04:22:23.831 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2026-02-17T04:22:23.912 INFO:teuthology.orchestra.run.trial040.stdout:{ 2026-02-17T04:22:23.913 INFO:teuthology.orchestra.run.trial040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T04:22:23.913 INFO:teuthology.orchestra.run.trial040.stdout:} 2026-02-17T04:22:23.918 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2026-02-17T04:22:24.094 INFO:teuthology.orchestra.run.trial040.stderr:instructed osd(s) 4 to deep-scrub 2026-02-17T04:22:24.103 INFO:tasks.ceph:Scrubbing osd.5 2026-02-17T04:22:24.103 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2026-02-17T04:22:24.183 INFO:teuthology.orchestra.run.trial040.stdout:{ 2026-02-17T04:22:24.184 INFO:teuthology.orchestra.run.trial040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T04:22:24.184 INFO:teuthology.orchestra.run.trial040.stdout:} 2026-02-17T04:22:24.191 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2026-02-17T04:22:24.366 INFO:teuthology.orchestra.run.trial040.stderr:instructed osd(s) 5 to deep-scrub 2026-02-17T04:22:24.375 INFO:tasks.ceph:Scrubbing osd.6 2026-02-17T04:22:24.375 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2026-02-17T04:22:24.456 INFO:teuthology.orchestra.run.trial040.stdout:{ 2026-02-17T04:22:24.456 INFO:teuthology.orchestra.run.trial040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T04:22:24.456 INFO:teuthology.orchestra.run.trial040.stdout:} 2026-02-17T04:22:24.465 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2026-02-17T04:22:24.639 INFO:teuthology.orchestra.run.trial040.stderr:instructed osd(s) 6 to deep-scrub 2026-02-17T04:22:24.647 INFO:tasks.ceph:Scrubbing osd.7 2026-02-17T04:22:24.647 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2026-02-17T04:22:24.729 INFO:teuthology.orchestra.run.trial040.stdout:{ 2026-02-17T04:22:24.729 INFO:teuthology.orchestra.run.trial040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T04:22:24.729 INFO:teuthology.orchestra.run.trial040.stdout:} 2026-02-17T04:22:24.735 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2026-02-17T04:22:24.911 INFO:teuthology.orchestra.run.trial040.stderr:instructed osd(s) 7 to deep-scrub 2026-02-17T04:22:24.920 INFO:tasks.ceph:Scrubbing osd.8 2026-02-17T04:22:24.921 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 config set osd_debug_deep_scrub_sleep 0 2026-02-17T04:22:25.002 INFO:teuthology.orchestra.run.trial040.stdout:{ 2026-02-17T04:22:25.002 INFO:teuthology.orchestra.run.trial040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T04:22:25.002 INFO:teuthology.orchestra.run.trial040.stdout:} 2026-02-17T04:22:25.009 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 8 2026-02-17T04:22:25.187 INFO:teuthology.orchestra.run.trial040.stderr:instructed osd(s) 8 to deep-scrub 2026-02-17T04:22:25.198 INFO:tasks.ceph:Scrubbing osd.9 2026-02-17T04:22:25.198 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 config set osd_debug_deep_scrub_sleep 0 2026-02-17T04:22:25.280 INFO:teuthology.orchestra.run.trial040.stdout:{ 2026-02-17T04:22:25.281 INFO:teuthology.orchestra.run.trial040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T04:22:25.281 INFO:teuthology.orchestra.run.trial040.stdout:} 2026-02-17T04:22:25.286 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 9 2026-02-17T04:22:25.465 INFO:teuthology.orchestra.run.trial040.stderr:instructed osd(s) 9 to deep-scrub 2026-02-17T04:22:25.474 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T04:22:25.649 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:22:25.650 INFO:teuthology.orchestra.run.trial040.stderr:dumped all 2026-02-17T04:22:25.657 INFO:teuthology.orchestra.run.trial040.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2026-02-17T04:22:23.817411+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":275728,"kb_used_data":6128,"kb_used_omap":254,"kb_used_meta":269185,"kb_avail":1048300272,"statfs":{"total":1073741824000,"available":1073459478528,"internally_reserved":0,"allocated":6275072,"data_stored":3029458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":260490,"internal_metadata":275646070},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.289985"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":71,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T04:22:13.528699+0000","last_change":"2026-02-17T04:22:03.505832+0000","last_active":"2026-02-17T04:22:13.528699+0000","last_peered":"2026-02-17T04:22:13.528699+0000","last_clean":"2026-02-17T04:22:13.528699+0000","last_became_active":"2026-02-17T04:22:03.505690+0000","last_became_peered":"2026-02-17T04:22:03.505690+0000","last_unstale":"2026-02-17T04:22:13.528699+0000","last_undegraded":"2026-02-17T04:22:13.528699+0000","last_fullsized":"2026-02-17T04:22:13.528699+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T08:19:43.881417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025232899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":95,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T04:22:13.639518+0000","last_change":"2026-02-17T04:22:03.505870+0000","last_active":"2026-02-17T04:22:13.639518+0000","last_peered":"2026-02-17T04:22:13.639518+0000","last_clean":"2026-02-17T04:22:13.639518+0000","last_became_active":"2026-02-17T04:22:03.505662+0000","last_became_peered":"2026-02-17T04:22:03.505662+0000","last_unstale":"2026-02-17T04:22:13.639518+0000","last_undegraded":"2026-02-17T04:22:13.639518+0000","last_fullsized":"2026-02-17T04:22:13.639518+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T07:53:41.824771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028003000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":103,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T04:22:14.197882+0000","last_change":"2026-02-17T04:22:14.197815+0000","last_active":"2026-02-17T04:22:14.197882+0000","last_peered":"2026-02-17T04:22:14.197882+0000","last_clean":"2026-02-17T04:22:14.197882+0000","last_became_active":"2026-02-17T04:22:14.197701+0000","last_became_peered":"2026-02-17T04:22:14.197701+0000","last_unstale":"2026-02-17T04:22:14.197882+0000","last_undegraded":"2026-02-17T04:22:14.197882+0000","last_fullsized":"2026-02-17T04:22:14.197882+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T09:38:48.807342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017771,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":77,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T04:22:13.640356+0000","last_change":"2026-02-17T04:22:13.640312+0000","last_active":"2026-02-17T04:22:13.640356+0000","last_peered":"2026-02-17T04:22:13.640356+0000","last_clean":"2026-02-17T04:22:13.640356+0000","last_became_active":"2026-02-17T04:22:13.640187+0000","last_became_peered":"2026-02-17T04:22:13.640187+0000","last_unstale":"2026-02-17T04:22:13.640356+0000","last_undegraded":"2026-02-17T04:22:13.640356+0000","last_fullsized":"2026-02-17T04:22:13.640356+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:57:15.928726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"17'1","reported_seq":92,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T04:22:13.529575+0000","last_change":"2026-02-17T04:22:13.529541+0000","last_active":"2026-02-17T04:22:13.529575+0000","last_peered":"2026-02-17T04:22:13.529575+0000","last_clean":"2026-02-17T04:22:13.529575+0000","last_became_active":"2026-02-17T04:22:13.529434+0000","last_became_peered":"2026-02-17T04:22:13.529434+0000","last_unstale":"2026-02-17T04:22:13.529575+0000","last_undegraded":"2026-02-17T04:22:13.529575+0000","last_fullsized":"2026-02-17T04:22:13.529575+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T09:47:30.119461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"19'2","reported_seq":99,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T04:22:13.529509+0000","last_change":"2026-02-17T04:22:13.529473+0000","last_active":"2026-02-17T04:22:13.529509+0000","last_peered":"2026-02-17T04:22:13.529509+0000","last_clean":"2026-02-17T04:22:13.529509+0000","last_became_active":"2026-02-17T04:22:13.529367+0000","last_became_peered":"2026-02-17T04:22:13.529367+0000","last_unstale":"2026-02-17T04:22:13.529509+0000","last_undegraded":"2026-02-17T04:22:13.529509+0000","last_fullsized":"2026-02-17T04:22:13.529509+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T10:58:31.526102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066248200000000004,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":70,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T04:22:13.639722+0000","last_change":"2026-02-17T04:22:03.505824+0000","last_active":"2026-02-17T04:22:13.639722+0000","last_peered":"2026-02-17T04:22:13.639722+0000","last_clean":"2026-02-17T04:22:13.639722+0000","last_became_active":"2026-02-17T04:22:03.505709+0000","last_became_peered":"2026-02-17T04:22:03.505709+0000","last_unstale":"2026-02-17T04:22:13.639722+0000","last_undegraded":"2026-02-17T04:22:13.639722+0000","last_fullsized":"2026-02-17T04:22:13.639722+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:34:03.058654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000203418,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":84,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T04:22:13.639737+0000","last_change":"2026-02-17T04:22:03.505939+0000","last_active":"2026-02-17T04:22:13.639737+0000","last_peered":"2026-02-17T04:22:13.639737+0000","last_clean":"2026-02-17T04:22:13.639737+0000","last_became_active":"2026-02-17T04:22:03.505839+0000","last_became_peered":"2026-02-17T04:22:03.505839+0000","last_unstale":"2026-02-17T04:22:13.639737+0000","last_undegraded":"2026-02-17T04:22:13.639737+0000","last_fullsized":"2026-02-17T04:22:13.639737+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:21:12.845335+0000","last_clean_scrub_stamp":"2026-02-17T04:21:12.845335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T06:01:02.501503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":38,"seq":163208757266,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":302942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27747,"internal_metadata":27562909},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":44,"seq":188978561042,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":302942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27091,"internal_metadata":27563565},"hb_peers":[0,1,2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":44,"seq":188978561042,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":22,"kb_used_meta":26921,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":302942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23180,"internal_metadata":27567476},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561042,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":302942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27741,"internal_metadata":27562915},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":44,"seq":188978561042,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":302942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29044,"internal_metadata":27561612},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":44,"seq":188978561041,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27576,"kb_used_data":616,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104830024,"statfs":{"total":107374182400,"available":107345944576,"internally_reserved":0,"allocated":630784,"data_stored":302961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29044,"internal_metadata":27561612},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":44,"seq":188978561041,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":302942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27089,"internal_metadata":27563567},"hb_peers":[0,1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":44,"seq":188978561041,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":302942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28393,"internal_metadata":27562263},"hb_peers":[0,1,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":54,"seq":231928234002,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27576,"kb_used_data":616,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830024,"statfs":{"total":107374182400,"available":107345944576,"internally_reserved":0,"allocated":630784,"data_stored":302961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27741,"internal_metadata":27562915},"hb_peers":[0,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":54,"seq":231928234001,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":302942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13420,"internal_metadata":27577236},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T04:22:25.662 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2026-02-17T04:21:12.845335+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=4, tm_min=21, tm_sec=12, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=4, tm_min=22, tm_sec=21, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T04:22:25.663 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2026-02-17T04:21:12.845335+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=4, tm_min=21, tm_sec=12, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=4, tm_min=22, tm_sec=21, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T04:22:25.663 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2026-02-17T04:21:12.845335+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=4, tm_min=21, tm_sec=12, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=4, tm_min=22, tm_sec=21, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T04:22:25.663 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2026-02-17T04:21:12.845335+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=4, tm_min=21, tm_sec=12, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=4, tm_min=22, tm_sec=21, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T04:22:25.663 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2026-02-17T04:21:12.845335+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=4, tm_min=21, tm_sec=12, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=4, tm_min=22, tm_sec=21, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T04:22:25.663 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2026-02-17T04:21:12.845335+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=4, tm_min=21, tm_sec=12, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=4, tm_min=22, tm_sec=21, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T04:22:25.664 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2026-02-17T04:21:12.845335+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=4, tm_min=21, tm_sec=12, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=4, tm_min=22, tm_sec=21, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T04:22:25.664 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-17T04:21:12.845335+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=4, tm_min=21, tm_sec=12, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=4, tm_min=22, tm_sec=21, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T04:22:25.664 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-17T04:22:45.665 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T04:22:45.841 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T04:22:45.842 INFO:teuthology.orchestra.run.trial040.stderr:dumped all 2026-02-17T04:22:45.851 INFO:teuthology.orchestra.run.trial040.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2026-02-17T04:22:45.819394+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":275728,"kb_used_data":6128,"kb_used_omap":254,"kb_used_meta":269185,"kb_avail":1048300272,"statfs":{"total":1073741824000,"available":1073459478528,"internally_reserved":0,"allocated":6275072,"data_stored":3029458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":260490,"internal_metadata":275646070},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.000988"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":79,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T04:22:24.987795+0000","last_change":"2026-02-17T04:22:24.987795+0000","last_active":"2026-02-17T04:22:24.987795+0000","last_peered":"2026-02-17T04:22:24.987795+0000","last_clean":"2026-02-17T04:22:24.987795+0000","last_became_active":"2026-02-17T04:22:03.505690+0000","last_became_peered":"2026-02-17T04:22:03.505690+0000","last_unstale":"2026-02-17T04:22:24.987795+0000","last_undegraded":"2026-02-17T04:22:24.987795+0000","last_fullsized":"2026-02-17T04:22:24.987795+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:22:24.987751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:22:24.987751+0000","last_clean_scrub_stamp":"2026-02-17T04:22:24.987751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:10:33.341460+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00025232899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":103,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T04:22:25.371167+0000","last_change":"2026-02-17T04:22:25.371167+0000","last_active":"2026-02-17T04:22:25.371167+0000","last_peered":"2026-02-17T04:22:25.371167+0000","last_clean":"2026-02-17T04:22:25.371167+0000","last_became_active":"2026-02-17T04:22:03.505662+0000","last_became_peered":"2026-02-17T04:22:03.505662+0000","last_unstale":"2026-02-17T04:22:25.371167+0000","last_undegraded":"2026-02-17T04:22:25.371167+0000","last_fullsized":"2026-02-17T04:22:25.371167+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:22:25.371136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:22:25.371136+0000","last_clean_scrub_stamp":"2026-02-17T04:22:25.371136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T06:28:42.314250+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00028003000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":111,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T04:22:26.037832+0000","last_change":"2026-02-17T04:22:26.037832+0000","last_active":"2026-02-17T04:22:26.037832+0000","last_peered":"2026-02-17T04:22:26.037832+0000","last_clean":"2026-02-17T04:22:26.037832+0000","last_became_active":"2026-02-17T04:22:14.197701+0000","last_became_peered":"2026-02-17T04:22:14.197701+0000","last_unstale":"2026-02-17T04:22:26.037832+0000","last_undegraded":"2026-02-17T04:22:26.037832+0000","last_fullsized":"2026-02-17T04:22:26.037832+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:22:26.037778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:22:26.037778+0000","last_clean_scrub_stamp":"2026-02-17T04:22:26.037778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:52:03.178619+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00017771,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":85,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T04:22:23.342577+0000","last_change":"2026-02-17T04:22:23.342577+0000","last_active":"2026-02-17T04:22:23.342577+0000","last_peered":"2026-02-17T04:22:23.342577+0000","last_clean":"2026-02-17T04:22:23.342577+0000","last_became_active":"2026-02-17T04:22:13.640187+0000","last_became_peered":"2026-02-17T04:22:13.640187+0000","last_unstale":"2026-02-17T04:22:23.342577+0000","last_undegraded":"2026-02-17T04:22:23.342577+0000","last_fullsized":"2026-02-17T04:22:23.342577+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:22:23.342543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:22:23.342543+0000","last_clean_scrub_stamp":"2026-02-17T04:22:23.342543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T06:13:30.396587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"55'2","reported_seq":101,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T04:22:24.036451+0000","last_change":"2026-02-17T04:22:24.036451+0000","last_active":"2026-02-17T04:22:24.036451+0000","last_peered":"2026-02-17T04:22:24.036451+0000","last_clean":"2026-02-17T04:22:24.036451+0000","last_became_active":"2026-02-17T04:22:13.529434+0000","last_became_peered":"2026-02-17T04:22:13.529434+0000","last_unstale":"2026-02-17T04:22:24.036451+0000","last_undegraded":"2026-02-17T04:22:24.036451+0000","last_fullsized":"2026-02-17T04:22:24.036451+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'2","last_scrub_stamp":"2026-02-17T04:22:24.036426+0000","last_deep_scrub":"55'2","last_deep_scrub_stamp":"2026-02-17T04:22:24.036426+0000","last_clean_scrub_stamp":"2026-02-17T04:22:24.036426+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T09:51:10.483572+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"55'3","reported_seq":108,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T04:22:25.117208+0000","last_change":"2026-02-17T04:22:25.117208+0000","last_active":"2026-02-17T04:22:25.117208+0000","last_peered":"2026-02-17T04:22:25.117208+0000","last_clean":"2026-02-17T04:22:25.117208+0000","last_became_active":"2026-02-17T04:22:13.529367+0000","last_became_peered":"2026-02-17T04:22:13.529367+0000","last_unstale":"2026-02-17T04:22:25.117208+0000","last_undegraded":"2026-02-17T04:22:25.117208+0000","last_fullsized":"2026-02-17T04:22:25.117208+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'3","last_scrub_stamp":"2026-02-17T04:22:25.117183+0000","last_deep_scrub":"55'3","last_deep_scrub_stamp":"2026-02-17T04:22:25.117183+0000","last_clean_scrub_stamp":"2026-02-17T04:22:25.117183+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:48:35.401644+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00066248200000000004,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":78,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T04:22:25.164219+0000","last_change":"2026-02-17T04:22:25.164219+0000","last_active":"2026-02-17T04:22:25.164219+0000","last_peered":"2026-02-17T04:22:25.164219+0000","last_clean":"2026-02-17T04:22:25.164219+0000","last_became_active":"2026-02-17T04:22:03.505709+0000","last_became_peered":"2026-02-17T04:22:03.505709+0000","last_unstale":"2026-02-17T04:22:25.164219+0000","last_undegraded":"2026-02-17T04:22:25.164219+0000","last_fullsized":"2026-02-17T04:22:25.164219+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:22:25.164181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:22:25.164181+0000","last_clean_scrub_stamp":"2026-02-17T04:22:25.164181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T09:00:58.397393+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.000203418,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":92,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T04:22:25.373195+0000","last_change":"2026-02-17T04:22:25.373195+0000","last_active":"2026-02-17T04:22:25.373195+0000","last_peered":"2026-02-17T04:22:25.373195+0000","last_clean":"2026-02-17T04:22:25.373195+0000","last_became_active":"2026-02-17T04:22:03.505839+0000","last_became_peered":"2026-02-17T04:22:03.505839+0000","last_unstale":"2026-02-17T04:22:25.373195+0000","last_undegraded":"2026-02-17T04:22:25.373195+0000","last_fullsized":"2026-02-17T04:22:25.373195+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T04:22:25.373170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T04:22:25.373170+0000","last_clean_scrub_stamp":"2026-02-17T04:22:25.373170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:37:37.481495+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":38,"seq":163208757270,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":302942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27747,"internal_metadata":27562909},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":44,"seq":188978561046,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":302942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27091,"internal_metadata":27563565},"hb_peers":[0,1,2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":44,"seq":188978561046,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":22,"kb_used_meta":26921,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":302942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23180,"internal_metadata":27567476},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561046,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":302942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27741,"internal_metadata":27562915},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":44,"seq":188978561046,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":302942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29044,"internal_metadata":27561612},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":44,"seq":188978561045,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27576,"kb_used_data":616,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104830024,"statfs":{"total":107374182400,"available":107345944576,"internally_reserved":0,"allocated":630784,"data_stored":302961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29044,"internal_metadata":27561612},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":44,"seq":188978561045,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":302942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27089,"internal_metadata":27563567},"hb_peers":[0,1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":44,"seq":188978561045,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":302942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28393,"internal_metadata":27562263},"hb_peers":[0,1,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":54,"seq":231928234006,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27576,"kb_used_data":616,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830024,"statfs":{"total":107374182400,"available":107345944576,"internally_reserved":0,"allocated":630784,"data_stored":302961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27741,"internal_metadata":27562915},"hb_peers":[0,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":54,"seq":231928234005,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":302942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13420,"internal_metadata":27577236},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T04:22:45.852 DEBUG:teuthology.orchestra.run.trial040:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-17T04:22:46.038 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-17T04:22:46.038 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-17T04:22:46.038 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-17T04:22:46.038 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T04:22:46.074 INFO:tasks.ceph.osd.0:Stopped 2026-02-17T04:22:46.075 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-17T04:22:46.075 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T04:22:46.144 INFO:tasks.ceph.osd.1:Stopped 2026-02-17T04:22:46.144 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-17T04:22:46.144 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T04:22:46.209 INFO:tasks.ceph.osd.2:Stopped 2026-02-17T04:22:46.209 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-17T04:22:46.209 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T04:22:46.284 INFO:tasks.ceph.osd.3:Stopped 2026-02-17T04:22:46.284 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2026-02-17T04:22:46.284 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T04:22:46.367 INFO:tasks.ceph.osd.4:Stopped 2026-02-17T04:22:46.367 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2026-02-17T04:22:46.367 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T04:22:46.390 INFO:tasks.ceph.osd.5:Stopped 2026-02-17T04:22:46.390 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2026-02-17T04:22:46.390 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T04:22:46.454 INFO:tasks.ceph.osd.6:Stopped 2026-02-17T04:22:46.454 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2026-02-17T04:22:46.454 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T04:22:46.528 INFO:tasks.ceph.osd.7:Stopped 2026-02-17T04:22:46.529 DEBUG:tasks.ceph.osd.8:waiting for process to exit 2026-02-17T04:22:46.529 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T04:22:46.601 INFO:tasks.ceph.osd.8:Stopped 2026-02-17T04:22:46.601 DEBUG:tasks.ceph.osd.9:waiting for process to exit 2026-02-17T04:22:46.601 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T04:22:46.667 INFO:tasks.ceph.osd.9:Stopped 2026-02-17T04:22:46.668 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-17T04:22:46.668 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-17T04:22:46.668 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T04:22:46.740 INFO:tasks.ceph.mgr.x:Stopped 2026-02-17T04:22:46.740 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-17T04:22:46.740 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-17T04:22:46.741 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T04:22:46.789 INFO:tasks.ceph.mon.a:Stopped 2026-02-17T04:22:46.789 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-17T04:22:46.790 DEBUG:teuthology.orchestra.run.trial040:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | grep -E -v 'but it is still running' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSDMAP_FLAGS\)' | grep -E -v '\(OSD_' | grep -E -v '\(PG_' | grep -E -v '\(POOL_APP_NOT_ENABLED\)' | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2026-02-17T04:22:46.856 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial040.front.sepia.ceph.com 2026-02-17T04:22:46.856 DEBUG:teuthology.orchestra.run.trial040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-17T04:22:46.926 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial040.front.sepia.ceph.com 2026-02-17T04:22:46.926 DEBUG:teuthology.orchestra.run.trial040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-17T04:22:46.995 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial040.front.sepia.ceph.com 2026-02-17T04:22:46.996 DEBUG:teuthology.orchestra.run.trial040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-17T04:22:47.062 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial040.front.sepia.ceph.com 2026-02-17T04:22:47.063 DEBUG:teuthology.orchestra.run.trial040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-17T04:22:47.130 INFO:tasks.ceph:Archiving mon data... 2026-02-17T04:22:47.131 DEBUG:teuthology.misc:Transferring archived files from trial040:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_03:53:03-rados-wip-bharath18-testing-2026-02-13-0856-distro-default-trial/50828/data/mon.a.tgz 2026-02-17T04:22:47.132 DEBUG:teuthology.orchestra.run.trial040:> mktemp 2026-02-17T04:22:47.187 INFO:teuthology.orchestra.run.trial040.stdout:/tmp/tmp.AgMVQHaT0R 2026-02-17T04:22:47.187 DEBUG:teuthology.orchestra.run.trial040:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.AgMVQHaT0R 2026-02-17T04:22:47.276 DEBUG:teuthology.orchestra.run.trial040:> sudo chmod 0666 /tmp/tmp.AgMVQHaT0R 2026-02-17T04:22:47.357 DEBUG:teuthology.orchestra.remote:trial040:/tmp/tmp.AgMVQHaT0R is 212KB 2026-02-17T04:22:47.450 DEBUG:teuthology.orchestra.run.trial040:> rm -fr /tmp/tmp.AgMVQHaT0R 2026-02-17T04:22:47.466 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-17T04:22:47.466 DEBUG:teuthology.orchestra.run.trial040:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-17T04:22:47.589 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-17T04:22:47.589 INFO:tasks.ceph:Archiving crash dumps... 2026-02-17T04:22:47.591 DEBUG:teuthology.misc:Transferring archived files from trial040:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_03:53:03-rados-wip-bharath18-testing-2026-02-13-0856-distro-default-trial/50828/remote/trial040/crash 2026-02-17T04:22:47.592 DEBUG:teuthology.orchestra.run.trial040:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-17T04:22:47.652 INFO:tasks.ceph:Compressing logs... 2026-02-17T04:22:47.653 DEBUG:teuthology.orchestra.run.trial040:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T04:22:47.717 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-17T04:22:47.760 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57681.log 2026-02-17T04:22:47.760 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57975.log 2026-02-17T04:22:47.760 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57289.log 2026-02-17T04:22:47.760 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.57681.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57681.log.gz 2026-02-17T04:22:47.760 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58318.log 2026-02-17T04:22:47.760 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.57975.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57975.log.gz 2026-02-17T04:22:47.760 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.57289.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-17T04:22:47.761 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57289.log.gz 2026-02-17T04:22:47.761 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.58318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57338.log 2026-02-17T04:22:47.761 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58318.log.gz 2026-02-17T04:22:47.761 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57240.log 2026-02-17T04:22:47.761 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.57338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56402.log 2026-02-17T04:22:47.761 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57338.log.gz 2026-02-17T04:22:47.761 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.57240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57779.log 2026-02-17T04:22:47.761 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57240.log.gz 2026-02-17T04:22:47.761 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.56402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56723.log 2026-02-17T04:22:47.761 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56402.log.gz 2026-02-17T04:22:47.761 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.57779.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-17T04:22:47.761 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57779.log.gz 2026-02-17T04:22:47.761 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.56723.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56723.log.gz 2026-02-17T04:22:47.761 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56354.log 2026-02-17T04:22:47.761 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55397.log 2026-02-17T04:22:47.761 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.56354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54540.log 2026-02-17T04:22:47.761 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56354.log.gz 2026-02-17T04:22:47.762 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.55397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54109.log 2026-02-17T04:22:47.762 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55397.log.gz 2026-02-17T04:22:47.762 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.54540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55155.log 2026-02-17T04:22:47.762 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54540.log.gz 2026-02-17T04:22:47.762 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.54109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55165.log 2026-02-17T04:22:47.762 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54109.log.gz 2026-02-17T04:22:47.762 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.55155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58514.log 2026-02-17T04:22:47.762 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55155.log.gz 2026-02-17T04:22:47.762 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.55165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55348.log 2026-02-17T04:22:47.762 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55165.log.gz 2026-02-17T04:22:47.762 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.58514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57436.log 2026-02-17T04:22:47.762 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58514.log.gz 2026-02-17T04:22:47.762 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.55348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53682.log 2026-02-17T04:22:47.762 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55348.log.gz 2026-02-17T04:22:47.762 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.57436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54683.log 2026-02-17T04:22:47.762 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57436.log.gz 2026-02-17T04:22:47.763 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.53682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56229.log 2026-02-17T04:22:47.763 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53682.log.gz 2026-02-17T04:22:47.763 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.54683.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-17T04:22:47.763 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54683.log.gz 2026-02-17T04:22:47.763 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.56229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54895.log 2026-02-17T04:22:47.763 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56229.log.gz 2026-02-17T04:22:47.763 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56104.log 2026-02-17T04:22:47.763 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.54895.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54895.log.gz 2026-02-17T04:22:47.763 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54393.log 2026-02-17T04:22:47.763 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.56104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56773.log 2026-02-17T04:22:47.763 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56104.log.gz 2026-02-17T04:22:47.763 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.54393.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54393.log.gz 2026-02-17T04:22:47.763 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48180.log 2026-02-17T04:22:47.763 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.56773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58024.log 2026-02-17T04:22:47.764 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56773.log.gz 2026-02-17T04:22:47.764 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48133.log 2026-02-17T04:22:47.764 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.48180.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48180.log.gz 2026-02-17T04:22:47.764 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.58024.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58024.log.gz 2026-02-17T04:22:47.764 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54858.log 2026-02-17T04:22:47.764 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54111.log 2026-02-17T04:22:47.764 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.48133.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48133.log.gz 2026-02-17T04:22:47.764 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.54858.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54858.log.gz 2026-02-17T04:22:47.764 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57093.log 2026-02-17T04:22:47.764 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56672.log 2026-02-17T04:22:47.764 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.54111.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54111.log.gz 2026-02-17T04:22:47.764 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.57093.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57093.log.gz 2026-02-17T04:22:47.764 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54121.log 2026-02-17T04:22:47.764 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.56672.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56672.log.gz 2026-02-17T04:22:47.764 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56032.log 2026-02-17T04:22:47.764 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.54121.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54121.log.gzgzip 2026-02-17T04:22:47.764 INFO:teuthology.orchestra.run.trial040.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.57632.log 2026-02-17T04:22:47.764 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.56032.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.56032.log.gz 2026-02-17T04:22:47.764 INFO:teuthology.orchestra.run.trial040.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.55858.log 2026-02-17T04:22:47.765 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.57632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58122.log 2026-02-17T04:22:47.765 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57632.log.gz 2026-02-17T04:22:47.765 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.55858.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55858.log.gz -5 2026-02-17T04:22:47.765 INFO:teuthology.orchestra.run.trial040.stderr: --verbose -- /var/log/ceph/ceph-client.admin.58171.log 2026-02-17T04:22:47.765 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.58122.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58122.log.gzgzip 2026-02-17T04:22:47.765 INFO:teuthology.orchestra.run.trial040.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.58465.log 2026-02-17T04:22:47.765 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57191.log 2026-02-17T04:22:47.765 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.58171.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58171.log.gz 2026-02-17T04:22:47.765 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.58465.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58465.log.gz 2026-02-17T04:22:47.765 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53473.log 2026-02-17T04:22:47.765 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.57191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56477.log 2026-02-17T04:22:47.765 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57191.log.gz 2026-02-17T04:22:47.765 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.53473.log: -- /var/log/ceph/ceph-client.admin.54682.log 2026-02-17T04:22:47.765 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53473.log.gz 2026-02-17T04:22:47.765 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.56477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55734.log 2026-02-17T04:22:47.765 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56477.log.gz 2026-02-17T04:22:47.765 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.54682.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54682.log.gz 2026-02-17T04:22:47.765 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56304.log 2026-02-17T04:22:47.765 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.55734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47742.log 2026-02-17T04:22:47.765 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55734.log.gz 2026-02-17T04:22:47.766 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.56304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56502.log 2026-02-17T04:22:47.766 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56304.log.gz 2026-02-17T04:22:47.766 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.47742.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47742.log.gz 2026-02-17T04:22:47.766 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54541.log 2026-02-17T04:22:47.766 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.56502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54542.log 2026-02-17T04:22:47.766 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56502.log.gz 2026-02-17T04:22:47.766 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.54541.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54541.log.gz 2026-02-17T04:22:47.766 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56129.log 2026-02-17T04:22:47.766 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.54542.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2026-02-17T04:22:47.766 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54542.log.gz 2026-02-17T04:22:47.766 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.56129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55166.log 2026-02-17T04:22:47.766 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56129.log.gz 2026-02-17T04:22:47.766 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2026-02-17T04:22:47.766 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54543.log 2026-02-17T04:22:47.766 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.55166.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55166.log.gz 2026-02-17T04:22:47.766 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58367.log 2026-02-17T04:22:47.766 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.54543.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54543.log.gz 2026-02-17T04:22:47.767 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58220.log 2026-02-17T04:22:47.767 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48274.log 2026-02-17T04:22:47.767 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.58367.log: /var/log/ceph/ceph-client.admin.58220.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58367.log.gz 2026-02-17T04:22:47.767 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58220.log.gz 2026-02-17T04:22:47.767 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56427.log 2026-02-17T04:22:47.767 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48039.log 2026-02-17T04:22:47.767 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.48274.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48274.log.gz 2026-02-17T04:22:47.767 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.56427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54395.log 2026-02-17T04:22:47.767 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56427.log.gz 2026-02-17T04:22:47.767 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.48039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56254.log 2026-02-17T04:22:47.767 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48039.log.gz 2026-02-17T04:22:47.767 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.54395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54119.log 2026-02-17T04:22:47.767 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54395.log.gz 2026-02-17T04:22:47.767 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.56254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53522.log 2026-02-17T04:22:47.767 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56254.log.gz 2026-02-17T04:22:47.767 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.54119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55029.log 2026-02-17T04:22:47.767 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54119.log.gz 2026-02-17T04:22:47.767 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.53522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54117.log 2026-02-17T04:22:47.767 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53522.log.gz 2026-02-17T04:22:47.767 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.55029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53592.log 2026-02-17T04:22:47.768 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55029.log.gz 2026-02-17T04:22:47.768 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.54117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56378.log 2026-02-17T04:22:47.768 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54117.log.gz 2026-02-17T04:22:47.768 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.53592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56007.log 2026-02-17T04:22:47.768 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53592.log.gz 2026-02-17T04:22:47.768 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.56378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55882.log 2026-02-17T04:22:47.768 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56378.log.gz 2026-02-17T04:22:47.768 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.56007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47559.log 2026-02-17T04:22:47.768 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56007.log.gz 2026-02-17T04:22:47.768 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.55882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58610.log 2026-02-17T04:22:47.768 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55882.log.gz 2026-02-17T04:22:47.768 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.47559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56797.log 2026-02-17T04:22:47.768 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47559.log.gz 2026-02-17T04:22:47.768 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.58610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48227.log 2026-02-17T04:22:47.768 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58610.log.gz 2026-02-17T04:22:47.768 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.56797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57534.log 2026-02-17T04:22:47.768 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56797.log.gz 2026-02-17T04:22:47.768 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.48227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56056.log 2026-02-17T04:22:47.768 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48227.log.gz 2026-02-17T04:22:47.768 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.57534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54110.log 2026-02-17T04:22:47.768 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57534.log.gz 2026-02-17T04:22:47.769 INFO:teuthology.orchestra.run.trial040.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-17T04:22:47.769 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.56056.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2026-02-17T04:22:47.769 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56056.log.gz 2026-02-17T04:22:47.769 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.54110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55187.log 2026-02-17T04:22:47.769 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54110.log.gz 2026-02-17T04:22:47.769 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57828.log 2026-02-17T04:22:47.769 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.55187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56329.log 2026-02-17T04:22:47.769 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55187.log.gz 2026-02-17T04:22:47.769 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.57828.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57828.log.gz 2026-02-17T04:22:47.769 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57926.log 2026-02-17T04:22:47.769 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.56329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53829.log 2026-02-17T04:22:47.769 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56329.log.gz 2026-02-17T04:22:47.769 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.57926.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57926.log.gz 2026-02-17T04:22:47.769 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57583.log 2026-02-17T04:22:47.769 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.53829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55710.log 2026-02-17T04:22:47.769 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53829.log.gz 2026-02-17T04:22:47.769 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.57583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54120.log 2026-02-17T04:22:47.769 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57583.log.gz 2026-02-17T04:22:47.769 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.55710.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-17T04:22:47.769 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55710.log.gz 2026-02-17T04:22:47.769 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.54120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55033.log 2026-02-17T04:22:47.770 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54120.log.gz 2026-02-17T04:22:47.770 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56179.log 2026-02-17T04:22:47.770 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.55033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56526.log 2026-02-17T04:22:47.770 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55033.log.gz 2026-02-17T04:22:47.770 INFO:teuthology.orchestra.run.trial040.stderr: 89.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-17T04:22:47.770 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.56179.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56179.log.gz 2026-02-17T04:22:47.770 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56204.log 2026-02-17T04:22:47.770 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2026-02-17T04:22:47.770 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.56526.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56526.log.gz 2026-02-17T04:22:47.770 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.56204.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56204.log.gz 2026-02-17T04:22:47.770 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48086.log 2026-02-17T04:22:47.770 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56748.log 2026-02-17T04:22:47.770 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.48086.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-17T04:22:47.770 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48086.log.gz 2026-02-17T04:22:47.770 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.56748.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56748.log.gz 2026-02-17T04:22:47.770 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56080.log 2026-02-17T04:22:47.770 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55446.log 2026-02-17T04:22:47.770 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.56080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57730.log 2026-02-17T04:22:47.770 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56080.log.gz 2026-02-17T04:22:47.770 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.55446.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55446.log.gz 2026-02-17T04:22:47.770 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58563.log 2026-02-17T04:22:47.771 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58269.log 2026-02-17T04:22:47.771 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.57730.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57730.log.gz 2026-02-17T04:22:47.771 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.58563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55031.log 2026-02-17T04:22:47.771 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58563.log.gz 2026-02-17T04:22:47.771 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.58269.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58269.log.gz 2026-02-17T04:22:47.771 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54102.log 2026-02-17T04:22:47.771 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.55031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56623.log 2026-02-17T04:22:47.771 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55031.log.gz 2026-02-17T04:22:47.771 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.54102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56551.log 2026-02-17T04:22:47.771 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54102.log.gz 2026-02-17T04:22:47.771 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.56623.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56623.log.gz 2026-02-17T04:22:47.771 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56575.log 2026-02-17T04:22:47.771 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.56551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57387.log 2026-02-17T04:22:47.771 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56551.log.gz 2026-02-17T04:22:47.771 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.56575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53617.log 2026-02-17T04:22:47.771 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56575.log.gz 2026-02-17T04:22:47.771 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.57387.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57387.log.gz 2026-02-17T04:22:47.771 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48473.log 2026-02-17T04:22:47.771 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.53617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57142.log 2026-02-17T04:22:47.771 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53617.log.gz 2026-02-17T04:22:47.771 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.48473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55957.log 2026-02-17T04:22:47.771 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48473.log.gz 2026-02-17T04:22:47.772 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.57142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54103.log 2026-02-17T04:22:47.772 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57142.log.gz 2026-02-17T04:22:47.772 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.55957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48785.log 2026-02-17T04:22:47.772 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55957.log.gz 2026-02-17T04:22:47.772 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.54103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56278.log 2026-02-17T04:22:47.772 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54103.log.gz 2026-02-17T04:22:47.772 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.48785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56995.log 2026-02-17T04:22:47.772 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48785.log.gz 2026-02-17T04:22:47.772 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.56278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55032.log 2026-02-17T04:22:47.772 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56278.log.gz 2026-02-17T04:22:47.772 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.56995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56452.log 2026-02-17T04:22:47.772 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56995.log.gz 2026-02-17T04:22:47.772 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.55032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53731.log 2026-02-17T04:22:47.772 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55032.log.gz 2026-02-17T04:22:47.772 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.56452.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.37714.log 2026-02-17T04:22:47.772 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56452.log.gz 2026-02-17T04:22:47.772 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.53731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55982.log 2026-02-17T04:22:47.772 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53731.log.gz 2026-02-17T04:22:47.772 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph.tmp-client.admin.37714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57485.log 2026-02-17T04:22:47.772 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.37714.log.gz 2026-02-17T04:22:47.772 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.55982.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55982.log.gz 2026-02-17T04:22:47.772 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56154.log 2026-02-17T04:22:47.772 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.57485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54680.log 2026-02-17T04:22:47.773 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57485.log.gz 2026-02-17T04:22:47.773 INFO:teuthology.orchestra.run.trial040.stderr:gzip/var/log/ceph/ceph-client.admin.56154.log: -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-17T04:22:47.773 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56154.log.gz 2026-02-17T04:22:47.773 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.54680.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54680.log.gz 2026-02-17T04:22:47.773 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47671.log 2026-02-17T04:22:47.773 INFO:teuthology.orchestra.run.trial040.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-17T04:22:47.773 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55907.log 2026-02-17T04:22:47.773 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.47671.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47671.log.gz 2026-02-17T04:22:47.773 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54115.log 2026-02-17T04:22:47.773 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.55907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58416.log 2026-02-17T04:22:47.773 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55907.log.gz 2026-02-17T04:22:47.773 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.54115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55786.log 2026-02-17T04:22:47.773 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54115.log.gz 2026-02-17T04:22:47.773 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.58416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57044.log 0.0% 2026-02-17T04:22:47.773 INFO:teuthology.orchestra.run.trial040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58416.log.gz 2026-02-17T04:22:47.773 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.55786.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55786.log.gz 2026-02-17T04:22:47.773 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57877.log 2026-02-17T04:22:47.773 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.57044.log: /var/log/ceph/ceph-client.admin.53780.log 2026-02-17T04:22:47.773 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57044.log.gz 2026-02-17T04:22:47.773 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.57877.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57877.log.gz 2026-02-17T04:22:47.773 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48368.log 2026-02-17T04:22:47.773 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.53780.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53780.log.gz 2026-02-17T04:22:47.773 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.48368.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-17T04:22:47.773 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48368.log.gz 2026-02-17T04:22:47.774 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56648.log 2026-02-17T04:22:47.774 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.8.log 2026-02-17T04:22:47.774 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.56648.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56648.log.gz 2026-02-17T04:22:47.774 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55932.log 2026-02-17T04:22:47.774 INFO:teuthology.orchestra.run.trial040.stderr: 85.8% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-17T04:22:47.774 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48321.log 2026-02-17T04:22:47.774 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.9.log 2026-02-17T04:22:47.774 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.55932.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55932.log.gz 2026-02-17T04:22:47.774 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.48321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55810.log 2026-02-17T04:22:47.774 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48321.log.gz 2026-02-17T04:22:47.774 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48425.log 2026-02-17T04:22:47.774 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.55810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58073.log 2026-02-17T04:22:47.774 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55810.log.gz 2026-02-17T04:22:47.774 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.48425.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48425.log.gz 2026-02-17T04:22:47.774 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55682.log 2026-02-17T04:22:47.774 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.58073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56946.log 2026-02-17T04:22:47.774 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58073.log.gz 2026-02-17T04:22:47.774 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.55682.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55682.log.gz 2026-02-17T04:22:47.774 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55834.log 2026-02-17T04:22:47.774 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.56946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56698.log 2026-02-17T04:22:47.774 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56946.log.gz 2026-02-17T04:22:47.774 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.55834.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55834.log.gz 2026-02-17T04:22:47.774 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56599.log 2026-02-17T04:22:47.774 INFO:teuthology.orchestra.run.trial040.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-17T04:22:47.775 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54672.log 2026-02-17T04:22:47.775 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.56698.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56698.log.gz 2026-02-17T04:22:47.775 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.56599.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56599.log.gz 2026-02-17T04:22:47.775 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.54672.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54672.log.gz 2026-02-17T04:22:47.775 INFO:teuthology.orchestra.run.trial040.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2026-02-17T04:22:47.775 INFO:teuthology.orchestra.run.trial040.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2026-02-17T04:22:47.775 INFO:teuthology.orchestra.run.trial040.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-17T04:22:47.775 INFO:teuthology.orchestra.run.trial040.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2026-02-17T04:22:47.775 INFO:teuthology.orchestra.run.trial040.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2026-02-17T04:22:47.775 INFO:teuthology.orchestra.run.trial040.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-17T04:22:47.775 INFO:teuthology.orchestra.run.trial040.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.8.log.gz 2026-02-17T04:22:47.779 INFO:teuthology.orchestra.run.trial040.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.9.log.gz 2026-02-17T04:22:47.795 INFO:teuthology.orchestra.run.trial040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-17T04:22:47.797 INFO:teuthology.orchestra.run.trial040.stderr: 2026-02-17T04:22:47.797 INFO:teuthology.orchestra.run.trial040.stderr:real 0m0.088s 2026-02-17T04:22:47.797 INFO:teuthology.orchestra.run.trial040.stderr:user 0m0.380s 2026-02-17T04:22:47.797 INFO:teuthology.orchestra.run.trial040.stderr:sys 0m0.081s 2026-02-17T04:22:47.797 INFO:tasks.ceph:Archiving logs... 2026-02-17T04:22:47.798 DEBUG:teuthology.misc:Transferring archived files from trial040:/var/log/ceph to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_03:53:03-rados-wip-bharath18-testing-2026-02-13-0856-distro-default-trial/50828/remote/trial040/log 2026-02-17T04:22:47.799 DEBUG:teuthology.orchestra.run.trial040:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-17T04:22:48.093 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-17T04:22:48.115 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-17T04:22:48.115 DEBUG:teuthology.orchestra.run.trial040:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T04:22:48.238 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-17T04:22:48.249 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-17T04:22:48.249 DEBUG:teuthology.orchestra.run.trial040:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T04:22:48.265 INFO:teuthology.orchestra.run.trial040.stderr:bash: line 1: ntpq: command not found 2026-02-17T04:22:48.296 INFO:teuthology.orchestra.run.trial040.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T04:22:48.296 INFO:teuthology.orchestra.run.trial040.stdout:=============================================================================== 2026-02-17T04:22:48.296 INFO:teuthology.orchestra.run.trial040.stdout:^- 72-14-182-49.ip.linodeus> 2 6 77 60 +3352us[+3822us] +/- 84ms 2026-02-17T04:22:48.296 INFO:teuthology.orchestra.run.trial040.stdout:^? gopher.fart.website 0 8 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T04:22:48.296 INFO:teuthology.orchestra.run.trial040.stdout:^? li1210-167.members.linod> 0 7 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T04:22:48.296 INFO:teuthology.orchestra.run.trial040.stdout:^* time.cloudflare.com 3 6 77 59 +31us[ +500us] +/- 6809us 2026-02-17T04:22:48.297 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-17T04:22:48.308 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-17T04:22:48.308 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-17T04:22:48.324 DEBUG:teuthology.orchestra.run.trial040:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-17T04:22:48.391 DEBUG:teuthology.orchestra.run.trial040:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-17T04:22:48.418 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T04:22:48.419 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-17T04:22:48.435 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-17T04:22:48.445 INFO:teuthology.task.internal:Duration was 359.864586 seconds 2026-02-17T04:22:48.445 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-17T04:22:48.457 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-17T04:22:48.458 DEBUG:teuthology.orchestra.run.trial040:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T04:22:48.494 INFO:teuthology.orchestra.run.trial040.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T04:22:48.880 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-17T04:22:48.881 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial040.front.sepia.ceph.com 2026-02-17T04:22:48.881 DEBUG:teuthology.orchestra.run.trial040:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T04:22:48.939 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-17T04:22:48.939 DEBUG:teuthology.orchestra.run.trial040:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T04:22:49.040 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-17T04:22:49.040 DEBUG:teuthology.orchestra.run.trial040:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T04:22:49.066 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T04:22:49.066 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T04:22:49.066 INFO:teuthology.orchestra.run.trial040.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T04:22:49.067 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T04:22:49.067 INFO:teuthology.orchestra.run.trial040.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T04:22:49.076 INFO:teuthology.orchestra.run.trial040.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 81.9% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T04:22:49.078 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-17T04:22:49.094 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-17T04:22:49.095 DEBUG:teuthology.orchestra.run.trial040:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T04:22:49.143 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-17T04:22:49.159 DEBUG:teuthology.orchestra.run.trial040:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:22:49.207 INFO:teuthology.orchestra.run.trial040.stdout:kernel.core_pattern = core 2026-02-17T04:22:49.220 DEBUG:teuthology.orchestra.run.trial040:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:22:49.275 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T04:22:49.275 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-17T04:22:49.292 INFO:teuthology.task.internal:Transferring archived files... 2026-02-17T04:22:49.293 DEBUG:teuthology.misc:Transferring archived files from trial040:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_03:53:03-rados-wip-bharath18-testing-2026-02-13-0856-distro-default-trial/50828/remote/trial040 2026-02-17T04:22:49.294 DEBUG:teuthology.orchestra.run.trial040:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T04:22:49.350 INFO:teuthology.task.internal:Removing archive directory... 2026-02-17T04:22:49.350 DEBUG:teuthology.orchestra.run.trial040:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T04:22:49.398 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-17T04:22:49.416 INFO:teuthology.task.internal:Not uploading archives. 2026-02-17T04:22:49.416 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-17T04:22:49.432 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-17T04:22:49.432 DEBUG:teuthology.orchestra.run.trial040:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T04:22:49.454 INFO:teuthology.orchestra.run.trial040.stdout: 791885 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 04:22 /home/ubuntu/cephtest 2026-02-17T04:22:49.455 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-17T04:22:49.475 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-17T04:22:49.512 INFO:teuthology.run:Summary data: description: rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{centos_latest}} duration: 359.864586353302 flavor: default owner: scheduled_skanta@soko04.front.sepia.ceph.com success: true 2026-02-17T04:22:49.512 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T04:22:49.623 INFO:teuthology.run:pass