2026-02-20T18:53:51.714 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-20T18:53:51.727 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T18:53:51.807 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/yuriw-2026-02-20_16:06:38-rados-wip-pdonnell-testing-20260219.182737-tentacle-distro-default-trial/61096 branch: wip-pdonnell-testing-20260219.182737-tentacle description: rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{centos_latest}} email: yweinste@redhat.com first_in_suite: false flavor: default job_id: '61096' kernel: branch: distro kdb: true sha1: distro last_in_suite: false machine_type: trial name: yuriw-2026-02-20_16:06:38-rados-wip-pdonnell-testing-20260219.182737-tentacle-distro-default-trial no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20260219.182737-tentacle ceph: conf: global: mon election default strategy: 3 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon scrub interval: 300 osd: bluestore zero block detection: true debug ms: 1 debug osd: 20 osd debug verify cached snaps: true osd debug verify missing on start: true osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd mclock skip benchmark: true osd op queue: debug_random osd op queue cut off: debug_random flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: f7870454149f22574086dd2ff55d050585136531 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: f7870454149f22574086dd2ff55d050585136531 workunit: branch: wip-pdonnell-testing-20260219.182737-tentacle sha1: f7870454149f22574086dd2ff55d050585136531 owner: scheduled_yuriw@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - osd.3 - osd.4 - osd.5 - osd.6 - osd.7 - osd.8 - osd.9 - client.0 seed: 8419 sha1: f7870454149f22574086dd2ff55d050585136531 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-pdonnell-testing-20260219.182737-tentacle suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_f7870454149f22574086dd2ff55d050585136531/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: f7870454149f22574086dd2ff55d050585136531 targets: trial166.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMs2dKewtPexVxJSWC4lJlDqkcgD5/0nxuRiJhTQmgQ1Ti9b0znZogSALLH3RRVknB52kjPVAFso1SaFrbYnH7w= tasks: - install: null - ceph: conf: osd: osd max object name len: 400 osd max object namespace len: 64 log-ignorelist: - but it is still running - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_APP_NOT_ENABLED\) pre-mgr-commands: - sudo ceph config set mgr mgr_pool false --force - workunit: clients: all: - rados/test_health_warnings.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-20_16:06:38 tube: trial user: yuriw verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.1540699 2026-02-20T18:53:51.807 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_f7870454149f22574086dd2ff55d050585136531/qa; will attempt to use it 2026-02-20T18:53:51.808 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_f7870454149f22574086dd2ff55d050585136531/qa/tasks 2026-02-20T18:53:51.808 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-20T18:53:51.809 INFO:teuthology.task.internal:Checking packages... 2026-02-20T18:53:51.810 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'f7870454149f22574086dd2ff55d050585136531' 2026-02-20T18:53:51.810 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-20T18:53:51.810 INFO:teuthology.packaging:ref: None 2026-02-20T18:53:51.810 INFO:teuthology.packaging:tag: None 2026-02-20T18:53:51.810 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20260219.182737-tentacle 2026-02-20T18:53:51.810 INFO:teuthology.packaging:sha1: f7870454149f22574086dd2ff55d050585136531 2026-02-20T18:53:51.810 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20260219.182737-tentacle 2026-02-20T18:53:51.934 INFO:teuthology.task.internal:Found packages for ceph version 20.2.0-677.gf7870454 2026-02-20T18:53:51.937 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-20T18:53:51.953 INFO:teuthology.task.internal:no buildpackages task found 2026-02-20T18:53:51.953 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-20T18:53:51.966 INFO:teuthology.task.internal:Saving configuration 2026-02-20T18:53:51.976 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-20T18:53:51.991 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-20T18:53:52.073 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial166.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-20_16:06:38-rados-wip-pdonnell-testing-20260219.182737-tentacle-distro-default-trial/61096', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-20 18:50:22.492079', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMs2dKewtPexVxJSWC4lJlDqkcgD5/0nxuRiJhTQmgQ1Ti9b0znZogSALLH3RRVknB52kjPVAFso1SaFrbYnH7w='} 2026-02-20T18:53:52.073 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-20T18:53:52.090 INFO:teuthology.task.internal:roles: ubuntu@trial166.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'osd.8', 'osd.9', 'client.0'] 2026-02-20T18:53:52.090 INFO:teuthology.run_tasks:Running task console_log... 2026-02-20T18:53:52.170 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ed153308d60>, signals=[15]) 2026-02-20T18:53:52.170 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-20T18:53:52.185 INFO:teuthology.task.internal:Opening connections... 2026-02-20T18:53:52.186 DEBUG:teuthology.task.internal:connecting to ubuntu@trial166.front.sepia.ceph.com 2026-02-20T18:53:52.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial166.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T18:53:52.247 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-20T18:53:52.261 DEBUG:teuthology.orchestra.run.trial166:> uname -m 2026-02-20T18:53:52.332 INFO:teuthology.orchestra.run.trial166.stdout:x86_64 2026-02-20T18:53:52.332 DEBUG:teuthology.orchestra.run.trial166:> cat /etc/os-release 2026-02-20T18:53:52.387 INFO:teuthology.orchestra.run.trial166.stdout:NAME="CentOS Stream" 2026-02-20T18:53:52.387 INFO:teuthology.orchestra.run.trial166.stdout:VERSION="9" 2026-02-20T18:53:52.387 INFO:teuthology.orchestra.run.trial166.stdout:ID="centos" 2026-02-20T18:53:52.387 INFO:teuthology.orchestra.run.trial166.stdout:ID_LIKE="rhel fedora" 2026-02-20T18:53:52.387 INFO:teuthology.orchestra.run.trial166.stdout:VERSION_ID="9" 2026-02-20T18:53:52.387 INFO:teuthology.orchestra.run.trial166.stdout:PLATFORM_ID="platform:el9" 2026-02-20T18:53:52.387 INFO:teuthology.orchestra.run.trial166.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-20T18:53:52.387 INFO:teuthology.orchestra.run.trial166.stdout:ANSI_COLOR="0;31" 2026-02-20T18:53:52.387 INFO:teuthology.orchestra.run.trial166.stdout:LOGO="fedora-logo-icon" 2026-02-20T18:53:52.387 INFO:teuthology.orchestra.run.trial166.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-20T18:53:52.387 INFO:teuthology.orchestra.run.trial166.stdout:HOME_URL="https://centos.org/" 2026-02-20T18:53:52.387 INFO:teuthology.orchestra.run.trial166.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-20T18:53:52.388 INFO:teuthology.orchestra.run.trial166.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-20T18:53:52.388 INFO:teuthology.orchestra.run.trial166.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-20T18:53:52.388 INFO:teuthology.lock.ops:Updating trial166.front.sepia.ceph.com on lock server 2026-02-20T18:53:52.451 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-20T18:53:52.462 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-20T18:53:52.473 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-20T18:53:52.473 DEBUG:teuthology.orchestra.run.trial166:> test '!' -e /home/ubuntu/cephtest 2026-02-20T18:53:52.488 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-20T18:53:52.499 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-20T18:53:52.499 DEBUG:teuthology.orchestra.run.trial166:> test -z $(ls -A /var/lib/ceph) 2026-02-20T18:53:52.544 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-20T18:53:52.622 INFO:teuthology.run_tasks:Running task kernel... 2026-02-20T18:53:52.645 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': True, 'sha1': 'distro'} 2026-02-20T18:53:52.645 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, timeout 300 2026-02-20T18:53:52.646 DEBUG:teuthology.orchestra.run.trial166:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-20T18:53:52.660 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T18:53:52.661 DEBUG:teuthology.orchestra.run.trial166:> uname -r 2026-02-20T18:53:52.717 INFO:teuthology.orchestra.run.trial166.stdout:5.14.0-681.el9.x86_64 2026-02-20T18:53:52.717 INFO:teuthology.task.kernel:Running kernel on trial166: 5.14.0-681.el9.x86_64 2026-02-20T18:53:52.717 DEBUG:teuthology.orchestra.run.trial166:> sudo yum install -y kernel 2026-02-20T18:53:55.760 INFO:teuthology.orchestra.run.trial166.stdout:CentOS Stream 9 - BaseOS 3.3 MB/s | 8.9 MB 00:02 2026-02-20T18:53:58.795 INFO:teuthology.orchestra.run.trial166.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-20T18:54:02.045 INFO:teuthology.orchestra.run.trial166.stdout:CentOS Stream 9 - CRB 8.8 MB/s | 7.8 MB 00:00 2026-02-20T18:54:02.990 INFO:teuthology.orchestra.run.trial166.stdout:CentOS Stream 9 - Extras packages 91 kB/s | 20 kB 00:00 2026-02-20T18:54:03.235 INFO:teuthology.orchestra.run.trial166.stdout:Extra Packages for Enterprise Linux 111 MB/s | 20 MB 00:00 2026-02-20T18:54:06.413 INFO:teuthology.orchestra.run.trial166.stdout:lab-extras 1.4 MB/s | 50 kB 00:00 2026-02-20T18:54:07.414 INFO:teuthology.orchestra.run.trial166.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-20T18:54:07.414 INFO:teuthology.orchestra.run.trial166.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-20T18:54:07.433 INFO:teuthology.orchestra.run.trial166.stdout:Dependencies resolved. 2026-02-20T18:54:07.433 INFO:teuthology.orchestra.run.trial166.stdout:Nothing to do. 2026-02-20T18:54:07.434 INFO:teuthology.orchestra.run.trial166.stdout:Complete! 2026-02-20T18:54:07.458 DEBUG:teuthology.orchestra.run.trial166:> echo no | sudo yum reinstall kernel || true 2026-02-20T18:54:07.754 INFO:teuthology.orchestra.run.trial166.stdout:Last metadata expiration check: 0:00:01 ago on Fri 20 Feb 2026 06:54:06 PM UTC. 2026-02-20T18:54:07.834 INFO:teuthology.orchestra.run.trial166.stdout:Dependencies resolved. 2026-02-20T18:54:07.835 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:54:07.835 INFO:teuthology.orchestra.run.trial166.stdout: Package Architecture Version Repository Size 2026-02-20T18:54:07.835 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:54:07.835 INFO:teuthology.orchestra.run.trial166.stdout:Reinstalling: 2026-02-20T18:54:07.835 INFO:teuthology.orchestra.run.trial166.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-20T18:54:07.835 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:54:07.836 INFO:teuthology.orchestra.run.trial166.stdout:Transaction Summary 2026-02-20T18:54:07.836 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:54:07.836 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:54:07.836 INFO:teuthology.orchestra.run.trial166.stdout:Total download size: 803 k 2026-02-20T18:54:07.836 INFO:teuthology.orchestra.run.trial166.stdout:Installed size: 0 2026-02-20T18:54:07.836 INFO:teuthology.orchestra.run.trial166.stderr:Operation aborted. 2026-02-20T18:54:07.856 INFO:teuthology.orchestra.run.trial166.stdout:Is this ok [y/N]: 2026-02-20T18:54:07.856 DEBUG:teuthology.orchestra.run.trial166:> sudo yum reinstall -y kernel || true 2026-02-20T18:54:08.156 INFO:teuthology.orchestra.run.trial166.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 06:54:06 PM UTC. 2026-02-20T18:54:08.237 INFO:teuthology.orchestra.run.trial166.stdout:Dependencies resolved. 2026-02-20T18:54:08.237 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:54:08.237 INFO:teuthology.orchestra.run.trial166.stdout: Package Architecture Version Repository Size 2026-02-20T18:54:08.237 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:54:08.237 INFO:teuthology.orchestra.run.trial166.stdout:Reinstalling: 2026-02-20T18:54:08.238 INFO:teuthology.orchestra.run.trial166.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-20T18:54:08.238 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:54:08.238 INFO:teuthology.orchestra.run.trial166.stdout:Transaction Summary 2026-02-20T18:54:08.238 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:54:08.238 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:54:08.238 INFO:teuthology.orchestra.run.trial166.stdout:Total download size: 803 k 2026-02-20T18:54:08.238 INFO:teuthology.orchestra.run.trial166.stdout:Installed size: 0 2026-02-20T18:54:08.238 INFO:teuthology.orchestra.run.trial166.stdout:Downloading Packages: 2026-02-20T18:54:09.197 INFO:teuthology.orchestra.run.trial166.stdout:kernel-5.14.0-681.el9.x86_64.rpm 896 kB/s | 803 kB 00:00 2026-02-20T18:54:09.198 INFO:teuthology.orchestra.run.trial166.stdout:-------------------------------------------------------------------------------- 2026-02-20T18:54:09.198 INFO:teuthology.orchestra.run.trial166.stdout:Total 836 kB/s | 803 kB 00:00 2026-02-20T18:54:09.207 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction check 2026-02-20T18:54:09.241 INFO:teuthology.orchestra.run.trial166.stdout:Transaction check succeeded. 2026-02-20T18:54:09.242 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction test 2026-02-20T18:54:09.246 INFO:teuthology.orchestra.run.trial166.stdout:Transaction test succeeded. 2026-02-20T18:54:09.246 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction 2026-02-20T18:54:09.269 INFO:teuthology.orchestra.run.trial166.stdout: Preparing : 1/1 2026-02-20T18:54:09.274 INFO:teuthology.orchestra.run.trial166.stdout: Reinstalling : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-20T18:54:09.274 INFO:teuthology.orchestra.run.trial166.stdout: Cleanup : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T18:54:09.382 INFO:teuthology.orchestra.run.trial166.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T18:54:09.382 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-20T18:54:09.439 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T18:54:09.439 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:54:09.440 INFO:teuthology.orchestra.run.trial166.stdout:Reinstalled: 2026-02-20T18:54:09.440 INFO:teuthology.orchestra.run.trial166.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-20T18:54:09.440 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:54:09.440 INFO:teuthology.orchestra.run.trial166.stdout:Complete! 2026-02-20T18:54:09.468 DEBUG:teuthology.orchestra.run.trial166:> rpm -q kernel | sort -rV | head -n 1 2026-02-20T18:54:09.492 INFO:teuthology.orchestra.run.trial166.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-20T18:54:09.493 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-20T18:54:09.493 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-20T18:54:09.493 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-20T18:54:09.493 DEBUG:teuthology.orchestra.run.trial166:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-20T18:54:09.557 INFO:teuthology.orchestra.run.trial166.stdout:ttyS1 2026-02-20T18:54:09.582 DEBUG:teuthology.parallel:result is None 2026-02-20T18:54:09.582 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-20T18:54:09.594 INFO:teuthology.task.internal:Creating test directory... 2026-02-20T18:54:09.594 DEBUG:teuthology.orchestra.run.trial166:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-20T18:54:09.638 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-20T18:54:09.650 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-20T18:54:09.663 INFO:teuthology.task.internal:Creating archive directory... 2026-02-20T18:54:09.664 DEBUG:teuthology.orchestra.run.trial166:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-20T18:54:09.701 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-20T18:54:09.713 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-20T18:54:09.713 DEBUG:teuthology.orchestra.run.trial166:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-20T18:54:09.758 INFO:teuthology.orchestra.run.trial166.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T18:54:09.767 INFO:teuthology.orchestra.run.trial166.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T18:54:09.769 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-20T18:54:09.781 INFO:teuthology.task.internal:Configuring sudo... 2026-02-20T18:54:09.782 DEBUG:teuthology.orchestra.run.trial166:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-20T18:54:09.834 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-20T18:54:09.851 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-20T18:54:09.851 DEBUG:teuthology.orchestra.run.trial166:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-20T18:54:09.889 DEBUG:teuthology.orchestra.run.trial166:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T18:54:10.061 DEBUG:teuthology.orchestra.run.trial166:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T18:54:10.083 DEBUG:teuthology.orchestra.run.trial166:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T18:54:10.209 DEBUG:teuthology.orchestra.run.trial166:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T18:54:10.235 DEBUG:teuthology.orchestra.run.trial166:> set -ex 2026-02-20T18:54:10.235 DEBUG:teuthology.orchestra.run.trial166:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-20T18:54:10.303 DEBUG:teuthology.orchestra.run.trial166:> sudo service rsyslog restart 2026-02-20T18:54:10.374 INFO:teuthology.orchestra.run.trial166.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T18:54:10.759 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-20T18:54:10.773 INFO:teuthology.task.internal:Starting timer... 2026-02-20T18:54:10.774 INFO:teuthology.run_tasks:Running task pcp... 2026-02-20T18:54:10.794 INFO:teuthology.run_tasks:Running task selinux... 2026-02-20T18:54:10.818 DEBUG:teuthology.orchestra.run.trial166:> sudo service auditd rotate 2026-02-20T18:54:10.846 INFO:teuthology.orchestra.run.trial166.stdout:Rotating logs: 2026-02-20T18:54:10.849 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-20T18:54:10.849 DEBUG:teuthology.orchestra.run.trial166:> /usr/sbin/getenforce 2026-02-20T18:54:10.906 INFO:teuthology.orchestra.run.trial166.stdout:Permissive 2026-02-20T18:54:10.906 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial166.front.sepia.ceph.com': 'permissive'} 2026-02-20T18:54:10.907 DEBUG:teuthology.orchestra.run.trial166:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-20T18:54:10.971 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T18:54:10.971 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-20T18:54:10.972 DEBUG:teuthology.orchestra.run.trial166:> sudo /usr/sbin/setenforce permissive 2026-02-20T18:54:11.035 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-20T18:54:11.055 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-20T18:54:11.068 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-20T18:54:11.069 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial166.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-20T18:56:47.542 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial166.front.sepia.ceph.com')] 2026-02-20T18:56:47.549 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial166.front.sepia.ceph.com' 2026-02-20T18:56:47.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial166.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T18:56:47.659 DEBUG:teuthology.orchestra.run.trial166:> true 2026-02-20T18:56:47.738 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial166.front.sepia.ceph.com' 2026-02-20T18:56:47.738 INFO:teuthology.run_tasks:Running task clock... 2026-02-20T18:56:47.753 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-20T18:56:47.753 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-20T18:56:47.753 DEBUG:teuthology.orchestra.run.trial166:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T18:56:47.805 INFO:teuthology.orchestra.run.trial166.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-20T18:56:47.817 INFO:teuthology.orchestra.run.trial166.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-20T18:56:47.837 INFO:teuthology.orchestra.run.trial166.stderr:sudo: ntpd: command not found 2026-02-20T18:56:47.846 INFO:teuthology.orchestra.run.trial166.stdout:506 Cannot talk to daemon 2026-02-20T18:56:47.857 INFO:teuthology.orchestra.run.trial166.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-20T18:56:47.868 INFO:teuthology.orchestra.run.trial166.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-20T18:56:47.915 INFO:teuthology.orchestra.run.trial166.stderr:bash: line 1: ntpq: command not found 2026-02-20T18:56:47.916 INFO:teuthology.orchestra.run.trial166.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T18:56:47.916 INFO:teuthology.orchestra.run.trial166.stdout:=============================================================================== 2026-02-20T18:56:47.918 INFO:teuthology.run_tasks:Running task install... 2026-02-20T18:56:47.935 DEBUG:teuthology.task.install:project ceph 2026-02-20T18:56:47.935 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'f7870454149f22574086dd2ff55d050585136531'}} 2026-02-20T18:56:47.936 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'f7870454149f22574086dd2ff55d050585136531'} 2026-02-20T18:56:47.936 INFO:teuthology.task.install:Using flavor: default 2026-02-20T18:56:47.949 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-20T18:56:47.949 INFO:teuthology.task.install:extra packages: [] 2026-02-20T18:56:47.949 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f7870454149f22574086dd2ff55d050585136531', 'tag': None, 'wait_for_package': False} 2026-02-20T18:56:47.950 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f7870454149f22574086dd2ff55d050585136531 2026-02-20T18:56:48.121 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260219.182737-tentacle/f7870454149f22574086dd2ff55d050585136531/centos/9/flavors/default/ 2026-02-20T18:56:48.121 INFO:teuthology.task.install.rpm:Package version is 20.2.0-677.gf7870454 2026-02-20T18:56:48.417 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260219.182737-tentacle/f7870454149f22574086dd2ff55d050585136531/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260219.182737-tentacle/f7870454149f22574086dd2ff55d050585136531/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260219.182737-tentacle/f7870454149f22574086dd2ff55d050585136531/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-20T18:56:48.418 DEBUG:teuthology.orchestra.run.trial166:> set -ex 2026-02-20T18:56:48.418 DEBUG:teuthology.orchestra.run.trial166:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-20T18:56:48.443 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-20T18:56:48.443 DEBUG:teuthology.orchestra.run.trial166:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f7870454149f22574086dd2ff55d050585136531/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-20T18:56:48.509 DEBUG:teuthology.orchestra.run.trial166:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-20T18:56:48.583 DEBUG:teuthology.orchestra.run.trial166:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-20T18:56:48.646 INFO:teuthology.orchestra.run.trial166.stdout:check_obsoletes = 1 2026-02-20T18:56:48.647 DEBUG:teuthology.orchestra.run.trial166:> sudo yum clean all 2026-02-20T18:56:48.807 INFO:teuthology.orchestra.run.trial166.stdout:41 files removed 2026-02-20T18:56:48.821 DEBUG:teuthology.orchestra.run.trial166:> sudo yum -y install ceph-radosgw 2026-02-20T18:56:49.432 INFO:teuthology.orchestra.run.trial166.stdout:ceph packages for x86_64 185 kB/s | 87 kB 00:00 2026-02-20T18:56:49.780 INFO:teuthology.orchestra.run.trial166.stdout:ceph noarch packages 56 kB/s | 18 kB 00:00 2026-02-20T18:56:50.043 INFO:teuthology.orchestra.run.trial166.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2026-02-20T18:56:51.061 INFO:teuthology.orchestra.run.trial166.stdout:CentOS Stream 9 - BaseOS 8.9 MB/s | 8.9 MB 00:00 2026-02-20T18:56:54.254 INFO:teuthology.orchestra.run.trial166.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-20T18:56:57.652 INFO:teuthology.orchestra.run.trial166.stdout:CentOS Stream 9 - CRB 7.6 MB/s | 7.8 MB 00:01 2026-02-20T18:56:59.377 INFO:teuthology.orchestra.run.trial166.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 20 kB 00:01 2026-02-20T18:56:59.745 INFO:teuthology.orchestra.run.trial166.stdout:Extra Packages for Enterprise Linux 66 MB/s | 20 MB 00:00 2026-02-20T18:57:03.028 INFO:teuthology.orchestra.run.trial166.stdout:lab-extras 1.7 MB/s | 50 kB 00:00 2026-02-20T18:57:04.209 INFO:teuthology.orchestra.run.trial166.stdout:Dependencies resolved. 2026-02-20T18:57:04.210 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:57:04.210 INFO:teuthology.orchestra.run.trial166.stdout: Package Arch Version Repository Size 2026-02-20T18:57:04.210 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:57:04.210 INFO:teuthology.orchestra.run.trial166.stdout:Installing: 2026-02-20T18:57:04.211 INFO:teuthology.orchestra.run.trial166.stdout: ceph-radosgw x86_64 2:20.2.0-677.gf7870454.el9 ceph 24 M 2026-02-20T18:57:04.211 INFO:teuthology.orchestra.run.trial166.stdout:Upgrading: 2026-02-20T18:57:04.211 INFO:teuthology.orchestra.run.trial166.stdout: librados2 x86_64 2:20.2.0-677.gf7870454.el9 ceph 3.5 M 2026-02-20T18:57:04.211 INFO:teuthology.orchestra.run.trial166.stdout: librbd1 x86_64 2:20.2.0-677.gf7870454.el9 ceph 2.8 M 2026-02-20T18:57:04.211 INFO:teuthology.orchestra.run.trial166.stdout:Installing dependencies: 2026-02-20T18:57:04.211 INFO:teuthology.orchestra.run.trial166.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-20T18:57:04.211 INFO:teuthology.orchestra.run.trial166.stdout: ceph-base x86_64 2:20.2.0-677.gf7870454.el9 ceph 5.9 M 2026-02-20T18:57:04.211 INFO:teuthology.orchestra.run.trial166.stdout: ceph-common x86_64 2:20.2.0-677.gf7870454.el9 ceph 24 M 2026-02-20T18:57:04.211 INFO:teuthology.orchestra.run.trial166.stdout: ceph-selinux x86_64 2:20.2.0-677.gf7870454.el9 ceph 25 k 2026-02-20T18:57:04.211 INFO:teuthology.orchestra.run.trial166.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-20T18:57:04.211 INFO:teuthology.orchestra.run.trial166.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-20T18:57:04.211 INFO:teuthology.orchestra.run.trial166.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-20T18:57:04.212 INFO:teuthology.orchestra.run.trial166.stdout: libcephfs2 x86_64 2:20.2.0-677.gf7870454.el9 ceph 869 k 2026-02-20T18:57:04.212 INFO:teuthology.orchestra.run.trial166.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-20T18:57:04.212 INFO:teuthology.orchestra.run.trial166.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-20T18:57:04.212 INFO:teuthology.orchestra.run.trial166.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-20T18:57:04.212 INFO:teuthology.orchestra.run.trial166.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-20T18:57:04.212 INFO:teuthology.orchestra.run.trial166.stdout: libradosstriper1 x86_64 2:20.2.0-677.gf7870454.el9 ceph 250 k 2026-02-20T18:57:04.212 INFO:teuthology.orchestra.run.trial166.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-20T18:57:04.212 INFO:teuthology.orchestra.run.trial166.stdout: librgw2 x86_64 2:20.2.0-677.gf7870454.el9 ceph 6.4 M 2026-02-20T18:57:04.212 INFO:teuthology.orchestra.run.trial166.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-20T18:57:04.212 INFO:teuthology.orchestra.run.trial166.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-20T18:57:04.212 INFO:teuthology.orchestra.run.trial166.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-20T18:57:04.212 INFO:teuthology.orchestra.run.trial166.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-20T18:57:04.213 INFO:teuthology.orchestra.run.trial166.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-20T18:57:04.213 INFO:teuthology.orchestra.run.trial166.stdout: python3-ceph-argparse x86_64 2:20.2.0-677.gf7870454.el9 ceph 45 k 2026-02-20T18:57:04.213 INFO:teuthology.orchestra.run.trial166.stdout: python3-ceph-common x86_64 2:20.2.0-677.gf7870454.el9 ceph 175 k 2026-02-20T18:57:04.213 INFO:teuthology.orchestra.run.trial166.stdout: python3-cephfs x86_64 2:20.2.0-677.gf7870454.el9 ceph 163 k 2026-02-20T18:57:04.213 INFO:teuthology.orchestra.run.trial166.stdout: python3-rados x86_64 2:20.2.0-677.gf7870454.el9 ceph 323 k 2026-02-20T18:57:04.213 INFO:teuthology.orchestra.run.trial166.stdout: python3-rbd x86_64 2:20.2.0-677.gf7870454.el9 ceph 305 k 2026-02-20T18:57:04.213 INFO:teuthology.orchestra.run.trial166.stdout: python3-rgw x86_64 2:20.2.0-677.gf7870454.el9 ceph 99 k 2026-02-20T18:57:04.213 INFO:teuthology.orchestra.run.trial166.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-20T18:57:04.213 INFO:teuthology.orchestra.run.trial166.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-20T18:57:04.213 INFO:teuthology.orchestra.run.trial166.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-20T18:57:04.213 INFO:teuthology.orchestra.run.trial166.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-20T18:57:04.213 INFO:teuthology.orchestra.run.trial166.stdout:Installing weak dependencies: 2026-02-20T18:57:04.213 INFO:teuthology.orchestra.run.trial166.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-20T18:57:04.214 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:04.214 INFO:teuthology.orchestra.run.trial166.stdout:Transaction Summary 2026-02-20T18:57:04.214 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:57:04.214 INFO:teuthology.orchestra.run.trial166.stdout:Install 32 Packages 2026-02-20T18:57:04.214 INFO:teuthology.orchestra.run.trial166.stdout:Upgrade 2 Packages 2026-02-20T18:57:04.214 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:04.215 INFO:teuthology.orchestra.run.trial166.stdout:Total download size: 78 M 2026-02-20T18:57:04.215 INFO:teuthology.orchestra.run.trial166.stdout:Downloading Packages: 2026-02-20T18:57:05.125 INFO:teuthology.orchestra.run.trial166.stdout:(1/34): ceph-base-20.2.0-677.gf7870454.el9.x86_ 13 MB/s | 5.9 MB 00:00 2026-02-20T18:57:05.171 INFO:teuthology.orchestra.run.trial166.stdout:(2/34): ceph-selinux-20.2.0-677.gf7870454.el9.x 539 kB/s | 25 kB 00:00 2026-02-20T18:57:05.236 INFO:teuthology.orchestra.run.trial166.stdout:(3/34): libcephfs2-20.2.0-677.gf7870454.el9.x86 13 MB/s | 869 kB 00:00 2026-02-20T18:57:05.294 INFO:teuthology.orchestra.run.trial166.stdout:(4/34): libradosstriper1-20.2.0-677.gf7870454.e 4.2 MB/s | 250 kB 00:00 2026-02-20T18:57:05.716 INFO:teuthology.orchestra.run.trial166.stdout:(5/34): librgw2-20.2.0-677.gf7870454.el9.x86_64 15 MB/s | 6.4 MB 00:00 2026-02-20T18:57:05.757 INFO:teuthology.orchestra.run.trial166.stdout:(6/34): python3-ceph-argparse-20.2.0-677.gf7870 1.1 MB/s | 45 kB 00:00 2026-02-20T18:57:05.801 INFO:teuthology.orchestra.run.trial166.stdout:(7/34): python3-ceph-common-20.2.0-677.gf787045 3.9 MB/s | 175 kB 00:00 2026-02-20T18:57:05.847 INFO:teuthology.orchestra.run.trial166.stdout:(8/34): python3-cephfs-20.2.0-677.gf7870454.el9 3.5 MB/s | 163 kB 00:00 2026-02-20T18:57:05.896 INFO:teuthology.orchestra.run.trial166.stdout:(9/34): python3-rados-20.2.0-677.gf7870454.el9. 6.4 MB/s | 323 kB 00:00 2026-02-20T18:57:05.947 INFO:teuthology.orchestra.run.trial166.stdout:(10/34): python3-rbd-20.2.0-677.gf7870454.el9.x 5.9 MB/s | 305 kB 00:00 2026-02-20T18:57:05.994 INFO:teuthology.orchestra.run.trial166.stdout:(11/34): python3-rgw-20.2.0-677.gf7870454.el9.x 2.0 MB/s | 99 kB 00:00 2026-02-20T18:57:06.061 INFO:teuthology.orchestra.run.trial166.stdout:(12/34): ceph-common-20.2.0-677.gf7870454.el9.x 17 MB/s | 24 MB 00:01 2026-02-20T18:57:06.186 INFO:teuthology.orchestra.run.trial166.stdout:(13/34): mailcap-2.1.49-5.el9.noarch.rpm 173 kB/s | 33 kB 00:00 2026-02-20T18:57:06.232 INFO:teuthology.orchestra.run.trial166.stdout:(14/34): boost-program-options-1.75.0-13.el9.x8 2.2 MB/s | 104 kB 00:00 2026-02-20T18:57:06.253 INFO:teuthology.orchestra.run.trial166.stdout:(15/34): libnbd-1.20.3-4.el9.x86_64.rpm 7.8 MB/s | 164 kB 00:00 2026-02-20T18:57:06.266 INFO:teuthology.orchestra.run.trial166.stdout:(16/34): libpmemobj-1.12.1-1.el9.x86_64.rpm 12 MB/s | 160 kB 00:00 2026-02-20T18:57:06.276 INFO:teuthology.orchestra.run.trial166.stdout:(17/34): librabbitmq-0.11.0-7.el9.x86_64.rpm 4.3 MB/s | 45 kB 00:00 2026-02-20T18:57:06.302 INFO:teuthology.orchestra.run.trial166.stdout:(18/34): librdkafka-1.6.1-102.el9.x86_64.rpm 25 MB/s | 662 kB 00:00 2026-02-20T18:57:06.314 INFO:teuthology.orchestra.run.trial166.stdout:(19/34): lttng-ust-2.12.0-6.el9.x86_64.rpm 24 MB/s | 292 kB 00:00 2026-02-20T18:57:06.326 INFO:teuthology.orchestra.run.trial166.stdout:(20/34): qatlib-25.08.0-2.el9.x86_64.rpm 20 MB/s | 240 kB 00:00 2026-02-20T18:57:06.336 INFO:teuthology.orchestra.run.trial166.stdout:(21/34): qatlib-service-25.08.0-2.el9.x86_64.rp 3.7 MB/s | 37 kB 00:00 2026-02-20T18:57:06.346 INFO:teuthology.orchestra.run.trial166.stdout:(22/34): qatzip-libs-1.3.1-1.el9.x86_64.rpm 6.4 MB/s | 66 kB 00:00 2026-02-20T18:57:06.399 INFO:teuthology.orchestra.run.trial166.stdout:(23/34): pciutils-3.7.0-7.el9.x86_64.rpm 278 kB/s | 93 kB 00:00 2026-02-20T18:57:06.451 INFO:teuthology.orchestra.run.trial166.stdout:(24/34): ceph-radosgw-20.2.0-677.gf7870454.el9. 13 MB/s | 24 MB 00:01 2026-02-20T18:57:06.458 INFO:teuthology.orchestra.run.trial166.stdout:(25/34): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.7 MB/s | 308 kB 00:00 2026-02-20T18:57:06.468 INFO:teuthology.orchestra.run.trial166.stdout:(26/34): libarrow-doc-9.0.0-15.el9.noarch.rpm 1.5 MB/s | 25 kB 00:00 2026-02-20T18:57:06.482 INFO:teuthology.orchestra.run.trial166.stdout:(27/34): liboath-2.6.12-1.el9.x86_64.rpm 2.0 MB/s | 49 kB 00:00 2026-02-20T18:57:06.514 INFO:teuthology.orchestra.run.trial166.stdout:(28/34): libunwind-1.6.2-1.el9.x86_64.rpm 1.4 MB/s | 67 kB 00:00 2026-02-20T18:57:06.537 INFO:teuthology.orchestra.run.trial166.stdout:(29/34): re2-20211101-20.el9.x86_64.rpm 8.2 MB/s | 191 kB 00:00 2026-02-20T18:57:06.589 INFO:teuthology.orchestra.run.trial166.stdout:(30/34): parquet-libs-9.0.0-15.el9.x86_64.rpm 7.9 MB/s | 838 kB 00:00 2026-02-20T18:57:06.825 INFO:teuthology.orchestra.run.trial166.stdout:(31/34): librados2-20.2.0-677.gf7870454.el9.x86 15 MB/s | 3.5 MB 00:00 2026-02-20T18:57:06.847 INFO:teuthology.orchestra.run.trial166.stdout:(32/34): libarrow-9.0.0-15.el9.x86_64.rpm 9.9 MB/s | 4.4 MB 00:00 2026-02-20T18:57:06.940 INFO:teuthology.orchestra.run.trial166.stdout:(33/34): thrift-0.15.0-4.el9.x86_64.rpm 3.9 MB/s | 1.6 MB 00:00 2026-02-20T18:57:07.030 INFO:teuthology.orchestra.run.trial166.stdout:(34/34): librbd1-20.2.0-677.gf7870454.el9.x86_6 14 MB/s | 2.8 MB 00:00 2026-02-20T18:57:07.033 INFO:teuthology.orchestra.run.trial166.stdout:-------------------------------------------------------------------------------- 2026-02-20T18:57:07.033 INFO:teuthology.orchestra.run.trial166.stdout:Total 27 MB/s | 78 MB 00:02 2026-02-20T18:57:07.122 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction check 2026-02-20T18:57:07.139 INFO:teuthology.orchestra.run.trial166.stdout:Transaction check succeeded. 2026-02-20T18:57:07.140 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction test 2026-02-20T18:57:07.436 INFO:teuthology.orchestra.run.trial166.stdout:Transaction test succeeded. 2026-02-20T18:57:07.436 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction 2026-02-20T18:57:07.768 INFO:teuthology.orchestra.run.trial166.stdout: Preparing : 1/1 2026-02-20T18:57:07.781 INFO:teuthology.orchestra.run.trial166.stdout: Installing : thrift-0.15.0-4.el9.x86_64 1/36 2026-02-20T18:57:07.944 INFO:teuthology.orchestra.run.trial166.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 2/36 2026-02-20T18:57:07.950 INFO:teuthology.orchestra.run.trial166.stdout: Upgrading : librados2-2:20.2.0-677.gf7870454.el9.x86_64 3/36 2026-02-20T18:57:07.981 INFO:teuthology.orchestra.run.trial166.stdout: Running scriptlet: librados2-2:20.2.0-677.gf7870454.el9.x86_64 3/36 2026-02-20T18:57:08.020 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-rados-2:20.2.0-677.gf7870454.el9.x86_64 4/36 2026-02-20T18:57:08.021 INFO:teuthology.orchestra.run.trial166.stdout: Installing : libcephfs2-2:20.2.0-677.gf7870454.el9.x86_64 5/36 2026-02-20T18:57:08.033 INFO:teuthology.orchestra.run.trial166.stdout: Running scriptlet: libcephfs2-2:20.2.0-677.gf7870454.el9.x86_64 5/36 2026-02-20T18:57:08.043 INFO:teuthology.orchestra.run.trial166.stdout: Installing : liboath-2.6.12-1.el9.x86_64 6/36 2026-02-20T18:57:08.045 INFO:teuthology.orchestra.run.trial166.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 7/36 2026-02-20T18:57:08.048 INFO:teuthology.orchestra.run.trial166.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 8/36 2026-02-20T18:57:08.053 INFO:teuthology.orchestra.run.trial166.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 9/36 2026-02-20T18:57:08.062 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-ceph-argparse-2:20.2.0-677.gf7870454.el9.x 10/36 2026-02-20T18:57:08.075 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-cephfs-2:20.2.0-677.gf7870454.el9.x86_64 11/36 2026-02-20T18:57:08.076 INFO:teuthology.orchestra.run.trial166.stdout: Installing : libradosstriper1-2:20.2.0-677.gf7870454.el9.x86_64 12/36 2026-02-20T18:57:08.089 INFO:teuthology.orchestra.run.trial166.stdout: Running scriptlet: libradosstriper1-2:20.2.0-677.gf7870454.el9.x86_64 12/36 2026-02-20T18:57:08.120 INFO:teuthology.orchestra.run.trial166.stdout: Installing : re2-1:20211101-20.el9.x86_64 13/36 2026-02-20T18:57:08.125 INFO:teuthology.orchestra.run.trial166.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 14/36 2026-02-20T18:57:08.133 INFO:teuthology.orchestra.run.trial166.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 15/36 2026-02-20T18:57:08.135 INFO:teuthology.orchestra.run.trial166.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 16/36 2026-02-20T18:57:08.140 INFO:teuthology.orchestra.run.trial166.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 17/36 2026-02-20T18:57:08.270 INFO:teuthology.orchestra.run.trial166.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/36 2026-02-20T18:57:08.271 INFO:teuthology.orchestra.run.trial166.stdout: Upgrading : librbd1-2:20.2.0-677.gf7870454.el9.x86_64 19/36 2026-02-20T18:57:08.298 INFO:teuthology.orchestra.run.trial166.stdout: Running scriptlet: librbd1-2:20.2.0-677.gf7870454.el9.x86_64 19/36 2026-02-20T18:57:08.300 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-rbd-2:20.2.0-677.gf7870454.el9.x86_64 20/36 2026-02-20T18:57:08.306 INFO:teuthology.orchestra.run.trial166.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/36 2026-02-20T18:57:08.598 INFO:teuthology.orchestra.run.trial166.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/36 2026-02-20T18:57:08.600 INFO:teuthology.orchestra.run.trial166.stdout: Installing : librgw2-2:20.2.0-677.gf7870454.el9.x86_64 23/36 2026-02-20T18:57:08.615 INFO:teuthology.orchestra.run.trial166.stdout: Running scriptlet: librgw2-2:20.2.0-677.gf7870454.el9.x86_64 23/36 2026-02-20T18:57:08.620 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-rgw-2:20.2.0-677.gf7870454.el9.x86_64 24/36 2026-02-20T18:57:08.625 INFO:teuthology.orchestra.run.trial166.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/36 2026-02-20T18:57:08.627 INFO:teuthology.orchestra.run.trial166.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/36 2026-02-20T18:57:08.628 INFO:teuthology.orchestra.run.trial166.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-20T18:57:08.645 INFO:teuthology.orchestra.run.trial166.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-20T18:57:08.648 INFO:teuthology.orchestra.run.trial166.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/36 2026-02-20T18:57:08.682 INFO:teuthology.orchestra.run.trial166.stdout: Installing : mailcap-2.1.49-5.el9.noarch 29/36 2026-02-20T18:57:08.684 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-ceph-common-2:20.2.0-677.gf7870454.el9.x86 30/36 2026-02-20T18:57:09.825 INFO:teuthology.orchestra.run.trial166.stdout: Running scriptlet: ceph-common-2:20.2.0-677.gf7870454.el9.x86_64 31/36 2026-02-20T18:57:09.828 INFO:teuthology.orchestra.run.trial166.stdout: Installing : ceph-common-2:20.2.0-677.gf7870454.el9.x86_64 31/36 2026-02-20T18:57:10.140 INFO:teuthology.orchestra.run.trial166.stdout: Running scriptlet: ceph-common-2:20.2.0-677.gf7870454.el9.x86_64 31/36 2026-02-20T18:57:10.143 INFO:teuthology.orchestra.run.trial166.stdout: Installing : ceph-base-2:20.2.0-677.gf7870454.el9.x86_64 32/36 2026-02-20T18:57:10.184 INFO:teuthology.orchestra.run.trial166.stdout: Running scriptlet: ceph-base-2:20.2.0-677.gf7870454.el9.x86_64 32/36 2026-02-20T18:57:10.184 INFO:teuthology.orchestra.run.trial166.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-20T18:57:10.184 INFO:teuthology.orchestra.run.trial166.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-20T18:57:10.184 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:10.187 INFO:teuthology.orchestra.run.trial166.stdout: Installing : ceph-selinux-2:20.2.0-677.gf7870454.el9.x86_64 33/36 2026-02-20T18:57:14.667 INFO:teuthology.orchestra.run.trial166.stdout: Running scriptlet: ceph-selinux-2:20.2.0-677.gf7870454.el9.x86_64 33/36 2026-02-20T18:57:14.667 INFO:teuthology.orchestra.run.trial166.stdout:skipping the directory /sys 2026-02-20T18:57:14.667 INFO:teuthology.orchestra.run.trial166.stdout:skipping the directory /proc 2026-02-20T18:57:14.667 INFO:teuthology.orchestra.run.trial166.stdout:skipping the directory /mnt 2026-02-20T18:57:14.667 INFO:teuthology.orchestra.run.trial166.stdout:skipping the directory /var/tmp 2026-02-20T18:57:14.667 INFO:teuthology.orchestra.run.trial166.stdout:skipping the directory /home 2026-02-20T18:57:14.667 INFO:teuthology.orchestra.run.trial166.stdout:skipping the directory /root 2026-02-20T18:57:14.667 INFO:teuthology.orchestra.run.trial166.stdout:skipping the directory /tmp 2026-02-20T18:57:14.667 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:15.760 INFO:teuthology.orchestra.run.trial166.stdout: Installing : ceph-radosgw-2:20.2.0-677.gf7870454.el9.x86_64 34/36 2026-02-20T18:57:15.784 INFO:teuthology.orchestra.run.trial166.stdout: Running scriptlet: ceph-radosgw-2:20.2.0-677.gf7870454.el9.x86_64 34/36 2026-02-20T18:57:15.784 INFO:teuthology.orchestra.run.trial166.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T18:57:15.784 INFO:teuthology.orchestra.run.trial166.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-20T18:57:15.784 INFO:teuthology.orchestra.run.trial166.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T18:57:15.785 INFO:teuthology.orchestra.run.trial166.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T18:57:15.785 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:15.786 INFO:teuthology.orchestra.run.trial166.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-20T18:57:15.798 INFO:teuthology.orchestra.run.trial166.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-20T18:57:15.798 INFO:teuthology.orchestra.run.trial166.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-20T18:57:15.853 INFO:teuthology.orchestra.run.trial166.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-20T18:57:15.853 INFO:teuthology.orchestra.run.trial166.stdout:Creating group 'qat' with GID 992. 2026-02-20T18:57:15.853 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:16.198 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : ceph-base-2:20.2.0-677.gf7870454.el9.x86_64 1/36 2026-02-20T18:57:16.198 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : ceph-common-2:20.2.0-677.gf7870454.el9.x86_64 2/36 2026-02-20T18:57:16.199 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : ceph-radosgw-2:20.2.0-677.gf7870454.el9.x86_64 3/36 2026-02-20T18:57:16.199 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : ceph-selinux-2:20.2.0-677.gf7870454.el9.x86_64 4/36 2026-02-20T18:57:16.199 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : libcephfs2-2:20.2.0-677.gf7870454.el9.x86_64 5/36 2026-02-20T18:57:16.199 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : libradosstriper1-2:20.2.0-677.gf7870454.el9.x86_64 6/36 2026-02-20T18:57:16.199 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : librgw2-2:20.2.0-677.gf7870454.el9.x86_64 7/36 2026-02-20T18:57:16.199 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-ceph-argparse-2:20.2.0-677.gf7870454.el9.x 8/36 2026-02-20T18:57:16.199 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-ceph-common-2:20.2.0-677.gf7870454.el9.x86 9/36 2026-02-20T18:57:16.199 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-cephfs-2:20.2.0-677.gf7870454.el9.x86_64 10/36 2026-02-20T18:57:16.199 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-rados-2:20.2.0-677.gf7870454.el9.x86_64 11/36 2026-02-20T18:57:16.199 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-rbd-2:20.2.0-677.gf7870454.el9.x86_64 12/36 2026-02-20T18:57:16.199 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-rgw-2:20.2.0-677.gf7870454.el9.x86_64 13/36 2026-02-20T18:57:16.200 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/36 2026-02-20T18:57:16.200 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 15/36 2026-02-20T18:57:16.200 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 16/36 2026-02-20T18:57:16.200 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 17/36 2026-02-20T18:57:16.200 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 18/36 2026-02-20T18:57:16.200 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/36 2026-02-20T18:57:16.200 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 20/36 2026-02-20T18:57:16.200 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 21/36 2026-02-20T18:57:16.200 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 22/36 2026-02-20T18:57:16.200 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 23/36 2026-02-20T18:57:16.200 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 24/36 2026-02-20T18:57:16.200 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 25/36 2026-02-20T18:57:16.201 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 26/36 2026-02-20T18:57:16.201 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 27/36 2026-02-20T18:57:16.201 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 28/36 2026-02-20T18:57:16.201 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 29/36 2026-02-20T18:57:16.201 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 30/36 2026-02-20T18:57:16.201 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : re2-1:20211101-20.el9.x86_64 31/36 2026-02-20T18:57:16.201 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 32/36 2026-02-20T18:57:16.201 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : librados2-2:20.2.0-677.gf7870454.el9.x86_64 33/36 2026-02-20T18:57:16.201 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 34/36 2026-02-20T18:57:16.201 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : librbd1-2:20.2.0-677.gf7870454.el9.x86_64 35/36 2026-02-20T18:57:16.260 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 36/36 2026-02-20T18:57:16.261 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:16.261 INFO:teuthology.orchestra.run.trial166.stdout:Upgraded: 2026-02-20T18:57:16.261 INFO:teuthology.orchestra.run.trial166.stdout: librados2-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T18:57:16.261 INFO:teuthology.orchestra.run.trial166.stdout: librbd1-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T18:57:16.261 INFO:teuthology.orchestra.run.trial166.stdout:Installed: 2026-02-20T18:57:16.261 INFO:teuthology.orchestra.run.trial166.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-20T18:57:16.261 INFO:teuthology.orchestra.run.trial166.stdout: ceph-base-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T18:57:16.261 INFO:teuthology.orchestra.run.trial166.stdout: ceph-common-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T18:57:16.261 INFO:teuthology.orchestra.run.trial166.stdout: ceph-radosgw-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T18:57:16.262 INFO:teuthology.orchestra.run.trial166.stdout: ceph-selinux-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T18:57:16.262 INFO:teuthology.orchestra.run.trial166.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-20T18:57:16.262 INFO:teuthology.orchestra.run.trial166.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-20T18:57:16.262 INFO:teuthology.orchestra.run.trial166.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-20T18:57:16.262 INFO:teuthology.orchestra.run.trial166.stdout: libcephfs2-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T18:57:16.262 INFO:teuthology.orchestra.run.trial166.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-20T18:57:16.262 INFO:teuthology.orchestra.run.trial166.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-20T18:57:16.262 INFO:teuthology.orchestra.run.trial166.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-20T18:57:16.262 INFO:teuthology.orchestra.run.trial166.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-20T18:57:16.262 INFO:teuthology.orchestra.run.trial166.stdout: libradosstriper1-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T18:57:16.262 INFO:teuthology.orchestra.run.trial166.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-20T18:57:16.262 INFO:teuthology.orchestra.run.trial166.stdout: librgw2-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T18:57:16.263 INFO:teuthology.orchestra.run.trial166.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-20T18:57:16.263 INFO:teuthology.orchestra.run.trial166.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-20T18:57:16.263 INFO:teuthology.orchestra.run.trial166.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-20T18:57:16.263 INFO:teuthology.orchestra.run.trial166.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-20T18:57:16.263 INFO:teuthology.orchestra.run.trial166.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-20T18:57:16.263 INFO:teuthology.orchestra.run.trial166.stdout: python3-ceph-argparse-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T18:57:16.263 INFO:teuthology.orchestra.run.trial166.stdout: python3-ceph-common-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T18:57:16.263 INFO:teuthology.orchestra.run.trial166.stdout: python3-cephfs-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T18:57:16.263 INFO:teuthology.orchestra.run.trial166.stdout: python3-rados-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T18:57:16.263 INFO:teuthology.orchestra.run.trial166.stdout: python3-rbd-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T18:57:16.263 INFO:teuthology.orchestra.run.trial166.stdout: python3-rgw-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T18:57:16.263 INFO:teuthology.orchestra.run.trial166.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-20T18:57:16.264 INFO:teuthology.orchestra.run.trial166.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-20T18:57:16.264 INFO:teuthology.orchestra.run.trial166.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-20T18:57:16.264 INFO:teuthology.orchestra.run.trial166.stdout: re2-1:20211101-20.el9.x86_64 2026-02-20T18:57:16.264 INFO:teuthology.orchestra.run.trial166.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-20T18:57:16.264 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:16.264 INFO:teuthology.orchestra.run.trial166.stdout:Complete! 2026-02-20T18:57:16.303 DEBUG:teuthology.orchestra.run.trial166:> sudo yum -y install ceph-test 2026-02-20T18:57:16.605 INFO:teuthology.orchestra.run.trial166.stdout:Last metadata expiration check: 0:00:13 ago on Fri 20 Feb 2026 06:57:03 PM UTC. 2026-02-20T18:57:16.689 INFO:teuthology.orchestra.run.trial166.stdout:Dependencies resolved. 2026-02-20T18:57:16.690 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:57:16.690 INFO:teuthology.orchestra.run.trial166.stdout: Package Arch Version Repository Size 2026-02-20T18:57:16.690 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:57:16.690 INFO:teuthology.orchestra.run.trial166.stdout:Installing: 2026-02-20T18:57:16.690 INFO:teuthology.orchestra.run.trial166.stdout: ceph-test x86_64 2:20.2.0-677.gf7870454.el9 ceph 84 M 2026-02-20T18:57:16.690 INFO:teuthology.orchestra.run.trial166.stdout:Installing dependencies: 2026-02-20T18:57:16.690 INFO:teuthology.orchestra.run.trial166.stdout: libcephsqlite x86_64 2:20.2.0-677.gf7870454.el9 ceph 164 k 2026-02-20T18:57:16.690 INFO:teuthology.orchestra.run.trial166.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-20T18:57:16.691 INFO:teuthology.orchestra.run.trial166.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-20T18:57:16.691 INFO:teuthology.orchestra.run.trial166.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-20T18:57:16.691 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:16.691 INFO:teuthology.orchestra.run.trial166.stdout:Transaction Summary 2026-02-20T18:57:16.691 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:57:16.691 INFO:teuthology.orchestra.run.trial166.stdout:Install 5 Packages 2026-02-20T18:57:16.691 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:16.691 INFO:teuthology.orchestra.run.trial166.stdout:Total download size: 85 M 2026-02-20T18:57:16.691 INFO:teuthology.orchestra.run.trial166.stdout:Installed size: 365 M 2026-02-20T18:57:16.691 INFO:teuthology.orchestra.run.trial166.stdout:Downloading Packages: 2026-02-20T18:57:17.094 INFO:teuthology.orchestra.run.trial166.stdout:(1/5): libcephsqlite-20.2.0-677.gf7870454.el9.x 514 kB/s | 164 kB 00:00 2026-02-20T18:57:17.647 INFO:teuthology.orchestra.run.trial166.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 267 kB/s | 233 kB 00:00 2026-02-20T18:57:17.805 INFO:teuthology.orchestra.run.trial166.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 402 kB/s | 64 kB 00:00 2026-02-20T18:57:17.959 INFO:teuthology.orchestra.run.trial166.stdout:(4/5): socat-1.7.4.1-8.el9.x86_64.rpm 351 kB/s | 303 kB 00:00 2026-02-20T18:57:21.602 INFO:teuthology.orchestra.run.trial166.stdout:(5/5): ceph-test-20.2.0-677.gf7870454.el9.x86_6 17 MB/s | 84 MB 00:04 2026-02-20T18:57:21.604 INFO:teuthology.orchestra.run.trial166.stdout:-------------------------------------------------------------------------------- 2026-02-20T18:57:21.604 INFO:teuthology.orchestra.run.trial166.stdout:Total 17 MB/s | 85 MB 00:04 2026-02-20T18:57:21.630 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction check 2026-02-20T18:57:21.641 INFO:teuthology.orchestra.run.trial166.stdout:Transaction check succeeded. 2026-02-20T18:57:21.641 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction test 2026-02-20T18:57:21.929 INFO:teuthology.orchestra.run.trial166.stdout:Transaction test succeeded. 2026-02-20T18:57:21.929 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction 2026-02-20T18:57:22.244 INFO:teuthology.orchestra.run.trial166.stdout: Preparing : 1/1 2026-02-20T18:57:22.250 INFO:teuthology.orchestra.run.trial166.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-20T18:57:22.255 INFO:teuthology.orchestra.run.trial166.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-20T18:57:22.262 INFO:teuthology.orchestra.run.trial166.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-20T18:57:22.263 INFO:teuthology.orchestra.run.trial166.stdout: Installing : libcephsqlite-2:20.2.0-677.gf7870454.el9.x86_64 4/5 2026-02-20T18:57:26.204 INFO:teuthology.orchestra.run.trial166.stdout: Running scriptlet: libcephsqlite-2:20.2.0-677.gf7870454.el9.x86_64 4/5 2026-02-20T18:57:26.222 INFO:teuthology.orchestra.run.trial166.stdout: Installing : ceph-test-2:20.2.0-677.gf7870454.el9.x86_64 5/5 2026-02-20T18:57:26.568 INFO:teuthology.orchestra.run.trial166.stdout: Running scriptlet: ceph-test-2:20.2.0-677.gf7870454.el9.x86_64 5/5 2026-02-20T18:57:26.568 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : ceph-test-2:20.2.0-677.gf7870454.el9.x86_64 1/5 2026-02-20T18:57:26.568 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : libcephsqlite-2:20.2.0-677.gf7870454.el9.x86_64 2/5 2026-02-20T18:57:26.568 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-20T18:57:26.568 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-20T18:57:26.621 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-20T18:57:26.622 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:26.622 INFO:teuthology.orchestra.run.trial166.stdout:Installed: 2026-02-20T18:57:26.622 INFO:teuthology.orchestra.run.trial166.stdout: ceph-test-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T18:57:26.622 INFO:teuthology.orchestra.run.trial166.stdout: libcephsqlite-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T18:57:26.622 INFO:teuthology.orchestra.run.trial166.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-20T18:57:26.622 INFO:teuthology.orchestra.run.trial166.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-20T18:57:26.622 INFO:teuthology.orchestra.run.trial166.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-20T18:57:26.622 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:26.622 INFO:teuthology.orchestra.run.trial166.stdout:Complete! 2026-02-20T18:57:26.655 DEBUG:teuthology.orchestra.run.trial166:> sudo yum -y install ceph 2026-02-20T18:57:26.960 INFO:teuthology.orchestra.run.trial166.stdout:Last metadata expiration check: 0:00:23 ago on Fri 20 Feb 2026 06:57:03 PM UTC. 2026-02-20T18:57:27.044 INFO:teuthology.orchestra.run.trial166.stdout:Dependencies resolved. 2026-02-20T18:57:27.046 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:57:27.046 INFO:teuthology.orchestra.run.trial166.stdout: Package Arch Version Repository Size 2026-02-20T18:57:27.046 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:57:27.046 INFO:teuthology.orchestra.run.trial166.stdout:Installing: 2026-02-20T18:57:27.046 INFO:teuthology.orchestra.run.trial166.stdout: ceph x86_64 2:20.2.0-677.gf7870454.el9 ceph 6.5 k 2026-02-20T18:57:27.046 INFO:teuthology.orchestra.run.trial166.stdout:Installing dependencies: 2026-02-20T18:57:27.046 INFO:teuthology.orchestra.run.trial166.stdout: ceph-mds x86_64 2:20.2.0-677.gf7870454.el9 ceph 2.3 M 2026-02-20T18:57:27.046 INFO:teuthology.orchestra.run.trial166.stdout: ceph-mgr x86_64 2:20.2.0-677.gf7870454.el9 ceph 961 k 2026-02-20T18:57:27.046 INFO:teuthology.orchestra.run.trial166.stdout: ceph-mgr-modules-core noarch 2:20.2.0-677.gf7870454.el9 ceph-noarch 290 k 2026-02-20T18:57:27.046 INFO:teuthology.orchestra.run.trial166.stdout: ceph-mon x86_64 2:20.2.0-677.gf7870454.el9 ceph 5.0 M 2026-02-20T18:57:27.046 INFO:teuthology.orchestra.run.trial166.stdout: ceph-osd x86_64 2:20.2.0-677.gf7870454.el9 ceph 17 M 2026-02-20T18:57:27.046 INFO:teuthology.orchestra.run.trial166.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-20T18:57:27.046 INFO:teuthology.orchestra.run.trial166.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-20T18:57:27.046 INFO:teuthology.orchestra.run.trial166.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-20T18:57:27.046 INFO:teuthology.orchestra.run.trial166.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-20T18:57:27.046 INFO:teuthology.orchestra.run.trial166.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-20T18:57:27.046 INFO:teuthology.orchestra.run.trial166.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-20T18:57:27.046 INFO:teuthology.orchestra.run.trial166.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-20T18:57:27.046 INFO:teuthology.orchestra.run.trial166.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-20T18:57:27.046 INFO:teuthology.orchestra.run.trial166.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-20T18:57:27.046 INFO:teuthology.orchestra.run.trial166.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-20T18:57:27.046 INFO:teuthology.orchestra.run.trial166.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-20T18:57:27.046 INFO:teuthology.orchestra.run.trial166.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-20T18:57:27.046 INFO:teuthology.orchestra.run.trial166.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-20T18:57:27.046 INFO:teuthology.orchestra.run.trial166.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-20T18:57:27.046 INFO:teuthology.orchestra.run.trial166.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-20T18:57:27.046 INFO:teuthology.orchestra.run.trial166.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-20T18:57:27.046 INFO:teuthology.orchestra.run.trial166.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-20T18:57:27.046 INFO:teuthology.orchestra.run.trial166.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-20T18:57:27.046 INFO:teuthology.orchestra.run.trial166.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-20T18:57:27.046 INFO:teuthology.orchestra.run.trial166.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-20T18:57:27.046 INFO:teuthology.orchestra.run.trial166.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-20T18:57:27.046 INFO:teuthology.orchestra.run.trial166.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-20T18:57:27.046 INFO:teuthology.orchestra.run.trial166.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-20T18:57:27.046 INFO:teuthology.orchestra.run.trial166.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-20T18:57:27.046 INFO:teuthology.orchestra.run.trial166.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-20T18:57:27.046 INFO:teuthology.orchestra.run.trial166.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-20T18:57:27.046 INFO:teuthology.orchestra.run.trial166.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-20T18:57:27.046 INFO:teuthology.orchestra.run.trial166.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-20T18:57:27.047 INFO:teuthology.orchestra.run.trial166.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-20T18:57:27.047 INFO:teuthology.orchestra.run.trial166.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-20T18:57:27.047 INFO:teuthology.orchestra.run.trial166.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-20T18:57:27.047 INFO:teuthology.orchestra.run.trial166.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-20T18:57:27.047 INFO:teuthology.orchestra.run.trial166.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-20T18:57:27.047 INFO:teuthology.orchestra.run.trial166.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-20T18:57:27.047 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:27.047 INFO:teuthology.orchestra.run.trial166.stdout:Transaction Summary 2026-02-20T18:57:27.047 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:57:27.047 INFO:teuthology.orchestra.run.trial166.stdout:Install 40 Packages 2026-02-20T18:57:27.047 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:27.047 INFO:teuthology.orchestra.run.trial166.stdout:Total download size: 30 M 2026-02-20T18:57:27.047 INFO:teuthology.orchestra.run.trial166.stdout:Installed size: 100 M 2026-02-20T18:57:27.047 INFO:teuthology.orchestra.run.trial166.stdout:Downloading Packages: 2026-02-20T18:57:27.415 INFO:teuthology.orchestra.run.trial166.stdout:(1/40): ceph-20.2.0-677.gf7870454.el9.x86_64.rp 126 kB/s | 6.5 kB 00:00 2026-02-20T18:57:27.504 INFO:teuthology.orchestra.run.trial166.stdout:(2/40): ceph-mgr-20.2.0-677.gf7870454.el9.x86_6 6.7 MB/s | 961 kB 00:00 2026-02-20T18:57:27.530 INFO:teuthology.orchestra.run.trial166.stdout:(3/40): ceph-mds-20.2.0-677.gf7870454.el9.x86_6 14 MB/s | 2.3 MB 00:00 2026-02-20T18:57:27.576 INFO:teuthology.orchestra.run.trial166.stdout:(4/40): ceph-mgr-modules-core-20.2.0-677.gf7870 6.1 MB/s | 290 kB 00:00 2026-02-20T18:57:27.650 INFO:teuthology.orchestra.run.trial166.stdout:(5/40): ceph-mon-20.2.0-677.gf7870454.el9.x86_6 22 MB/s | 5.0 MB 00:00 2026-02-20T18:57:27.650 INFO:teuthology.orchestra.run.trial166.stdout:(6/40): ledmon-libs-1.1.0-3.el9.x86_64.rpm 555 kB/s | 40 kB 00:00 2026-02-20T18:57:27.672 INFO:teuthology.orchestra.run.trial166.stdout:(7/40): libconfig-1.7.2-9.el9.x86_64.rpm 3.1 MB/s | 72 kB 00:00 2026-02-20T18:57:27.735 INFO:teuthology.orchestra.run.trial166.stdout:(8/40): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.9 MB/s | 253 kB 00:00 2026-02-20T18:57:27.758 INFO:teuthology.orchestra.run.trial166.stdout:(9/40): python3-cryptography-36.0.1-5.el9.x86_6 14 MB/s | 1.2 MB 00:00 2026-02-20T18:57:27.759 INFO:teuthology.orchestra.run.trial166.stdout:(10/40): python3-ply-3.11-14.el9.noarch.rpm 4.4 MB/s | 106 kB 00:00 2026-02-20T18:57:27.782 INFO:teuthology.orchestra.run.trial166.stdout:(11/40): python3-pycparser-2.20-6.el9.noarch.rp 5.6 MB/s | 135 kB 00:00 2026-02-20T18:57:27.783 INFO:teuthology.orchestra.run.trial166.stdout:(12/40): python3-pyparsing-2.4.7-9.el9.noarch.r 6.0 MB/s | 150 kB 00:00 2026-02-20T18:57:27.804 INFO:teuthology.orchestra.run.trial166.stdout:(13/40): python3-requests-2.25.1-10.el9.noarch. 5.7 MB/s | 126 kB 00:00 2026-02-20T18:57:27.808 INFO:teuthology.orchestra.run.trial166.stdout:(14/40): python3-urllib3-1.26.5-7.el9.noarch.rp 8.8 MB/s | 218 kB 00:00 2026-02-20T18:57:27.827 INFO:teuthology.orchestra.run.trial166.stdout:(15/40): unzip-6.0-59.el9.x86_64.rpm 7.7 MB/s | 182 kB 00:00 2026-02-20T18:57:27.834 INFO:teuthology.orchestra.run.trial166.stdout:(16/40): zip-3.0-35.el9.x86_64.rpm 9.9 MB/s | 266 kB 00:00 2026-02-20T18:57:27.917 INFO:teuthology.orchestra.run.trial166.stdout:(17/40): ceph-osd-20.2.0-677.gf7870454.el9.x86_ 41 MB/s | 17 MB 00:00 2026-02-20T18:57:28.393 INFO:teuthology.orchestra.run.trial166.stdout:(18/40): lua-5.4.4-4.el9.x86_64.rpm 337 kB/s | 188 kB 00:00 2026-02-20T18:57:28.553 INFO:teuthology.orchestra.run.trial166.stdout:(19/40): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 340 kB/s | 246 kB 00:00 2026-02-20T18:57:28.553 INFO:teuthology.orchestra.run.trial166.stdout:(20/40): python3-packaging-20.9-5.el9.noarch.rp 481 kB/s | 77 kB 00:00 2026-02-20T18:57:28.637 INFO:teuthology.orchestra.run.trial166.stdout:(21/40): python3-toml-0.10.2-6.el9.noarch.rpm 496 kB/s | 42 kB 00:00 2026-02-20T18:57:28.641 INFO:teuthology.orchestra.run.trial166.stdout:(22/40): python3-libstoragemgmt-1.10.1-1.el9.x8 246 kB/s | 177 kB 00:00 2026-02-20T18:57:28.666 INFO:teuthology.orchestra.run.trial166.stdout:(23/40): python3-autocommand-2.2.2-8.el9.noarch 1.2 MB/s | 29 kB 00:00 2026-02-20T18:57:28.686 INFO:teuthology.orchestra.run.trial166.stdout:(24/40): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2026-02-20T18:57:28.688 INFO:teuthology.orchestra.run.trial166.stdout:(25/40): python3-backports-tarfile-1.2.0-1.el9. 2.7 MB/s | 60 kB 00:00 2026-02-20T18:57:28.703 INFO:teuthology.orchestra.run.trial166.stdout:(26/40): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 2.5 MB/s | 43 kB 00:00 2026-02-20T18:57:28.724 INFO:teuthology.orchestra.run.trial166.stdout:(27/40): python3-cheroot-10.0.1-4.el9.noarch.rp 4.8 MB/s | 173 kB 00:00 2026-02-20T18:57:28.736 INFO:teuthology.orchestra.run.trial166.stdout:(28/40): python3-jaraco-8.2.1-3.el9.noarch.rpm 887 kB/s | 11 kB 00:00 2026-02-20T18:57:28.743 INFO:teuthology.orchestra.run.trial166.stdout:(29/40): python3-cherrypy-18.6.1-2.el9.noarch.r 8.9 MB/s | 358 kB 00:00 2026-02-20T18:57:28.747 INFO:teuthology.orchestra.run.trial166.stdout:(30/40): python3-jaraco-classes-3.2.1-5.el9.noa 1.5 MB/s | 18 kB 00:00 2026-02-20T18:57:28.755 INFO:teuthology.orchestra.run.trial166.stdout:(31/40): python3-jaraco-collections-3.0.0-8.el9 1.8 MB/s | 23 kB 00:00 2026-02-20T18:57:28.759 INFO:teuthology.orchestra.run.trial166.stdout:(32/40): python3-jaraco-context-6.0.1-3.el9.noa 1.6 MB/s | 20 kB 00:00 2026-02-20T18:57:28.769 INFO:teuthology.orchestra.run.trial166.stdout:(33/40): python3-jaraco-functools-3.5.0-2.el9.n 1.5 MB/s | 19 kB 00:00 2026-02-20T18:57:28.773 INFO:teuthology.orchestra.run.trial166.stdout:(34/40): python3-jaraco-text-4.0.0-2.el9.noarch 2.0 MB/s | 26 kB 00:00 2026-02-20T18:57:28.784 INFO:teuthology.orchestra.run.trial166.stdout:(35/40): python3-portend-3.1.0-2.el9.noarch.rpm 1.4 MB/s | 16 kB 00:00 2026-02-20T18:57:28.785 INFO:teuthology.orchestra.run.trial166.stdout:(36/40): python3-more-itertools-8.12.0-2.el9.no 4.6 MB/s | 79 kB 00:00 2026-02-20T18:57:28.799 INFO:teuthology.orchestra.run.trial166.stdout:(37/40): python3-tempora-5.0.0-2.el9.noarch.rpm 2.5 MB/s | 36 kB 00:00 2026-02-20T18:57:28.808 INFO:teuthology.orchestra.run.trial166.stdout:(38/40): python3-pyOpenSSL-21.0.0-1.el9.noarch. 3.7 MB/s | 90 kB 00:00 2026-02-20T18:57:28.812 INFO:teuthology.orchestra.run.trial166.stdout:(39/40): python3-zc-lockfile-2.0-10.el9.noarch. 1.6 MB/s | 20 kB 00:00 2026-02-20T18:57:28.886 INFO:teuthology.orchestra.run.trial166.stdout:(40/40): lua-devel-5.4.4-4.el9.x86_64.rpm 67 kB/s | 22 kB 00:00 2026-02-20T18:57:28.889 INFO:teuthology.orchestra.run.trial166.stdout:-------------------------------------------------------------------------------- 2026-02-20T18:57:28.889 INFO:teuthology.orchestra.run.trial166.stdout:Total 16 MB/s | 30 MB 00:01 2026-02-20T18:57:29.034 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction check 2026-02-20T18:57:29.052 INFO:teuthology.orchestra.run.trial166.stdout:Transaction check succeeded. 2026-02-20T18:57:29.052 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction test 2026-02-20T18:57:29.196 INFO:teuthology.orchestra.run.trial166.stdout:Transaction test succeeded. 2026-02-20T18:57:29.196 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction 2026-02-20T18:57:29.386 INFO:teuthology.orchestra.run.trial166.stdout: Preparing : 1/1 2026-02-20T18:57:29.388 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/40 2026-02-20T18:57:29.393 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/40 2026-02-20T18:57:29.397 INFO:teuthology.orchestra.run.trial166.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/40 2026-02-20T18:57:29.399 INFO:teuthology.orchestra.run.trial166.stdout: Installing : unzip-6.0-59.el9.x86_64 4/40 2026-02-20T18:57:29.405 INFO:teuthology.orchestra.run.trial166.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 5/40 2026-02-20T18:57:29.429 INFO:teuthology.orchestra.run.trial166.stdout: Installing : zip-3.0-35.el9.x86_64 6/40 2026-02-20T18:57:29.432 INFO:teuthology.orchestra.run.trial166.stdout: Installing : luarocks-3.9.2-5.el9.noarch 7/40 2026-02-20T18:57:29.437 INFO:teuthology.orchestra.run.trial166.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 8/40 2026-02-20T18:57:29.442 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 9/40 2026-02-20T18:57:29.448 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 10/40 2026-02-20T18:57:29.452 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 11/40 2026-02-20T18:57:29.458 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 12/40 2026-02-20T18:57:29.463 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 13/40 2026-02-20T18:57:29.466 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 14/40 2026-02-20T18:57:29.472 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 15/40 2026-02-20T18:57:29.476 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 16/40 2026-02-20T18:57:29.483 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 17/40 2026-02-20T18:57:29.486 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 18/40 2026-02-20T18:57:29.509 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 19/40 2026-02-20T18:57:29.521 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/40 2026-02-20T18:57:29.526 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/40 2026-02-20T18:57:29.536 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 22/40 2026-02-20T18:57:29.542 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-packaging-20.9-5.el9.noarch 23/40 2026-02-20T18:57:29.555 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/40 2026-02-20T18:57:29.571 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/40 2026-02-20T18:57:29.647 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/40 2026-02-20T18:57:29.655 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 27/40 2026-02-20T18:57:29.678 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/40 2026-02-20T18:57:29.707 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 29/40 2026-02-20T18:57:29.712 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/40 2026-02-20T18:57:29.759 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/40 2026-02-20T18:57:29.803 INFO:teuthology.orchestra.run.trial166.stdout: Installing : ceph-mgr-modules-core-2:20.2.0-677.gf7870454.el9.n 32/40 2026-02-20T18:57:29.804 INFO:teuthology.orchestra.run.trial166.stdout: Installing : ceph-mgr-2:20.2.0-677.gf7870454.el9.x86_64 33/40 2026-02-20T18:57:29.827 INFO:teuthology.orchestra.run.trial166.stdout: Running scriptlet: ceph-mgr-2:20.2.0-677.gf7870454.el9.x86_64 33/40 2026-02-20T18:57:29.827 INFO:teuthology.orchestra.run.trial166.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T18:57:29.827 INFO:teuthology.orchestra.run.trial166.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-20T18:57:29.827 INFO:teuthology.orchestra.run.trial166.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T18:57:29.828 INFO:teuthology.orchestra.run.trial166.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T18:57:29.828 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:29.833 INFO:teuthology.orchestra.run.trial166.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 34/40 2026-02-20T18:57:29.852 INFO:teuthology.orchestra.run.trial166.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-20T18:57:29.852 INFO:teuthology.orchestra.run.trial166.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-20T18:57:29.852 INFO:teuthology.orchestra.run.trial166.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-20T18:57:29.852 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:29.860 INFO:teuthology.orchestra.run.trial166.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-20T18:57:29.884 INFO:teuthology.orchestra.run.trial166.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-20T18:57:29.885 INFO:teuthology.orchestra.run.trial166.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-20T18:57:29.885 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:30.579 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 36/40 2026-02-20T18:57:30.580 INFO:teuthology.orchestra.run.trial166.stdout: Installing : ceph-osd-2:20.2.0-677.gf7870454.el9.x86_64 37/40 2026-02-20T18:57:30.605 INFO:teuthology.orchestra.run.trial166.stdout: Running scriptlet: ceph-osd-2:20.2.0-677.gf7870454.el9.x86_64 37/40 2026-02-20T18:57:30.605 INFO:teuthology.orchestra.run.trial166.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T18:57:30.605 INFO:teuthology.orchestra.run.trial166.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-20T18:57:30.605 INFO:teuthology.orchestra.run.trial166.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T18:57:30.606 INFO:teuthology.orchestra.run.trial166.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T18:57:30.606 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:30.823 INFO:teuthology.orchestra.run.trial166.stdout: Installing : ceph-mon-2:20.2.0-677.gf7870454.el9.x86_64 38/40 2026-02-20T18:57:30.844 INFO:teuthology.orchestra.run.trial166.stdout: Running scriptlet: ceph-mon-2:20.2.0-677.gf7870454.el9.x86_64 38/40 2026-02-20T18:57:30.844 INFO:teuthology.orchestra.run.trial166.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T18:57:30.844 INFO:teuthology.orchestra.run.trial166.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-20T18:57:30.844 INFO:teuthology.orchestra.run.trial166.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T18:57:30.844 INFO:teuthology.orchestra.run.trial166.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T18:57:30.844 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:30.948 INFO:teuthology.orchestra.run.trial166.stdout: Installing : ceph-mds-2:20.2.0-677.gf7870454.el9.x86_64 39/40 2026-02-20T18:57:30.970 INFO:teuthology.orchestra.run.trial166.stdout: Running scriptlet: ceph-mds-2:20.2.0-677.gf7870454.el9.x86_64 39/40 2026-02-20T18:57:30.970 INFO:teuthology.orchestra.run.trial166.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T18:57:30.970 INFO:teuthology.orchestra.run.trial166.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-20T18:57:30.970 INFO:teuthology.orchestra.run.trial166.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T18:57:30.970 INFO:teuthology.orchestra.run.trial166.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T18:57:30.970 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:30.987 INFO:teuthology.orchestra.run.trial166.stdout: Installing : ceph-2:20.2.0-677.gf7870454.el9.x86_64 40/40 2026-02-20T18:57:31.327 INFO:teuthology.orchestra.run.trial166.stdout: Running scriptlet: ceph-2:20.2.0-677.gf7870454.el9.x86_64 40/40 2026-02-20T18:57:31.327 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : ceph-2:20.2.0-677.gf7870454.el9.x86_64 1/40 2026-02-20T18:57:31.327 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : ceph-mds-2:20.2.0-677.gf7870454.el9.x86_64 2/40 2026-02-20T18:57:31.327 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : ceph-mgr-2:20.2.0-677.gf7870454.el9.x86_64 3/40 2026-02-20T18:57:31.327 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : ceph-mon-2:20.2.0-677.gf7870454.el9.x86_64 4/40 2026-02-20T18:57:31.327 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : ceph-osd-2:20.2.0-677.gf7870454.el9.x86_64 5/40 2026-02-20T18:57:31.327 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : ceph-mgr-modules-core-2:20.2.0-677.gf7870454.el9.n 6/40 2026-02-20T18:57:31.327 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 7/40 2026-02-20T18:57:31.327 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 8/40 2026-02-20T18:57:31.327 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 9/40 2026-02-20T18:57:31.327 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 10/40 2026-02-20T18:57:31.328 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-ply-3.11-14.el9.noarch 11/40 2026-02-20T18:57:31.328 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 12/40 2026-02-20T18:57:31.328 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 13/40 2026-02-20T18:57:31.328 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 14/40 2026-02-20T18:57:31.328 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 15/40 2026-02-20T18:57:31.328 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : unzip-6.0-59.el9.x86_64 16/40 2026-02-20T18:57:31.328 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : zip-3.0-35.el9.x86_64 17/40 2026-02-20T18:57:31.328 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 18/40 2026-02-20T18:57:31.328 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : lua-5.4.4-4.el9.x86_64 19/40 2026-02-20T18:57:31.328 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 20/40 2026-02-20T18:57:31.328 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 21/40 2026-02-20T18:57:31.328 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 22/40 2026-02-20T18:57:31.328 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 23/40 2026-02-20T18:57:31.328 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 24/40 2026-02-20T18:57:31.328 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 25/40 2026-02-20T18:57:31.328 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 26/40 2026-02-20T18:57:31.328 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 27/40 2026-02-20T18:57:31.328 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 28/40 2026-02-20T18:57:31.328 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 29/40 2026-02-20T18:57:31.328 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 30/40 2026-02-20T18:57:31.328 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 31/40 2026-02-20T18:57:31.328 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 32/40 2026-02-20T18:57:31.328 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 33/40 2026-02-20T18:57:31.328 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 34/40 2026-02-20T18:57:31.328 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 35/40 2026-02-20T18:57:31.328 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 36/40 2026-02-20T18:57:31.328 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 37/40 2026-02-20T18:57:31.328 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 38/40 2026-02-20T18:57:31.328 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 39/40 2026-02-20T18:57:31.385 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 40/40 2026-02-20T18:57:31.385 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:31.385 INFO:teuthology.orchestra.run.trial166.stdout:Installed: 2026-02-20T18:57:31.386 INFO:teuthology.orchestra.run.trial166.stdout: ceph-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T18:57:31.386 INFO:teuthology.orchestra.run.trial166.stdout: ceph-mds-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T18:57:31.386 INFO:teuthology.orchestra.run.trial166.stdout: ceph-mgr-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T18:57:31.386 INFO:teuthology.orchestra.run.trial166.stdout: ceph-mgr-modules-core-2:20.2.0-677.gf7870454.el9.noarch 2026-02-20T18:57:31.386 INFO:teuthology.orchestra.run.trial166.stdout: ceph-mon-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T18:57:31.386 INFO:teuthology.orchestra.run.trial166.stdout: ceph-osd-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T18:57:31.386 INFO:teuthology.orchestra.run.trial166.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-20T18:57:31.386 INFO:teuthology.orchestra.run.trial166.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-20T18:57:31.386 INFO:teuthology.orchestra.run.trial166.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T18:57:31.386 INFO:teuthology.orchestra.run.trial166.stdout: lua-5.4.4-4.el9.x86_64 2026-02-20T18:57:31.386 INFO:teuthology.orchestra.run.trial166.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-20T18:57:31.386 INFO:teuthology.orchestra.run.trial166.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-20T18:57:31.387 INFO:teuthology.orchestra.run.trial166.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-20T18:57:31.387 INFO:teuthology.orchestra.run.trial166.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-20T18:57:31.387 INFO:teuthology.orchestra.run.trial166.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-20T18:57:31.387 INFO:teuthology.orchestra.run.trial166.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-20T18:57:31.387 INFO:teuthology.orchestra.run.trial166.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-20T18:57:31.387 INFO:teuthology.orchestra.run.trial166.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-20T18:57:31.387 INFO:teuthology.orchestra.run.trial166.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-20T18:57:31.387 INFO:teuthology.orchestra.run.trial166.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-20T18:57:31.387 INFO:teuthology.orchestra.run.trial166.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-20T18:57:31.387 INFO:teuthology.orchestra.run.trial166.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-20T18:57:31.387 INFO:teuthology.orchestra.run.trial166.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-20T18:57:31.388 INFO:teuthology.orchestra.run.trial166.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-20T18:57:31.388 INFO:teuthology.orchestra.run.trial166.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-20T18:57:31.388 INFO:teuthology.orchestra.run.trial166.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T18:57:31.388 INFO:teuthology.orchestra.run.trial166.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-20T18:57:31.388 INFO:teuthology.orchestra.run.trial166.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-20T18:57:31.388 INFO:teuthology.orchestra.run.trial166.stdout: python3-ply-3.11-14.el9.noarch 2026-02-20T18:57:31.388 INFO:teuthology.orchestra.run.trial166.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-20T18:57:31.388 INFO:teuthology.orchestra.run.trial166.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-20T18:57:31.388 INFO:teuthology.orchestra.run.trial166.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-20T18:57:31.389 INFO:teuthology.orchestra.run.trial166.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-20T18:57:31.389 INFO:teuthology.orchestra.run.trial166.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-20T18:57:31.389 INFO:teuthology.orchestra.run.trial166.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-20T18:57:31.389 INFO:teuthology.orchestra.run.trial166.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-20T18:57:31.389 INFO:teuthology.orchestra.run.trial166.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-20T18:57:31.389 INFO:teuthology.orchestra.run.trial166.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-20T18:57:31.389 INFO:teuthology.orchestra.run.trial166.stdout: unzip-6.0-59.el9.x86_64 2026-02-20T18:57:31.389 INFO:teuthology.orchestra.run.trial166.stdout: zip-3.0-35.el9.x86_64 2026-02-20T18:57:31.389 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:31.389 INFO:teuthology.orchestra.run.trial166.stdout:Complete! 2026-02-20T18:57:31.422 DEBUG:teuthology.orchestra.run.trial166:> sudo yum -y install ceph-base 2026-02-20T18:57:31.728 INFO:teuthology.orchestra.run.trial166.stdout:Last metadata expiration check: 0:00:28 ago on Fri 20 Feb 2026 06:57:03 PM UTC. 2026-02-20T18:57:31.794 INFO:teuthology.orchestra.run.trial166.stdout:Package ceph-base-2:20.2.0-677.gf7870454.el9.x86_64 is already installed. 2026-02-20T18:57:31.811 INFO:teuthology.orchestra.run.trial166.stdout:Dependencies resolved. 2026-02-20T18:57:31.811 INFO:teuthology.orchestra.run.trial166.stdout:Nothing to do. 2026-02-20T18:57:31.811 INFO:teuthology.orchestra.run.trial166.stdout:Complete! 2026-02-20T18:57:31.833 DEBUG:teuthology.orchestra.run.trial166:> sudo yum -y install cephadm 2026-02-20T18:57:32.137 INFO:teuthology.orchestra.run.trial166.stdout:Last metadata expiration check: 0:00:29 ago on Fri 20 Feb 2026 06:57:03 PM UTC. 2026-02-20T18:57:32.219 INFO:teuthology.orchestra.run.trial166.stdout:Dependencies resolved. 2026-02-20T18:57:32.219 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:57:32.219 INFO:teuthology.orchestra.run.trial166.stdout: Package Arch Version Repository Size 2026-02-20T18:57:32.219 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:57:32.219 INFO:teuthology.orchestra.run.trial166.stdout:Installing: 2026-02-20T18:57:32.219 INFO:teuthology.orchestra.run.trial166.stdout: cephadm noarch 2:20.2.0-677.gf7870454.el9 ceph-noarch 1.0 M 2026-02-20T18:57:32.219 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:32.219 INFO:teuthology.orchestra.run.trial166.stdout:Transaction Summary 2026-02-20T18:57:32.219 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:57:32.219 INFO:teuthology.orchestra.run.trial166.stdout:Install 1 Package 2026-02-20T18:57:32.219 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:32.219 INFO:teuthology.orchestra.run.trial166.stdout:Total download size: 1.0 M 2026-02-20T18:57:32.220 INFO:teuthology.orchestra.run.trial166.stdout:Installed size: 1.0 M 2026-02-20T18:57:32.220 INFO:teuthology.orchestra.run.trial166.stdout:Downloading Packages: 2026-02-20T18:57:32.341 INFO:teuthology.orchestra.run.trial166.stdout:cephadm-20.2.0-677.gf7870454.el9.noarch.rpm 8.3 MB/s | 1.0 MB 00:00 2026-02-20T18:57:32.341 INFO:teuthology.orchestra.run.trial166.stdout:-------------------------------------------------------------------------------- 2026-02-20T18:57:32.342 INFO:teuthology.orchestra.run.trial166.stdout:Total 8.2 MB/s | 1.0 MB 00:00 2026-02-20T18:57:32.342 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction check 2026-02-20T18:57:32.344 INFO:teuthology.orchestra.run.trial166.stdout:Transaction check succeeded. 2026-02-20T18:57:32.344 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction test 2026-02-20T18:57:32.348 INFO:teuthology.orchestra.run.trial166.stdout:Transaction test succeeded. 2026-02-20T18:57:32.348 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction 2026-02-20T18:57:32.366 INFO:teuthology.orchestra.run.trial166.stdout: Preparing : 1/1 2026-02-20T18:57:32.425 INFO:teuthology.orchestra.run.trial166.stdout: Running scriptlet: cephadm-2:20.2.0-677.gf7870454.el9.noarch 1/1 2026-02-20T18:57:32.438 INFO:teuthology.orchestra.run.trial166.stdout: Installing : cephadm-2:20.2.0-677.gf7870454.el9.noarch 1/1 2026-02-20T18:57:32.501 INFO:teuthology.orchestra.run.trial166.stdout: Running scriptlet: cephadm-2:20.2.0-677.gf7870454.el9.noarch 1/1 2026-02-20T18:57:32.556 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : cephadm-2:20.2.0-677.gf7870454.el9.noarch 1/1 2026-02-20T18:57:32.556 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:32.556 INFO:teuthology.orchestra.run.trial166.stdout:Installed: 2026-02-20T18:57:32.556 INFO:teuthology.orchestra.run.trial166.stdout: cephadm-2:20.2.0-677.gf7870454.el9.noarch 2026-02-20T18:57:32.556 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:32.556 INFO:teuthology.orchestra.run.trial166.stdout:Complete! 2026-02-20T18:57:32.585 DEBUG:teuthology.orchestra.run.trial166:> sudo yum -y install ceph-immutable-object-cache 2026-02-20T18:57:32.897 INFO:teuthology.orchestra.run.trial166.stdout:Last metadata expiration check: 0:00:29 ago on Fri 20 Feb 2026 06:57:03 PM UTC. 2026-02-20T18:57:32.980 INFO:teuthology.orchestra.run.trial166.stdout:Dependencies resolved. 2026-02-20T18:57:32.980 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:57:32.981 INFO:teuthology.orchestra.run.trial166.stdout: Package Arch Version Repo Size 2026-02-20T18:57:32.981 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:57:32.981 INFO:teuthology.orchestra.run.trial166.stdout:Installing: 2026-02-20T18:57:32.981 INFO:teuthology.orchestra.run.trial166.stdout: ceph-immutable-object-cache x86_64 2:20.2.0-677.gf7870454.el9 ceph 154 k 2026-02-20T18:57:32.981 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:32.981 INFO:teuthology.orchestra.run.trial166.stdout:Transaction Summary 2026-02-20T18:57:32.981 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:57:32.981 INFO:teuthology.orchestra.run.trial166.stdout:Install 1 Package 2026-02-20T18:57:32.981 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:32.981 INFO:teuthology.orchestra.run.trial166.stdout:Total download size: 154 k 2026-02-20T18:57:32.981 INFO:teuthology.orchestra.run.trial166.stdout:Installed size: 447 k 2026-02-20T18:57:32.982 INFO:teuthology.orchestra.run.trial166.stdout:Downloading Packages: 2026-02-20T18:57:33.067 INFO:teuthology.orchestra.run.trial166.stdout:ceph-immutable-object-cache-20.2.0-677.gf787045 1.8 MB/s | 154 kB 00:00 2026-02-20T18:57:33.068 INFO:teuthology.orchestra.run.trial166.stdout:-------------------------------------------------------------------------------- 2026-02-20T18:57:33.068 INFO:teuthology.orchestra.run.trial166.stdout:Total 1.7 MB/s | 154 kB 00:00 2026-02-20T18:57:33.068 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction check 2026-02-20T18:57:33.072 INFO:teuthology.orchestra.run.trial166.stdout:Transaction check succeeded. 2026-02-20T18:57:33.072 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction test 2026-02-20T18:57:33.098 INFO:teuthology.orchestra.run.trial166.stdout:Transaction test succeeded. 2026-02-20T18:57:33.099 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction 2026-02-20T18:57:33.147 INFO:teuthology.orchestra.run.trial166.stdout: Preparing : 1/1 2026-02-20T18:57:33.149 INFO:teuthology.orchestra.run.trial166.stdout: Installing : ceph-immutable-object-cache-2:20.2.0-677.gf7870454.e 1/1 2026-02-20T18:57:33.172 INFO:teuthology.orchestra.run.trial166.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.2.0-677.gf7870454.e 1/1 2026-02-20T18:57:33.172 INFO:teuthology.orchestra.run.trial166.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T18:57:33.173 INFO:teuthology.orchestra.run.trial166.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-20T18:57:33.173 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:33.472 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : ceph-immutable-object-cache-2:20.2.0-677.gf7870454.e 1/1 2026-02-20T18:57:33.472 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:33.472 INFO:teuthology.orchestra.run.trial166.stdout:Installed: 2026-02-20T18:57:33.472 INFO:teuthology.orchestra.run.trial166.stdout: ceph-immutable-object-cache-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T18:57:33.472 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:33.472 INFO:teuthology.orchestra.run.trial166.stdout:Complete! 2026-02-20T18:57:33.499 DEBUG:teuthology.orchestra.run.trial166:> sudo yum -y install ceph-mgr 2026-02-20T18:57:33.807 INFO:teuthology.orchestra.run.trial166.stdout:Last metadata expiration check: 0:00:30 ago on Fri 20 Feb 2026 06:57:03 PM UTC. 2026-02-20T18:57:33.872 INFO:teuthology.orchestra.run.trial166.stdout:Package ceph-mgr-2:20.2.0-677.gf7870454.el9.x86_64 is already installed. 2026-02-20T18:57:33.889 INFO:teuthology.orchestra.run.trial166.stdout:Dependencies resolved. 2026-02-20T18:57:33.889 INFO:teuthology.orchestra.run.trial166.stdout:Nothing to do. 2026-02-20T18:57:33.889 INFO:teuthology.orchestra.run.trial166.stdout:Complete! 2026-02-20T18:57:33.912 DEBUG:teuthology.orchestra.run.trial166:> sudo yum -y install ceph-mgr-dashboard 2026-02-20T18:57:34.216 INFO:teuthology.orchestra.run.trial166.stdout:Last metadata expiration check: 0:00:31 ago on Fri 20 Feb 2026 06:57:03 PM UTC. 2026-02-20T18:57:34.301 INFO:teuthology.orchestra.run.trial166.stdout:Dependencies resolved. 2026-02-20T18:57:34.301 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:57:34.301 INFO:teuthology.orchestra.run.trial166.stdout: Package Arch Version Repository Size 2026-02-20T18:57:34.301 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:57:34.301 INFO:teuthology.orchestra.run.trial166.stdout:Installing: 2026-02-20T18:57:34.302 INFO:teuthology.orchestra.run.trial166.stdout: ceph-mgr-dashboard noarch 2:20.2.0-677.gf7870454.el9 ceph-noarch 11 M 2026-02-20T18:57:34.302 INFO:teuthology.orchestra.run.trial166.stdout:Installing dependencies: 2026-02-20T18:57:34.302 INFO:teuthology.orchestra.run.trial166.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-20T18:57:34.302 INFO:teuthology.orchestra.run.trial166.stdout: ceph-grafana-dashboards noarch 2:20.2.0-677.gf7870454.el9 ceph-noarch 43 k 2026-02-20T18:57:34.302 INFO:teuthology.orchestra.run.trial166.stdout: ceph-prometheus-alerts noarch 2:20.2.0-677.gf7870454.el9 ceph-noarch 17 k 2026-02-20T18:57:34.302 INFO:teuthology.orchestra.run.trial166.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-20T18:57:34.302 INFO:teuthology.orchestra.run.trial166.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-20T18:57:34.302 INFO:teuthology.orchestra.run.trial166.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-20T18:57:34.302 INFO:teuthology.orchestra.run.trial166.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-20T18:57:34.302 INFO:teuthology.orchestra.run.trial166.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-20T18:57:34.302 INFO:teuthology.orchestra.run.trial166.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-20T18:57:34.302 INFO:teuthology.orchestra.run.trial166.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-20T18:57:34.302 INFO:teuthology.orchestra.run.trial166.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-20T18:57:34.302 INFO:teuthology.orchestra.run.trial166.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-20T18:57:34.302 INFO:teuthology.orchestra.run.trial166.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-20T18:57:34.302 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:34.302 INFO:teuthology.orchestra.run.trial166.stdout:Transaction Summary 2026-02-20T18:57:34.302 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:57:34.302 INFO:teuthology.orchestra.run.trial166.stdout:Install 14 Packages 2026-02-20T18:57:34.302 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:34.302 INFO:teuthology.orchestra.run.trial166.stdout:Total download size: 16 M 2026-02-20T18:57:34.302 INFO:teuthology.orchestra.run.trial166.stdout:Installed size: 158 M 2026-02-20T18:57:34.302 INFO:teuthology.orchestra.run.trial166.stdout:Downloading Packages: 2026-02-20T18:57:34.816 INFO:teuthology.orchestra.run.trial166.stdout:(1/14): ceph-prometheus-alerts-20.2.0-677.gf787 233 kB/s | 17 kB 00:00 2026-02-20T18:57:34.826 INFO:teuthology.orchestra.run.trial166.stdout:(2/14): ceph-grafana-dashboards-20.2.0-677.gf78 512 kB/s | 43 kB 00:00 2026-02-20T18:57:34.890 INFO:teuthology.orchestra.run.trial166.stdout:(3/14): python3-jmespath-1.0.1-1.el9.noarch.rpm 751 kB/s | 48 kB 00:00 2026-02-20T18:57:34.947 INFO:teuthology.orchestra.run.trial166.stdout:(4/14): protobuf-3.14.0-17.el9.x86_64.rpm 7.7 MB/s | 1.0 MB 00:00 2026-02-20T18:57:34.954 INFO:teuthology.orchestra.run.trial166.stdout:(5/14): python3-protobuf-3.14.0-17.el9.noarch.r 4.0 MB/s | 267 kB 00:00 2026-02-20T18:57:35.078 INFO:teuthology.orchestra.run.trial166.stdout:(6/14): protobuf-compiler-3.14.0-17.el9.x86_64. 6.4 MB/s | 862 kB 00:00 2026-02-20T18:57:35.148 INFO:teuthology.orchestra.run.trial166.stdout:(7/14): ceph-mgr-dashboard-20.2.0-677.gf7870454 26 MB/s | 11 MB 00:00 2026-02-20T18:57:35.164 INFO:teuthology.orchestra.run.trial166.stdout:(8/14): grpc-data-1.46.7-10.el9.noarch.rpm 226 kB/s | 19 kB 00:00 2026-02-20T18:57:35.205 INFO:teuthology.orchestra.run.trial166.stdout:(9/14): abseil-cpp-20211102.0-4.el9.x86_64.rpm 2.1 MB/s | 551 kB 00:00 2026-02-20T18:57:35.244 INFO:teuthology.orchestra.run.trial166.stdout:(10/14): python3-repoze-lru-0.7-16.el9.noarch.r 793 kB/s | 31 kB 00:00 2026-02-20T18:57:35.267 INFO:teuthology.orchestra.run.trial166.stdout:(11/14): python3-grpcio-tools-1.46.7-10.el9.x86 1.4 MB/s | 144 kB 00:00 2026-02-20T18:57:35.303 INFO:teuthology.orchestra.run.trial166.stdout:(12/14): python3-xmltodict-0.12.0-15.el9.noarch 611 kB/s | 22 kB 00:00 2026-02-20T18:57:35.446 INFO:teuthology.orchestra.run.trial166.stdout:(13/14): python3-grpcio-1.46.7-10.el9.x86_64.rp 6.8 MB/s | 2.0 MB 00:00 2026-02-20T18:57:35.600 INFO:teuthology.orchestra.run.trial166.stdout:(14/14): python3-routes-2.5.1-5.el9.noarch.rpm 530 kB/s | 188 kB 00:00 2026-02-20T18:57:35.601 INFO:teuthology.orchestra.run.trial166.stdout:-------------------------------------------------------------------------------- 2026-02-20T18:57:35.601 INFO:teuthology.orchestra.run.trial166.stdout:Total 12 MB/s | 16 MB 00:01 2026-02-20T18:57:35.640 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction check 2026-02-20T18:57:35.649 INFO:teuthology.orchestra.run.trial166.stdout:Transaction check succeeded. 2026-02-20T18:57:35.649 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction test 2026-02-20T18:57:35.745 INFO:teuthology.orchestra.run.trial166.stdout:Transaction test succeeded. 2026-02-20T18:57:35.745 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction 2026-02-20T18:57:35.861 INFO:teuthology.orchestra.run.trial166.stdout: Preparing : 1/1 2026-02-20T18:57:35.869 INFO:teuthology.orchestra.run.trial166.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 1/14 2026-02-20T18:57:35.873 INFO:teuthology.orchestra.run.trial166.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 2/14 2026-02-20T18:57:35.878 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 3/14 2026-02-20T18:57:35.889 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 4/14 2026-02-20T18:57:35.891 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 5/14 2026-02-20T18:57:35.919 INFO:teuthology.orchestra.run.trial166.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 6/14 2026-02-20T18:57:35.962 INFO:teuthology.orchestra.run.trial166.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 7/14 2026-02-20T18:57:35.990 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 8/14 2026-02-20T18:57:36.001 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 9/14 2026-02-20T18:57:36.009 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/14 2026-02-20T18:57:36.011 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 11/14 2026-02-20T18:57:36.018 INFO:teuthology.orchestra.run.trial166.stdout: Installing : ceph-prometheus-alerts-2:20.2.0-677.gf7870454.el9. 12/14 2026-02-20T18:57:37.153 INFO:teuthology.orchestra.run.trial166.stdout: Installing : ceph-grafana-dashboards-2:20.2.0-677.gf7870454.el9 13/14 2026-02-20T18:57:37.158 INFO:teuthology.orchestra.run.trial166.stdout: Installing : ceph-mgr-dashboard-2:20.2.0-677.gf7870454.el9.noar 14/14 2026-02-20T18:57:37.340 INFO:teuthology.orchestra.run.trial166.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.2.0-677.gf7870454.el9.noar 14/14 2026-02-20T18:57:37.340 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : ceph-grafana-dashboards-2:20.2.0-677.gf7870454.el9 1/14 2026-02-20T18:57:37.340 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : ceph-mgr-dashboard-2:20.2.0-677.gf7870454.el9.noar 2/14 2026-02-20T18:57:37.340 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : ceph-prometheus-alerts-2:20.2.0-677.gf7870454.el9. 3/14 2026-02-20T18:57:37.340 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 4/14 2026-02-20T18:57:37.340 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 5/14 2026-02-20T18:57:37.340 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 6/14 2026-02-20T18:57:37.340 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 7/14 2026-02-20T18:57:37.341 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 8/14 2026-02-20T18:57:37.341 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 9/14 2026-02-20T18:57:37.341 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 10/14 2026-02-20T18:57:37.341 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 11/14 2026-02-20T18:57:37.341 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 12/14 2026-02-20T18:57:37.341 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 13/14 2026-02-20T18:57:37.395 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 14/14 2026-02-20T18:57:37.395 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:37.395 INFO:teuthology.orchestra.run.trial166.stdout:Installed: 2026-02-20T18:57:37.395 INFO:teuthology.orchestra.run.trial166.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-20T18:57:37.395 INFO:teuthology.orchestra.run.trial166.stdout: ceph-grafana-dashboards-2:20.2.0-677.gf7870454.el9.noarch 2026-02-20T18:57:37.395 INFO:teuthology.orchestra.run.trial166.stdout: ceph-mgr-dashboard-2:20.2.0-677.gf7870454.el9.noarch 2026-02-20T18:57:37.395 INFO:teuthology.orchestra.run.trial166.stdout: ceph-prometheus-alerts-2:20.2.0-677.gf7870454.el9.noarch 2026-02-20T18:57:37.395 INFO:teuthology.orchestra.run.trial166.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-20T18:57:37.395 INFO:teuthology.orchestra.run.trial166.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-20T18:57:37.396 INFO:teuthology.orchestra.run.trial166.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-20T18:57:37.396 INFO:teuthology.orchestra.run.trial166.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-20T18:57:37.396 INFO:teuthology.orchestra.run.trial166.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-20T18:57:37.396 INFO:teuthology.orchestra.run.trial166.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-20T18:57:37.396 INFO:teuthology.orchestra.run.trial166.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-20T18:57:37.396 INFO:teuthology.orchestra.run.trial166.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-20T18:57:37.396 INFO:teuthology.orchestra.run.trial166.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-20T18:57:37.396 INFO:teuthology.orchestra.run.trial166.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-20T18:57:37.396 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:37.396 INFO:teuthology.orchestra.run.trial166.stdout:Complete! 2026-02-20T18:57:37.428 DEBUG:teuthology.orchestra.run.trial166:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-20T18:57:37.735 INFO:teuthology.orchestra.run.trial166.stdout:Last metadata expiration check: 0:00:34 ago on Fri 20 Feb 2026 06:57:03 PM UTC. 2026-02-20T18:57:37.819 INFO:teuthology.orchestra.run.trial166.stdout:Dependencies resolved. 2026-02-20T18:57:37.820 INFO:teuthology.orchestra.run.trial166.stdout:====================================================================================== 2026-02-20T18:57:37.820 INFO:teuthology.orchestra.run.trial166.stdout: Package Arch Version Repository Size 2026-02-20T18:57:37.820 INFO:teuthology.orchestra.run.trial166.stdout:====================================================================================== 2026-02-20T18:57:37.820 INFO:teuthology.orchestra.run.trial166.stdout:Installing: 2026-02-20T18:57:37.821 INFO:teuthology.orchestra.run.trial166.stdout: ceph-mgr-diskprediction-local noarch 2:20.2.0-677.gf7870454.el9 ceph-noarch 7.4 M 2026-02-20T18:57:37.821 INFO:teuthology.orchestra.run.trial166.stdout:Installing dependencies: 2026-02-20T18:57:37.821 INFO:teuthology.orchestra.run.trial166.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-20T18:57:37.821 INFO:teuthology.orchestra.run.trial166.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-20T18:57:37.821 INFO:teuthology.orchestra.run.trial166.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-20T18:57:37.821 INFO:teuthology.orchestra.run.trial166.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-20T18:57:37.821 INFO:teuthology.orchestra.run.trial166.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-20T18:57:37.821 INFO:teuthology.orchestra.run.trial166.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-20T18:57:37.822 INFO:teuthology.orchestra.run.trial166.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-20T18:57:37.822 INFO:teuthology.orchestra.run.trial166.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-20T18:57:37.822 INFO:teuthology.orchestra.run.trial166.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-20T18:57:37.822 INFO:teuthology.orchestra.run.trial166.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-20T18:57:37.822 INFO:teuthology.orchestra.run.trial166.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-20T18:57:37.822 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:37.822 INFO:teuthology.orchestra.run.trial166.stdout:Transaction Summary 2026-02-20T18:57:37.822 INFO:teuthology.orchestra.run.trial166.stdout:====================================================================================== 2026-02-20T18:57:37.822 INFO:teuthology.orchestra.run.trial166.stdout:Install 12 Packages 2026-02-20T18:57:37.822 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:37.822 INFO:teuthology.orchestra.run.trial166.stdout:Total download size: 43 M 2026-02-20T18:57:37.823 INFO:teuthology.orchestra.run.trial166.stdout:Installed size: 234 M 2026-02-20T18:57:37.823 INFO:teuthology.orchestra.run.trial166.stdout:Downloading Packages: 2026-02-20T18:57:38.005 INFO:teuthology.orchestra.run.trial166.stdout:(1/12): libquadmath-11.5.0-14.el9.x86_64.rpm 5.3 MB/s | 184 kB 00:00 2026-02-20T18:57:38.012 INFO:teuthology.orchestra.run.trial166.stdout:(2/12): libgfortran-11.5.0-14.el9.x86_64.rpm 19 MB/s | 794 kB 00:00 2026-02-20T18:57:38.408 INFO:teuthology.orchestra.run.trial166.stdout:(3/12): flexiblas-3.0.4-9.el9.x86_64.rpm 73 kB/s | 30 kB 00:00 2026-02-20T18:57:38.435 INFO:teuthology.orchestra.run.trial166.stdout:(4/12): ceph-mgr-diskprediction-local-20.2.0-67 16 MB/s | 7.4 MB 00:00 2026-02-20T18:57:38.491 INFO:teuthology.orchestra.run.trial166.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-9.el9.x 180 kB/s | 15 kB 00:00 2026-02-20T18:57:38.923 INFO:teuthology.orchestra.run.trial166.stdout:(6/12): openblas-0.3.29-1.el9.x86_64.rpm 86 kB/s | 42 kB 00:00 2026-02-20T18:57:39.592 INFO:teuthology.orchestra.run.trial166.stdout:(7/12): openblas-openmp-0.3.29-1.el9.x86_64.rpm 4.8 MB/s | 5.3 MB 00:01 2026-02-20T18:57:39.960 INFO:teuthology.orchestra.run.trial166.stdout:(8/12): python3-devel-3.9.25-3.el9.x86_64.rpm 236 kB/s | 244 kB 00:01 2026-02-20T18:57:40.619 INFO:teuthology.orchestra.run.trial166.stdout:(9/12): python3-numpy-1.23.5-2.el9.x86_64.rpm 6.0 MB/s | 6.1 MB 00:01 2026-02-20T18:57:40.998 INFO:teuthology.orchestra.run.trial166.stdout:(10/12): python3-numpy-f2py-1.23.5-2.el9.x86_64 426 kB/s | 442 kB 00:01 2026-02-20T18:57:41.867 INFO:teuthology.orchestra.run.trial166.stdout:(11/12): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 794 kB/s | 3.0 MB 00:03 2026-02-20T18:57:43.620 INFO:teuthology.orchestra.run.trial166.stdout:(12/12): python3-scipy-1.9.3-2.el9.x86_64.rpm 6.4 MB/s | 19 MB 00:03 2026-02-20T18:57:43.622 INFO:teuthology.orchestra.run.trial166.stdout:-------------------------------------------------------------------------------- 2026-02-20T18:57:43.623 INFO:teuthology.orchestra.run.trial166.stdout:Total 7.4 MB/s | 43 MB 00:05 2026-02-20T18:57:43.783 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction check 2026-02-20T18:57:43.797 INFO:teuthology.orchestra.run.trial166.stdout:Transaction check succeeded. 2026-02-20T18:57:43.797 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction test 2026-02-20T18:57:43.998 INFO:teuthology.orchestra.run.trial166.stdout:Transaction test succeeded. 2026-02-20T18:57:43.999 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction 2026-02-20T18:57:44.213 INFO:teuthology.orchestra.run.trial166.stdout: Preparing : 1/1 2026-02-20T18:57:44.216 INFO:teuthology.orchestra.run.trial166.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 1/12 2026-02-20T18:57:44.222 INFO:teuthology.orchestra.run.trial166.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 2/12 2026-02-20T18:57:44.255 INFO:teuthology.orchestra.run.trial166.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 3/12 2026-02-20T18:57:44.260 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 4/12 2026-02-20T18:57:44.319 INFO:teuthology.orchestra.run.trial166.stdout: Installing : openblas-0.3.29-1.el9.x86_64 5/12 2026-02-20T18:57:44.321 INFO:teuthology.orchestra.run.trial166.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 6/12 2026-02-20T18:57:44.343 INFO:teuthology.orchestra.run.trial166.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 7/12 2026-02-20T18:57:44.660 INFO:teuthology.orchestra.run.trial166.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 8/12 2026-02-20T18:57:44.731 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 9/12 2026-02-20T18:57:45.385 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 10/12 2026-02-20T18:57:45.852 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 11/12 2026-02-20T18:57:45.853 INFO:teuthology.orchestra.run.trial166.stdout: Installing : ceph-mgr-diskprediction-local-2:20.2.0-677.gf78704 12/12 2026-02-20T18:57:46.125 INFO:teuthology.orchestra.run.trial166.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.2.0-677.gf78704 12/12 2026-02-20T18:57:46.125 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.2.0-677.gf78704 1/12 2026-02-20T18:57:46.125 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 2/12 2026-02-20T18:57:46.125 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 3/12 2026-02-20T18:57:46.125 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 4/12 2026-02-20T18:57:46.125 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 5/12 2026-02-20T18:57:46.126 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 6/12 2026-02-20T18:57:46.126 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 7/12 2026-02-20T18:57:46.126 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 8/12 2026-02-20T18:57:46.126 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 9/12 2026-02-20T18:57:46.126 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 10/12 2026-02-20T18:57:46.126 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 11/12 2026-02-20T18:57:46.183 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 12/12 2026-02-20T18:57:46.183 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:46.183 INFO:teuthology.orchestra.run.trial166.stdout:Installed: 2026-02-20T18:57:46.183 INFO:teuthology.orchestra.run.trial166.stdout: ceph-mgr-diskprediction-local-2:20.2.0-677.gf7870454.el9.noarch 2026-02-20T18:57:46.183 INFO:teuthology.orchestra.run.trial166.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-20T18:57:46.183 INFO:teuthology.orchestra.run.trial166.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-20T18:57:46.183 INFO:teuthology.orchestra.run.trial166.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-20T18:57:46.183 INFO:teuthology.orchestra.run.trial166.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-20T18:57:46.183 INFO:teuthology.orchestra.run.trial166.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-20T18:57:46.183 INFO:teuthology.orchestra.run.trial166.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-20T18:57:46.184 INFO:teuthology.orchestra.run.trial166.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-20T18:57:46.184 INFO:teuthology.orchestra.run.trial166.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-20T18:57:46.184 INFO:teuthology.orchestra.run.trial166.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-20T18:57:46.184 INFO:teuthology.orchestra.run.trial166.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-20T18:57:46.184 INFO:teuthology.orchestra.run.trial166.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-20T18:57:46.184 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:46.184 INFO:teuthology.orchestra.run.trial166.stdout:Complete! 2026-02-20T18:57:46.221 DEBUG:teuthology.orchestra.run.trial166:> sudo yum -y install ceph-mgr-rook 2026-02-20T18:57:46.531 INFO:teuthology.orchestra.run.trial166.stdout:Last metadata expiration check: 0:00:43 ago on Fri 20 Feb 2026 06:57:03 PM UTC. 2026-02-20T18:57:46.615 INFO:teuthology.orchestra.run.trial166.stdout:Dependencies resolved. 2026-02-20T18:57:46.616 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:57:46.617 INFO:teuthology.orchestra.run.trial166.stdout: Package Arch Version Repository Size 2026-02-20T18:57:46.617 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:57:46.617 INFO:teuthology.orchestra.run.trial166.stdout:Installing: 2026-02-20T18:57:46.617 INFO:teuthology.orchestra.run.trial166.stdout: ceph-mgr-rook noarch 2:20.2.0-677.gf7870454.el9 ceph-noarch 50 k 2026-02-20T18:57:46.617 INFO:teuthology.orchestra.run.trial166.stdout:Installing dependencies: 2026-02-20T18:57:46.617 INFO:teuthology.orchestra.run.trial166.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-20T18:57:46.617 INFO:teuthology.orchestra.run.trial166.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-20T18:57:46.618 INFO:teuthology.orchestra.run.trial166.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-20T18:57:46.618 INFO:teuthology.orchestra.run.trial166.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-20T18:57:46.618 INFO:teuthology.orchestra.run.trial166.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-20T18:57:46.618 INFO:teuthology.orchestra.run.trial166.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-20T18:57:46.618 INFO:teuthology.orchestra.run.trial166.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-20T18:57:46.618 INFO:teuthology.orchestra.run.trial166.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-20T18:57:46.618 INFO:teuthology.orchestra.run.trial166.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-20T18:57:46.618 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:46.619 INFO:teuthology.orchestra.run.trial166.stdout:Transaction Summary 2026-02-20T18:57:46.619 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:57:46.619 INFO:teuthology.orchestra.run.trial166.stdout:Install 10 Packages 2026-02-20T18:57:46.619 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:46.619 INFO:teuthology.orchestra.run.trial166.stdout:Total download size: 2.0 M 2026-02-20T18:57:46.619 INFO:teuthology.orchestra.run.trial166.stdout:Installed size: 25 M 2026-02-20T18:57:46.619 INFO:teuthology.orchestra.run.trial166.stdout:Downloading Packages: 2026-02-20T18:57:46.800 INFO:teuthology.orchestra.run.trial166.stdout:(1/10): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.5 MB/s | 159 kB 00:00 2026-02-20T18:57:46.807 INFO:teuthology.orchestra.run.trial166.stdout:(2/10): python3-pyasn1-modules-0.4.8-6.el9.noar 5.4 MB/s | 279 kB 00:00 2026-02-20T18:57:46.810 INFO:teuthology.orchestra.run.trial166.stdout:(3/10): python3-requests-oauthlib-1.3.0-12.el9. 5.1 MB/s | 54 kB 00:00 2026-02-20T18:57:46.923 INFO:teuthology.orchestra.run.trial166.stdout:(4/10): ceph-mgr-rook-20.2.0-677.gf7870454.el9. 301 kB/s | 50 kB 00:00 2026-02-20T18:57:47.016 INFO:teuthology.orchestra.run.trial166.stdout:(5/10): python3-certifi-2023.05.07-4.el9.noarch 69 kB/s | 14 kB 00:00 2026-02-20T18:57:47.080 INFO:teuthology.orchestra.run.trial166.stdout:(6/10): python3-cachetools-4.2.4-1.el9.noarch.r 118 kB/s | 32 kB 00:00 2026-02-20T18:57:47.208 INFO:teuthology.orchestra.run.trial166.stdout:(7/10): python3-rsa-4.9-2.el9.noarch.rpm 462 kB/s | 59 kB 00:00 2026-02-20T18:57:47.303 INFO:teuthology.orchestra.run.trial166.stdout:(8/10): python3-websocket-client-1.2.3-2.el9.no 939 kB/s | 90 kB 00:00 2026-02-20T18:57:47.361 INFO:teuthology.orchestra.run.trial166.stdout:(9/10): python3-google-auth-2.45.0-1.el9.noarch 580 kB/s | 254 kB 00:00 2026-02-20T18:57:47.397 INFO:teuthology.orchestra.run.trial166.stdout:(10/10): python3-kubernetes-26.1.0-3.el9.noarch 2.7 MB/s | 1.0 MB 00:00 2026-02-20T18:57:47.399 INFO:teuthology.orchestra.run.trial166.stdout:-------------------------------------------------------------------------------- 2026-02-20T18:57:47.399 INFO:teuthology.orchestra.run.trial166.stdout:Total 2.5 MB/s | 2.0 MB 00:00 2026-02-20T18:57:47.424 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction check 2026-02-20T18:57:47.432 INFO:teuthology.orchestra.run.trial166.stdout:Transaction check succeeded. 2026-02-20T18:57:47.432 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction test 2026-02-20T18:57:47.471 INFO:teuthology.orchestra.run.trial166.stdout:Transaction test succeeded. 2026-02-20T18:57:47.471 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction 2026-02-20T18:57:47.544 INFO:teuthology.orchestra.run.trial166.stdout: Preparing : 1/1 2026-02-20T18:57:47.594 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/10 2026-02-20T18:57:47.607 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/10 2026-02-20T18:57:47.622 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/10 2026-02-20T18:57:47.626 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/10 2026-02-20T18:57:47.633 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/10 2026-02-20T18:57:47.672 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/10 2026-02-20T18:57:47.684 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-20T18:57:48.002 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 8/10 2026-02-20T18:57:48.016 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 9/10 2026-02-20T18:57:48.017 INFO:teuthology.orchestra.run.trial166.stdout: Installing : ceph-mgr-rook-2:20.2.0-677.gf7870454.el9.noarch 10/10 2026-02-20T18:57:48.120 INFO:teuthology.orchestra.run.trial166.stdout: Running scriptlet: ceph-mgr-rook-2:20.2.0-677.gf7870454.el9.noarch 10/10 2026-02-20T18:57:48.120 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : ceph-mgr-rook-2:20.2.0-677.gf7870454.el9.noarch 1/10 2026-02-20T18:57:48.120 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 2/10 2026-02-20T18:57:48.120 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 3/10 2026-02-20T18:57:48.120 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 4/10 2026-02-20T18:57:48.120 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 5/10 2026-02-20T18:57:48.120 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 6/10 2026-02-20T18:57:48.121 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-20T18:57:48.121 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 8/10 2026-02-20T18:57:48.121 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 9/10 2026-02-20T18:57:48.177 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 10/10 2026-02-20T18:57:48.177 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:48.177 INFO:teuthology.orchestra.run.trial166.stdout:Installed: 2026-02-20T18:57:48.177 INFO:teuthology.orchestra.run.trial166.stdout: ceph-mgr-rook-2:20.2.0-677.gf7870454.el9.noarch 2026-02-20T18:57:48.177 INFO:teuthology.orchestra.run.trial166.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-20T18:57:48.177 INFO:teuthology.orchestra.run.trial166.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-20T18:57:48.177 INFO:teuthology.orchestra.run.trial166.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-20T18:57:48.177 INFO:teuthology.orchestra.run.trial166.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-20T18:57:48.177 INFO:teuthology.orchestra.run.trial166.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-20T18:57:48.177 INFO:teuthology.orchestra.run.trial166.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-20T18:57:48.177 INFO:teuthology.orchestra.run.trial166.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-20T18:57:48.177 INFO:teuthology.orchestra.run.trial166.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-20T18:57:48.177 INFO:teuthology.orchestra.run.trial166.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-20T18:57:48.177 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:48.177 INFO:teuthology.orchestra.run.trial166.stdout:Complete! 2026-02-20T18:57:48.207 DEBUG:teuthology.orchestra.run.trial166:> sudo yum -y install ceph-mgr-cephadm 2026-02-20T18:57:48.510 INFO:teuthology.orchestra.run.trial166.stdout:Last metadata expiration check: 0:00:45 ago on Fri 20 Feb 2026 06:57:03 PM UTC. 2026-02-20T18:57:48.595 INFO:teuthology.orchestra.run.trial166.stdout:Dependencies resolved. 2026-02-20T18:57:48.596 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:57:48.597 INFO:teuthology.orchestra.run.trial166.stdout: Package Arch Version Repository Size 2026-02-20T18:57:48.597 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:57:48.597 INFO:teuthology.orchestra.run.trial166.stdout:Installing: 2026-02-20T18:57:48.597 INFO:teuthology.orchestra.run.trial166.stdout: ceph-mgr-cephadm noarch 2:20.2.0-677.gf7870454.el9 ceph-noarch 173 k 2026-02-20T18:57:48.597 INFO:teuthology.orchestra.run.trial166.stdout:Installing dependencies: 2026-02-20T18:57:48.597 INFO:teuthology.orchestra.run.trial166.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-20T18:57:48.597 INFO:teuthology.orchestra.run.trial166.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-20T18:57:48.597 INFO:teuthology.orchestra.run.trial166.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-20T18:57:48.597 INFO:teuthology.orchestra.run.trial166.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-20T18:57:48.597 INFO:teuthology.orchestra.run.trial166.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-20T18:57:48.597 INFO:teuthology.orchestra.run.trial166.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-20T18:57:48.597 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:48.597 INFO:teuthology.orchestra.run.trial166.stdout:Transaction Summary 2026-02-20T18:57:48.597 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:57:48.597 INFO:teuthology.orchestra.run.trial166.stdout:Install 7 Packages 2026-02-20T18:57:48.597 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:48.597 INFO:teuthology.orchestra.run.trial166.stdout:Total download size: 7.1 M 2026-02-20T18:57:48.597 INFO:teuthology.orchestra.run.trial166.stdout:Installed size: 33 M 2026-02-20T18:57:48.598 INFO:teuthology.orchestra.run.trial166.stdout:Downloading Packages: 2026-02-20T18:57:49.136 INFO:teuthology.orchestra.run.trial166.stdout:(1/7): ceph-mgr-cephadm-20.2.0-677.gf7870454.el 502 kB/s | 173 kB 00:00 2026-02-20T18:57:49.594 INFO:teuthology.orchestra.run.trial166.stdout:(2/7): python3-jinja2-2.11.3-8.el9.noarch.rpm 310 kB/s | 249 kB 00:00 2026-02-20T18:57:49.693 INFO:teuthology.orchestra.run.trial166.stdout:(3/7): python3-markupsafe-1.1.1-12.el9.x86_64.r 62 kB/s | 35 kB 00:00 2026-02-20T18:57:49.868 INFO:teuthology.orchestra.run.trial166.stdout:(4/7): python3-babel-2.9.1-2.el9.noarch.rpm 5.5 MB/s | 6.0 MB 00:01 2026-02-20T18:57:49.987 INFO:teuthology.orchestra.run.trial166.stdout:(5/7): python3-natsort-7.1.1-5.el9.noarch.rpm 196 kB/s | 58 kB 00:00 2026-02-20T18:57:50.126 INFO:teuthology.orchestra.run.trial166.stdout:(6/7): python3-asyncssh-2.13.2-5.el9.noarch.rpm 1.0 MB/s | 548 kB 00:00 2026-02-20T18:57:50.195 INFO:teuthology.orchestra.run.trial166.stdout:(7/7): python3-typing-extensions-4.15.0-1.el9.n 265 kB/s | 86 kB 00:00 2026-02-20T18:57:50.196 INFO:teuthology.orchestra.run.trial166.stdout:-------------------------------------------------------------------------------- 2026-02-20T18:57:50.196 INFO:teuthology.orchestra.run.trial166.stdout:Total 4.4 MB/s | 7.1 MB 00:01 2026-02-20T18:57:50.233 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction check 2026-02-20T18:57:50.240 INFO:teuthology.orchestra.run.trial166.stdout:Transaction check succeeded. 2026-02-20T18:57:50.240 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction test 2026-02-20T18:57:50.310 INFO:teuthology.orchestra.run.trial166.stdout:Transaction test succeeded. 2026-02-20T18:57:50.311 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction 2026-02-20T18:57:50.399 INFO:teuthology.orchestra.run.trial166.stdout: Preparing : 1/1 2026-02-20T18:57:50.448 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 1/7 2026-02-20T18:57:50.457 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/7 2026-02-20T18:57:50.463 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/7 2026-02-20T18:57:50.679 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-20T18:57:50.702 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 5/7 2026-02-20T18:57:50.726 INFO:teuthology.orchestra.run.trial166.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 6/7 2026-02-20T18:57:50.727 INFO:teuthology.orchestra.run.trial166.stdout: Installing : ceph-mgr-cephadm-2:20.2.0-677.gf7870454.el9.noarch 7/7 2026-02-20T18:57:50.838 INFO:teuthology.orchestra.run.trial166.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.2.0-677.gf7870454.el9.noarch 7/7 2026-02-20T18:57:50.838 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : ceph-mgr-cephadm-2:20.2.0-677.gf7870454.el9.noarch 1/7 2026-02-20T18:57:50.839 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/7 2026-02-20T18:57:50.839 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 3/7 2026-02-20T18:57:50.839 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-20T18:57:50.839 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 5/7 2026-02-20T18:57:50.839 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 6/7 2026-02-20T18:57:50.895 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 7/7 2026-02-20T18:57:50.895 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:50.896 INFO:teuthology.orchestra.run.trial166.stdout:Installed: 2026-02-20T18:57:50.896 INFO:teuthology.orchestra.run.trial166.stdout: ceph-mgr-cephadm-2:20.2.0-677.gf7870454.el9.noarch 2026-02-20T18:57:50.896 INFO:teuthology.orchestra.run.trial166.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-20T18:57:50.896 INFO:teuthology.orchestra.run.trial166.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-20T18:57:50.896 INFO:teuthology.orchestra.run.trial166.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-20T18:57:50.896 INFO:teuthology.orchestra.run.trial166.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-20T18:57:50.896 INFO:teuthology.orchestra.run.trial166.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-20T18:57:50.896 INFO:teuthology.orchestra.run.trial166.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-20T18:57:50.896 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:50.896 INFO:teuthology.orchestra.run.trial166.stdout:Complete! 2026-02-20T18:57:50.924 DEBUG:teuthology.orchestra.run.trial166:> sudo yum -y install ceph-fuse 2026-02-20T18:57:51.224 INFO:teuthology.orchestra.run.trial166.stdout:Last metadata expiration check: 0:00:48 ago on Fri 20 Feb 2026 06:57:03 PM UTC. 2026-02-20T18:57:51.307 INFO:teuthology.orchestra.run.trial166.stdout:Dependencies resolved. 2026-02-20T18:57:51.308 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:57:51.308 INFO:teuthology.orchestra.run.trial166.stdout: Package Architecture Version Repository Size 2026-02-20T18:57:51.308 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:57:51.309 INFO:teuthology.orchestra.run.trial166.stdout:Installing: 2026-02-20T18:57:51.309 INFO:teuthology.orchestra.run.trial166.stdout: ceph-fuse x86_64 2:20.2.0-677.gf7870454.el9 ceph 943 k 2026-02-20T18:57:51.309 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:51.309 INFO:teuthology.orchestra.run.trial166.stdout:Transaction Summary 2026-02-20T18:57:51.309 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:57:51.309 INFO:teuthology.orchestra.run.trial166.stdout:Install 1 Package 2026-02-20T18:57:51.309 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:51.309 INFO:teuthology.orchestra.run.trial166.stdout:Total download size: 943 k 2026-02-20T18:57:51.309 INFO:teuthology.orchestra.run.trial166.stdout:Installed size: 2.7 M 2026-02-20T18:57:51.309 INFO:teuthology.orchestra.run.trial166.stdout:Downloading Packages: 2026-02-20T18:57:51.802 INFO:teuthology.orchestra.run.trial166.stdout:ceph-fuse-20.2.0-677.gf7870454.el9.x86_64.rpm 1.9 MB/s | 943 kB 00:00 2026-02-20T18:57:51.802 INFO:teuthology.orchestra.run.trial166.stdout:-------------------------------------------------------------------------------- 2026-02-20T18:57:51.802 INFO:teuthology.orchestra.run.trial166.stdout:Total 1.9 MB/s | 943 kB 00:00 2026-02-20T18:57:51.803 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction check 2026-02-20T18:57:51.807 INFO:teuthology.orchestra.run.trial166.stdout:Transaction check succeeded. 2026-02-20T18:57:51.807 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction test 2026-02-20T18:57:51.840 INFO:teuthology.orchestra.run.trial166.stdout:Transaction test succeeded. 2026-02-20T18:57:51.841 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction 2026-02-20T18:57:51.929 INFO:teuthology.orchestra.run.trial166.stdout: Preparing : 1/1 2026-02-20T18:57:51.946 INFO:teuthology.orchestra.run.trial166.stdout: Installing : ceph-fuse-2:20.2.0-677.gf7870454.el9.x86_64 1/1 2026-02-20T18:57:52.173 INFO:teuthology.orchestra.run.trial166.stdout: Running scriptlet: ceph-fuse-2:20.2.0-677.gf7870454.el9.x86_64 1/1 2026-02-20T18:57:52.230 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : ceph-fuse-2:20.2.0-677.gf7870454.el9.x86_64 1/1 2026-02-20T18:57:52.230 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:52.230 INFO:teuthology.orchestra.run.trial166.stdout:Installed: 2026-02-20T18:57:52.230 INFO:teuthology.orchestra.run.trial166.stdout: ceph-fuse-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T18:57:52.230 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:52.230 INFO:teuthology.orchestra.run.trial166.stdout:Complete! 2026-02-20T18:57:52.258 DEBUG:teuthology.orchestra.run.trial166:> sudo yum -y install ceph-volume 2026-02-20T18:57:52.562 INFO:teuthology.orchestra.run.trial166.stdout:Last metadata expiration check: 0:00:49 ago on Fri 20 Feb 2026 06:57:03 PM UTC. 2026-02-20T18:57:52.646 INFO:teuthology.orchestra.run.trial166.stdout:Dependencies resolved. 2026-02-20T18:57:52.647 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:57:52.647 INFO:teuthology.orchestra.run.trial166.stdout: Package Arch Version Repository Size 2026-02-20T18:57:52.647 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:57:52.647 INFO:teuthology.orchestra.run.trial166.stdout:Installing: 2026-02-20T18:57:52.647 INFO:teuthology.orchestra.run.trial166.stdout: ceph-volume noarch 2:20.2.0-677.gf7870454.el9 ceph-noarch 297 k 2026-02-20T18:57:52.647 INFO:teuthology.orchestra.run.trial166.stdout:Installing dependencies: 2026-02-20T18:57:52.647 INFO:teuthology.orchestra.run.trial166.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-20T18:57:52.647 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:52.647 INFO:teuthology.orchestra.run.trial166.stdout:Transaction Summary 2026-02-20T18:57:52.647 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:57:52.647 INFO:teuthology.orchestra.run.trial166.stdout:Install 2 Packages 2026-02-20T18:57:52.647 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:52.647 INFO:teuthology.orchestra.run.trial166.stdout:Total download size: 648 k 2026-02-20T18:57:52.648 INFO:teuthology.orchestra.run.trial166.stdout:Installed size: 2.2 M 2026-02-20T18:57:52.648 INFO:teuthology.orchestra.run.trial166.stdout:Downloading Packages: 2026-02-20T18:57:53.174 INFO:teuthology.orchestra.run.trial166.stdout:(1/2): cryptsetup-2.8.1-3.el9.x86_64.rpm 1.5 MB/s | 351 kB 00:00 2026-02-20T18:57:53.516 INFO:teuthology.orchestra.run.trial166.stdout:(2/2): ceph-volume-20.2.0-677.gf7870454.el9.noa 527 kB/s | 297 kB 00:00 2026-02-20T18:57:53.517 INFO:teuthology.orchestra.run.trial166.stdout:-------------------------------------------------------------------------------- 2026-02-20T18:57:53.517 INFO:teuthology.orchestra.run.trial166.stdout:Total 746 kB/s | 648 kB 00:00 2026-02-20T18:57:53.527 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction check 2026-02-20T18:57:53.533 INFO:teuthology.orchestra.run.trial166.stdout:Transaction check succeeded. 2026-02-20T18:57:53.533 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction test 2026-02-20T18:57:53.576 INFO:teuthology.orchestra.run.trial166.stdout:Transaction test succeeded. 2026-02-20T18:57:53.576 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction 2026-02-20T18:57:53.656 INFO:teuthology.orchestra.run.trial166.stdout: Preparing : 1/1 2026-02-20T18:57:53.719 INFO:teuthology.orchestra.run.trial166.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 1/2 2026-02-20T18:57:53.721 INFO:teuthology.orchestra.run.trial166.stdout: Installing : ceph-volume-2:20.2.0-677.gf7870454.el9.noarch 2/2 2026-02-20T18:57:53.735 INFO:teuthology.orchestra.run.trial166.stdout: Running scriptlet: ceph-volume-2:20.2.0-677.gf7870454.el9.noarch 2/2 2026-02-20T18:57:53.735 INFO:teuthology.orchestra.run.trial166.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T18:57:53.735 INFO:teuthology.orchestra.run.trial166.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-20T18:57:53.735 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:53.949 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : ceph-volume-2:20.2.0-677.gf7870454.el9.noarch 1/2 2026-02-20T18:57:54.006 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 2/2 2026-02-20T18:57:54.007 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:54.007 INFO:teuthology.orchestra.run.trial166.stdout:Installed: 2026-02-20T18:57:54.007 INFO:teuthology.orchestra.run.trial166.stdout: ceph-volume-2:20.2.0-677.gf7870454.el9.noarch cryptsetup-2.8.1-3.el9.x86_64 2026-02-20T18:57:54.007 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:54.007 INFO:teuthology.orchestra.run.trial166.stdout:Complete! 2026-02-20T18:57:54.035 DEBUG:teuthology.orchestra.run.trial166:> sudo yum -y install librados-devel 2026-02-20T18:57:54.347 INFO:teuthology.orchestra.run.trial166.stdout:Last metadata expiration check: 0:00:51 ago on Fri 20 Feb 2026 06:57:03 PM UTC. 2026-02-20T18:57:54.430 INFO:teuthology.orchestra.run.trial166.stdout:Dependencies resolved. 2026-02-20T18:57:54.430 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:57:54.430 INFO:teuthology.orchestra.run.trial166.stdout: Package Arch Version Repo Size 2026-02-20T18:57:54.430 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:57:54.430 INFO:teuthology.orchestra.run.trial166.stdout:Installing: 2026-02-20T18:57:54.430 INFO:teuthology.orchestra.run.trial166.stdout: librados-devel x86_64 2:20.2.0-677.gf7870454.el9 ceph 126 k 2026-02-20T18:57:54.430 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:54.430 INFO:teuthology.orchestra.run.trial166.stdout:Transaction Summary 2026-02-20T18:57:54.430 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:57:54.430 INFO:teuthology.orchestra.run.trial166.stdout:Install 1 Package 2026-02-20T18:57:54.430 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:54.430 INFO:teuthology.orchestra.run.trial166.stdout:Total download size: 126 k 2026-02-20T18:57:54.430 INFO:teuthology.orchestra.run.trial166.stdout:Installed size: 449 k 2026-02-20T18:57:54.430 INFO:teuthology.orchestra.run.trial166.stdout:Downloading Packages: 2026-02-20T18:57:54.930 INFO:teuthology.orchestra.run.trial166.stdout:librados-devel-20.2.0-677.gf7870454.el9.x86_64. 252 kB/s | 126 kB 00:00 2026-02-20T18:57:54.930 INFO:teuthology.orchestra.run.trial166.stdout:-------------------------------------------------------------------------------- 2026-02-20T18:57:54.930 INFO:teuthology.orchestra.run.trial166.stdout:Total 252 kB/s | 126 kB 00:00 2026-02-20T18:57:54.930 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction check 2026-02-20T18:57:54.933 INFO:teuthology.orchestra.run.trial166.stdout:Transaction check succeeded. 2026-02-20T18:57:54.933 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction test 2026-02-20T18:57:54.963 INFO:teuthology.orchestra.run.trial166.stdout:Transaction test succeeded. 2026-02-20T18:57:54.964 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction 2026-02-20T18:57:55.017 INFO:teuthology.orchestra.run.trial166.stdout: Preparing : 1/1 2026-02-20T18:57:55.033 INFO:teuthology.orchestra.run.trial166.stdout: Installing : librados-devel-2:20.2.0-677.gf7870454.el9.x86_64 1/1 2026-02-20T18:57:55.120 INFO:teuthology.orchestra.run.trial166.stdout: Running scriptlet: librados-devel-2:20.2.0-677.gf7870454.el9.x86_64 1/1 2026-02-20T18:57:55.177 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : librados-devel-2:20.2.0-677.gf7870454.el9.x86_64 1/1 2026-02-20T18:57:55.177 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:55.177 INFO:teuthology.orchestra.run.trial166.stdout:Installed: 2026-02-20T18:57:55.177 INFO:teuthology.orchestra.run.trial166.stdout: librados-devel-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T18:57:55.177 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:55.177 INFO:teuthology.orchestra.run.trial166.stdout:Complete! 2026-02-20T18:57:55.204 DEBUG:teuthology.orchestra.run.trial166:> sudo yum -y install libcephfs2 2026-02-20T18:57:55.518 INFO:teuthology.orchestra.run.trial166.stdout:Last metadata expiration check: 0:00:52 ago on Fri 20 Feb 2026 06:57:03 PM UTC. 2026-02-20T18:57:55.585 INFO:teuthology.orchestra.run.trial166.stdout:Package libcephfs2-2:20.2.0-677.gf7870454.el9.x86_64 is already installed. 2026-02-20T18:57:55.603 INFO:teuthology.orchestra.run.trial166.stdout:Dependencies resolved. 2026-02-20T18:57:55.604 INFO:teuthology.orchestra.run.trial166.stdout:Nothing to do. 2026-02-20T18:57:55.604 INFO:teuthology.orchestra.run.trial166.stdout:Complete! 2026-02-20T18:57:55.625 DEBUG:teuthology.orchestra.run.trial166:> sudo yum -y install libcephfs-devel 2026-02-20T18:57:55.934 INFO:teuthology.orchestra.run.trial166.stdout:Last metadata expiration check: 0:00:52 ago on Fri 20 Feb 2026 06:57:03 PM UTC. 2026-02-20T18:57:56.018 INFO:teuthology.orchestra.run.trial166.stdout:Dependencies resolved. 2026-02-20T18:57:56.018 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:57:56.018 INFO:teuthology.orchestra.run.trial166.stdout: Package Arch Version Repo Size 2026-02-20T18:57:56.018 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:57:56.018 INFO:teuthology.orchestra.run.trial166.stdout:Installing: 2026-02-20T18:57:56.018 INFO:teuthology.orchestra.run.trial166.stdout: libcephfs-devel x86_64 2:20.2.0-677.gf7870454.el9 ceph 34 k 2026-02-20T18:57:56.019 INFO:teuthology.orchestra.run.trial166.stdout:Installing dependencies: 2026-02-20T18:57:56.019 INFO:teuthology.orchestra.run.trial166.stdout: libcephfs-proxy2 x86_64 2:20.2.0-677.gf7870454.el9 ceph 24 k 2026-02-20T18:57:56.019 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:56.019 INFO:teuthology.orchestra.run.trial166.stdout:Transaction Summary 2026-02-20T18:57:56.019 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:57:56.019 INFO:teuthology.orchestra.run.trial166.stdout:Install 2 Packages 2026-02-20T18:57:56.019 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:56.019 INFO:teuthology.orchestra.run.trial166.stdout:Total download size: 58 k 2026-02-20T18:57:56.019 INFO:teuthology.orchestra.run.trial166.stdout:Installed size: 207 k 2026-02-20T18:57:56.019 INFO:teuthology.orchestra.run.trial166.stdout:Downloading Packages: 2026-02-20T18:57:56.281 INFO:teuthology.orchestra.run.trial166.stdout:(1/2): libcephfs-devel-20.2.0-677.gf7870454.el9 131 kB/s | 34 kB 00:00 2026-02-20T18:57:56.284 INFO:teuthology.orchestra.run.trial166.stdout:(2/2): libcephfs-proxy2-20.2.0-677.gf7870454.el 91 kB/s | 24 kB 00:00 2026-02-20T18:57:56.284 INFO:teuthology.orchestra.run.trial166.stdout:-------------------------------------------------------------------------------- 2026-02-20T18:57:56.285 INFO:teuthology.orchestra.run.trial166.stdout:Total 219 kB/s | 58 kB 00:00 2026-02-20T18:57:56.285 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction check 2026-02-20T18:57:56.288 INFO:teuthology.orchestra.run.trial166.stdout:Transaction check succeeded. 2026-02-20T18:57:56.288 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction test 2026-02-20T18:57:56.319 INFO:teuthology.orchestra.run.trial166.stdout:Transaction test succeeded. 2026-02-20T18:57:56.319 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction 2026-02-20T18:57:56.367 INFO:teuthology.orchestra.run.trial166.stdout: Preparing : 1/1 2026-02-20T18:57:56.368 INFO:teuthology.orchestra.run.trial166.stdout: Installing : libcephfs-proxy2-2:20.2.0-677.gf7870454.el9.x86_64 1/2 2026-02-20T18:57:56.382 INFO:teuthology.orchestra.run.trial166.stdout: Running scriptlet: libcephfs-proxy2-2:20.2.0-677.gf7870454.el9.x86_64 1/2 2026-02-20T18:57:56.398 INFO:teuthology.orchestra.run.trial166.stdout: Installing : libcephfs-devel-2:20.2.0-677.gf7870454.el9.x86_64 2/2 2026-02-20T18:57:56.452 INFO:teuthology.orchestra.run.trial166.stdout: Running scriptlet: libcephfs-devel-2:20.2.0-677.gf7870454.el9.x86_64 2/2 2026-02-20T18:57:56.452 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : libcephfs-devel-2:20.2.0-677.gf7870454.el9.x86_64 1/2 2026-02-20T18:57:56.508 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : libcephfs-proxy2-2:20.2.0-677.gf7870454.el9.x86_64 2/2 2026-02-20T18:57:56.508 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:56.508 INFO:teuthology.orchestra.run.trial166.stdout:Installed: 2026-02-20T18:57:56.508 INFO:teuthology.orchestra.run.trial166.stdout: libcephfs-devel-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T18:57:56.508 INFO:teuthology.orchestra.run.trial166.stdout: libcephfs-proxy2-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T18:57:56.508 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:56.508 INFO:teuthology.orchestra.run.trial166.stdout:Complete! 2026-02-20T18:57:56.535 DEBUG:teuthology.orchestra.run.trial166:> sudo yum -y install librados2 2026-02-20T18:57:56.842 INFO:teuthology.orchestra.run.trial166.stdout:Last metadata expiration check: 0:00:53 ago on Fri 20 Feb 2026 06:57:03 PM UTC. 2026-02-20T18:57:56.908 INFO:teuthology.orchestra.run.trial166.stdout:Package librados2-2:20.2.0-677.gf7870454.el9.x86_64 is already installed. 2026-02-20T18:57:56.927 INFO:teuthology.orchestra.run.trial166.stdout:Dependencies resolved. 2026-02-20T18:57:56.927 INFO:teuthology.orchestra.run.trial166.stdout:Nothing to do. 2026-02-20T18:57:56.927 INFO:teuthology.orchestra.run.trial166.stdout:Complete! 2026-02-20T18:57:56.948 DEBUG:teuthology.orchestra.run.trial166:> sudo yum -y install librbd1 2026-02-20T18:57:57.258 INFO:teuthology.orchestra.run.trial166.stdout:Last metadata expiration check: 0:00:54 ago on Fri 20 Feb 2026 06:57:03 PM UTC. 2026-02-20T18:57:57.325 INFO:teuthology.orchestra.run.trial166.stdout:Package librbd1-2:20.2.0-677.gf7870454.el9.x86_64 is already installed. 2026-02-20T18:57:57.343 INFO:teuthology.orchestra.run.trial166.stdout:Dependencies resolved. 2026-02-20T18:57:57.344 INFO:teuthology.orchestra.run.trial166.stdout:Nothing to do. 2026-02-20T18:57:57.344 INFO:teuthology.orchestra.run.trial166.stdout:Complete! 2026-02-20T18:57:57.365 DEBUG:teuthology.orchestra.run.trial166:> sudo yum -y install python3-rados 2026-02-20T18:57:57.675 INFO:teuthology.orchestra.run.trial166.stdout:Last metadata expiration check: 0:00:54 ago on Fri 20 Feb 2026 06:57:03 PM UTC. 2026-02-20T18:57:57.741 INFO:teuthology.orchestra.run.trial166.stdout:Package python3-rados-2:20.2.0-677.gf7870454.el9.x86_64 is already installed. 2026-02-20T18:57:57.759 INFO:teuthology.orchestra.run.trial166.stdout:Dependencies resolved. 2026-02-20T18:57:57.760 INFO:teuthology.orchestra.run.trial166.stdout:Nothing to do. 2026-02-20T18:57:57.760 INFO:teuthology.orchestra.run.trial166.stdout:Complete! 2026-02-20T18:57:57.782 DEBUG:teuthology.orchestra.run.trial166:> sudo yum -y install python3-rgw 2026-02-20T18:57:58.087 INFO:teuthology.orchestra.run.trial166.stdout:Last metadata expiration check: 0:00:55 ago on Fri 20 Feb 2026 06:57:03 PM UTC. 2026-02-20T18:57:58.153 INFO:teuthology.orchestra.run.trial166.stdout:Package python3-rgw-2:20.2.0-677.gf7870454.el9.x86_64 is already installed. 2026-02-20T18:57:58.171 INFO:teuthology.orchestra.run.trial166.stdout:Dependencies resolved. 2026-02-20T18:57:58.171 INFO:teuthology.orchestra.run.trial166.stdout:Nothing to do. 2026-02-20T18:57:58.172 INFO:teuthology.orchestra.run.trial166.stdout:Complete! 2026-02-20T18:57:58.193 DEBUG:teuthology.orchestra.run.trial166:> sudo yum -y install python3-cephfs 2026-02-20T18:57:58.500 INFO:teuthology.orchestra.run.trial166.stdout:Last metadata expiration check: 0:00:55 ago on Fri 20 Feb 2026 06:57:03 PM UTC. 2026-02-20T18:57:58.566 INFO:teuthology.orchestra.run.trial166.stdout:Package python3-cephfs-2:20.2.0-677.gf7870454.el9.x86_64 is already installed. 2026-02-20T18:57:58.584 INFO:teuthology.orchestra.run.trial166.stdout:Dependencies resolved. 2026-02-20T18:57:58.584 INFO:teuthology.orchestra.run.trial166.stdout:Nothing to do. 2026-02-20T18:57:58.584 INFO:teuthology.orchestra.run.trial166.stdout:Complete! 2026-02-20T18:57:58.605 DEBUG:teuthology.orchestra.run.trial166:> sudo yum -y install python3-rbd 2026-02-20T18:57:58.910 INFO:teuthology.orchestra.run.trial166.stdout:Last metadata expiration check: 0:00:55 ago on Fri 20 Feb 2026 06:57:03 PM UTC. 2026-02-20T18:57:58.976 INFO:teuthology.orchestra.run.trial166.stdout:Package python3-rbd-2:20.2.0-677.gf7870454.el9.x86_64 is already installed. 2026-02-20T18:57:58.994 INFO:teuthology.orchestra.run.trial166.stdout:Dependencies resolved. 2026-02-20T18:57:58.994 INFO:teuthology.orchestra.run.trial166.stdout:Nothing to do. 2026-02-20T18:57:58.994 INFO:teuthology.orchestra.run.trial166.stdout:Complete! 2026-02-20T18:57:59.015 DEBUG:teuthology.orchestra.run.trial166:> sudo yum -y install rbd-fuse 2026-02-20T18:57:59.324 INFO:teuthology.orchestra.run.trial166.stdout:Last metadata expiration check: 0:00:56 ago on Fri 20 Feb 2026 06:57:03 PM UTC. 2026-02-20T18:57:59.409 INFO:teuthology.orchestra.run.trial166.stdout:Dependencies resolved. 2026-02-20T18:57:59.409 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:57:59.409 INFO:teuthology.orchestra.run.trial166.stdout: Package Architecture Version Repository Size 2026-02-20T18:57:59.409 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:57:59.409 INFO:teuthology.orchestra.run.trial166.stdout:Installing: 2026-02-20T18:57:59.409 INFO:teuthology.orchestra.run.trial166.stdout: rbd-fuse x86_64 2:20.2.0-677.gf7870454.el9 ceph 91 k 2026-02-20T18:57:59.409 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:59.410 INFO:teuthology.orchestra.run.trial166.stdout:Transaction Summary 2026-02-20T18:57:59.410 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:57:59.410 INFO:teuthology.orchestra.run.trial166.stdout:Install 1 Package 2026-02-20T18:57:59.410 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:59.410 INFO:teuthology.orchestra.run.trial166.stdout:Total download size: 91 k 2026-02-20T18:57:59.410 INFO:teuthology.orchestra.run.trial166.stdout:Installed size: 238 k 2026-02-20T18:57:59.410 INFO:teuthology.orchestra.run.trial166.stdout:Downloading Packages: 2026-02-20T18:57:59.756 INFO:teuthology.orchestra.run.trial166.stdout:rbd-fuse-20.2.0-677.gf7870454.el9.x86_64.rpm 263 kB/s | 91 kB 00:00 2026-02-20T18:57:59.757 INFO:teuthology.orchestra.run.trial166.stdout:-------------------------------------------------------------------------------- 2026-02-20T18:57:59.757 INFO:teuthology.orchestra.run.trial166.stdout:Total 262 kB/s | 91 kB 00:00 2026-02-20T18:57:59.757 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction check 2026-02-20T18:57:59.761 INFO:teuthology.orchestra.run.trial166.stdout:Transaction check succeeded. 2026-02-20T18:57:59.761 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction test 2026-02-20T18:57:59.792 INFO:teuthology.orchestra.run.trial166.stdout:Transaction test succeeded. 2026-02-20T18:57:59.792 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction 2026-02-20T18:57:59.844 INFO:teuthology.orchestra.run.trial166.stdout: Preparing : 1/1 2026-02-20T18:57:59.862 INFO:teuthology.orchestra.run.trial166.stdout: Installing : rbd-fuse-2:20.2.0-677.gf7870454.el9.x86_64 1/1 2026-02-20T18:57:59.938 INFO:teuthology.orchestra.run.trial166.stdout: Running scriptlet: rbd-fuse-2:20.2.0-677.gf7870454.el9.x86_64 1/1 2026-02-20T18:57:59.995 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : rbd-fuse-2:20.2.0-677.gf7870454.el9.x86_64 1/1 2026-02-20T18:57:59.995 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:59.995 INFO:teuthology.orchestra.run.trial166.stdout:Installed: 2026-02-20T18:57:59.995 INFO:teuthology.orchestra.run.trial166.stdout: rbd-fuse-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T18:57:59.995 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:57:59.995 INFO:teuthology.orchestra.run.trial166.stdout:Complete! 2026-02-20T18:58:00.024 DEBUG:teuthology.orchestra.run.trial166:> sudo yum -y install rbd-mirror 2026-02-20T18:58:00.329 INFO:teuthology.orchestra.run.trial166.stdout:Last metadata expiration check: 0:00:57 ago on Fri 20 Feb 2026 06:57:03 PM UTC. 2026-02-20T18:58:00.414 INFO:teuthology.orchestra.run.trial166.stdout:Dependencies resolved. 2026-02-20T18:58:00.415 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:58:00.415 INFO:teuthology.orchestra.run.trial166.stdout: Package Arch Version Repo Size 2026-02-20T18:58:00.415 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:58:00.415 INFO:teuthology.orchestra.run.trial166.stdout:Installing: 2026-02-20T18:58:00.415 INFO:teuthology.orchestra.run.trial166.stdout: rbd-mirror x86_64 2:20.2.0-677.gf7870454.el9 ceph 2.9 M 2026-02-20T18:58:00.415 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:58:00.415 INFO:teuthology.orchestra.run.trial166.stdout:Transaction Summary 2026-02-20T18:58:00.415 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:58:00.415 INFO:teuthology.orchestra.run.trial166.stdout:Install 1 Package 2026-02-20T18:58:00.415 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:58:00.415 INFO:teuthology.orchestra.run.trial166.stdout:Total download size: 2.9 M 2026-02-20T18:58:00.415 INFO:teuthology.orchestra.run.trial166.stdout:Installed size: 11 M 2026-02-20T18:58:00.415 INFO:teuthology.orchestra.run.trial166.stdout:Downloading Packages: 2026-02-20T18:58:01.739 INFO:teuthology.orchestra.run.trial166.stdout:rbd-mirror-20.2.0-677.gf7870454.el9.x86_64.rpm 2.2 MB/s | 2.9 MB 00:01 2026-02-20T18:58:01.740 INFO:teuthology.orchestra.run.trial166.stdout:-------------------------------------------------------------------------------- 2026-02-20T18:58:01.740 INFO:teuthology.orchestra.run.trial166.stdout:Total 2.2 MB/s | 2.9 MB 00:01 2026-02-20T18:58:01.740 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction check 2026-02-20T18:58:01.745 INFO:teuthology.orchestra.run.trial166.stdout:Transaction check succeeded. 2026-02-20T18:58:01.745 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction test 2026-02-20T18:58:01.784 INFO:teuthology.orchestra.run.trial166.stdout:Transaction test succeeded. 2026-02-20T18:58:01.784 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction 2026-02-20T18:58:01.962 INFO:teuthology.orchestra.run.trial166.stdout: Preparing : 1/1 2026-02-20T18:58:01.964 INFO:teuthology.orchestra.run.trial166.stdout: Installing : rbd-mirror-2:20.2.0-677.gf7870454.el9.x86_64 1/1 2026-02-20T18:58:01.988 INFO:teuthology.orchestra.run.trial166.stdout: Running scriptlet: rbd-mirror-2:20.2.0-677.gf7870454.el9.x86_64 1/1 2026-02-20T18:58:01.988 INFO:teuthology.orchestra.run.trial166.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T18:58:01.988 INFO:teuthology.orchestra.run.trial166.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-20T18:58:01.988 INFO:teuthology.orchestra.run.trial166.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T18:58:01.988 INFO:teuthology.orchestra.run.trial166.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T18:58:01.988 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:58:02.286 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : rbd-mirror-2:20.2.0-677.gf7870454.el9.x86_64 1/1 2026-02-20T18:58:02.286 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:58:02.286 INFO:teuthology.orchestra.run.trial166.stdout:Installed: 2026-02-20T18:58:02.286 INFO:teuthology.orchestra.run.trial166.stdout: rbd-mirror-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T18:58:02.286 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:58:02.286 INFO:teuthology.orchestra.run.trial166.stdout:Complete! 2026-02-20T18:58:02.313 DEBUG:teuthology.orchestra.run.trial166:> sudo yum -y install rbd-nbd 2026-02-20T18:58:02.621 INFO:teuthology.orchestra.run.trial166.stdout:Last metadata expiration check: 0:00:59 ago on Fri 20 Feb 2026 06:57:03 PM UTC. 2026-02-20T18:58:02.704 INFO:teuthology.orchestra.run.trial166.stdout:Dependencies resolved. 2026-02-20T18:58:02.704 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:58:02.704 INFO:teuthology.orchestra.run.trial166.stdout: Package Architecture Version Repository Size 2026-02-20T18:58:02.704 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:58:02.704 INFO:teuthology.orchestra.run.trial166.stdout:Installing: 2026-02-20T18:58:02.704 INFO:teuthology.orchestra.run.trial166.stdout: rbd-nbd x86_64 2:20.2.0-677.gf7870454.el9 ceph 180 k 2026-02-20T18:58:02.704 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:58:02.704 INFO:teuthology.orchestra.run.trial166.stdout:Transaction Summary 2026-02-20T18:58:02.704 INFO:teuthology.orchestra.run.trial166.stdout:================================================================================ 2026-02-20T18:58:02.704 INFO:teuthology.orchestra.run.trial166.stdout:Install 1 Package 2026-02-20T18:58:02.704 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:58:02.705 INFO:teuthology.orchestra.run.trial166.stdout:Total download size: 180 k 2026-02-20T18:58:02.705 INFO:teuthology.orchestra.run.trial166.stdout:Installed size: 498 k 2026-02-20T18:58:02.705 INFO:teuthology.orchestra.run.trial166.stdout:Downloading Packages: 2026-02-20T18:58:03.120 INFO:teuthology.orchestra.run.trial166.stdout:rbd-nbd-20.2.0-677.gf7870454.el9.x86_64.rpm 433 kB/s | 180 kB 00:00 2026-02-20T18:58:03.121 INFO:teuthology.orchestra.run.trial166.stdout:-------------------------------------------------------------------------------- 2026-02-20T18:58:03.121 INFO:teuthology.orchestra.run.trial166.stdout:Total 433 kB/s | 180 kB 00:00 2026-02-20T18:58:03.121 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction check 2026-02-20T18:58:03.125 INFO:teuthology.orchestra.run.trial166.stdout:Transaction check succeeded. 2026-02-20T18:58:03.125 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction test 2026-02-20T18:58:03.155 INFO:teuthology.orchestra.run.trial166.stdout:Transaction test succeeded. 2026-02-20T18:58:03.156 INFO:teuthology.orchestra.run.trial166.stdout:Running transaction 2026-02-20T18:58:03.210 INFO:teuthology.orchestra.run.trial166.stdout: Preparing : 1/1 2026-02-20T18:58:03.227 INFO:teuthology.orchestra.run.trial166.stdout: Installing : rbd-nbd-2:20.2.0-677.gf7870454.el9.x86_64 1/1 2026-02-20T18:58:03.315 INFO:teuthology.orchestra.run.trial166.stdout: Running scriptlet: rbd-nbd-2:20.2.0-677.gf7870454.el9.x86_64 1/1 2026-02-20T18:58:03.373 INFO:teuthology.orchestra.run.trial166.stdout: Verifying : rbd-nbd-2:20.2.0-677.gf7870454.el9.x86_64 1/1 2026-02-20T18:58:03.373 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:58:03.373 INFO:teuthology.orchestra.run.trial166.stdout:Installed: 2026-02-20T18:58:03.373 INFO:teuthology.orchestra.run.trial166.stdout: rbd-nbd-2:20.2.0-677.gf7870454.el9.x86_64 2026-02-20T18:58:03.373 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:58:03.373 INFO:teuthology.orchestra.run.trial166.stdout:Complete! 2026-02-20T18:58:03.406 DEBUG:teuthology.parallel:result is None 2026-02-20T18:58:03.407 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f7870454149f22574086dd2ff55d050585136531 2026-02-20T18:58:03.578 DEBUG:teuthology.orchestra.run.trial166:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-20T18:58:03.596 INFO:teuthology.orchestra.run.trial166.stdout:20.2.0-677.gf7870454.el9 2026-02-20T18:58:03.597 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-677.gf7870454.el9 2026-02-20T18:58:03.597 INFO:teuthology.task.install:The correct ceph version 20.2.0-677.gf7870454 is installed. 2026-02-20T18:58:03.599 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-20T18:58:03.599 DEBUG:teuthology.orchestra.run.trial166:> set -ex 2026-02-20T18:58:03.599 DEBUG:teuthology.orchestra.run.trial166:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-20T18:58:03.662 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-20T18:58:03.663 DEBUG:teuthology.orchestra.run.trial166:> set -ex 2026-02-20T18:58:03.663 DEBUG:teuthology.orchestra.run.trial166:> sudo dd of=/usr/bin/daemon-helper 2026-02-20T18:58:03.726 DEBUG:teuthology.orchestra.run.trial166:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-20T18:58:03.790 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-20T18:58:03.791 DEBUG:teuthology.orchestra.run.trial166:> set -ex 2026-02-20T18:58:03.791 DEBUG:teuthology.orchestra.run.trial166:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-20T18:58:03.854 DEBUG:teuthology.orchestra.run.trial166:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-20T18:58:03.919 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-20T18:58:03.920 DEBUG:teuthology.orchestra.run.trial166:> set -ex 2026-02-20T18:58:03.920 DEBUG:teuthology.orchestra.run.trial166:> sudo dd of=/usr/bin/stdin-killer 2026-02-20T18:58:03.984 DEBUG:teuthology.orchestra.run.trial166:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-20T18:58:04.049 INFO:teuthology.run_tasks:Running task ceph... 2026-02-20T18:58:04.162 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-20T18:58:04.162 DEBUG:teuthology.orchestra.run.trial166:> sudo chmod 777 /var/log/ceph 2026-02-20T18:58:04.186 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-20T18:58:04.186 DEBUG:teuthology.orchestra.run.trial166:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-20T18:58:04.250 INFO:tasks.ceph:Creating extra log directories... 2026-02-20T18:58:04.250 DEBUG:teuthology.orchestra.run.trial166:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-20T18:58:04.323 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-20T18:58:04.323 INFO:tasks.ceph:config {'conf': {'osd': {'osd max object name len': 400, 'osd max object namespace len': 64, 'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'global': {'mon election default strategy': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['but it is still running', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_APP_NOT_ENABLED\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-20T18:58:04.324 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-20_16:06:38-rados-wip-pdonnell-testing-20260219.182737-tentacle-distro-default-trial/61096', 'branch': 'wip-pdonnell-testing-20260219.182737-tentacle', 'description': 'rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{centos_latest}}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'flavor': 'default', 'job_id': '61096', 'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'yuriw-2026-02-20_16:06:38-rados-wip-pdonnell-testing-20260219.182737-tentacle-distro-default-trial', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20260219.182737-tentacle'}, 'ceph': {'conf': {'global': {'mon election default strategy': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'f7870454149f22574086dd2ff55d050585136531'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'f7870454149f22574086dd2ff55d050585136531'}}, 'workunit': {'branch': 'wip-pdonnell-testing-20260219.182737-tentacle', 'sha1': 'f7870454149f22574086dd2ff55d050585136531'}}, 'owner': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'priority': 69, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'osd.8', 'osd.9', 'client.0']], 'seed': 8419, 'sha1': 'f7870454149f22574086dd2ff55d050585136531', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-pdonnell-testing-20260219.182737-tentacle', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_f7870454149f22574086dd2ff55d050585136531/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'f7870454149f22574086dd2ff55d050585136531', 'targets': {'trial166.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMs2dKewtPexVxJSWC4lJlDqkcgD5/0nxuRiJhTQmgQ1Ti9b0znZogSALLH3RRVknB52kjPVAFso1SaFrbYnH7w='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'osd': {'osd max object name len': 400, 'osd max object namespace len': 64, 'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'global': {'mon election default strategy': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}}, 'log-ignorelist': ['but it is still running', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_APP_NOT_ENABLED\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'pre-mgr-commands': ['sudo ceph config set mgr mgr_pool false --force'], 'flavor': 'default', 'sha1': 'f7870454149f22574086dd2ff55d050585136531', 'cluster': 'ceph'}}, {'workunit': {'clients': {'all': ['rados/test_health_warnings.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-20_16:06:38', 'tube': 'trial', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.1540699'} 2026-02-20T18:58:04.324 DEBUG:teuthology.orchestra.run.trial166:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-20T18:58:04.369 DEBUG:teuthology.orchestra.run.trial166:> sudo install -d -m0777 -- /var/run/ceph 2026-02-20T18:58:04.435 DEBUG:teuthology.orchestra.run.trial166:> set -ex 2026-02-20T18:58:04.435 DEBUG:teuthology.orchestra.run.trial166:> dd if=/scratch_devs of=/dev/stdout 2026-02-20T18:58:04.491 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-20T18:58:04.492 DEBUG:teuthology.orchestra.run.trial166:> stat /dev/vg_nvme/lv_1 2026-02-20T18:58:04.547 INFO:teuthology.orchestra.run.trial166.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-20T18:58:04.547 INFO:teuthology.orchestra.run.trial166.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T18:58:04.547 INFO:teuthology.orchestra.run.trial166.stdout:Device: 6h/6d Inode: 907 Links: 1 2026-02-20T18:58:04.547 INFO:teuthology.orchestra.run.trial166.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T18:58:04.547 INFO:teuthology.orchestra.run.trial166.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T18:58:04.547 INFO:teuthology.orchestra.run.trial166.stdout:Access: 2026-02-20 18:58:02.137492954 +0000 2026-02-20T18:58:04.547 INFO:teuthology.orchestra.run.trial166.stdout:Modify: 2026-02-20 18:56:37.364050210 +0000 2026-02-20T18:58:04.547 INFO:teuthology.orchestra.run.trial166.stdout:Change: 2026-02-20 18:56:37.364050210 +0000 2026-02-20T18:58:04.547 INFO:teuthology.orchestra.run.trial166.stdout: Birth: 2026-02-20 18:56:37.364050210 +0000 2026-02-20T18:58:04.547 DEBUG:teuthology.orchestra.run.trial166:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-20T18:58:04.609 INFO:teuthology.orchestra.run.trial166.stderr:1+0 records in 2026-02-20T18:58:04.610 INFO:teuthology.orchestra.run.trial166.stderr:1+0 records out 2026-02-20T18:58:04.610 INFO:teuthology.orchestra.run.trial166.stderr:512 bytes copied, 0.000153776 s, 3.3 MB/s 2026-02-20T18:58:04.611 DEBUG:teuthology.orchestra.run.trial166:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-20T18:58:04.668 DEBUG:teuthology.orchestra.run.trial166:> stat /dev/vg_nvme/lv_2 2026-02-20T18:58:04.727 INFO:teuthology.orchestra.run.trial166.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-20T18:58:04.727 INFO:teuthology.orchestra.run.trial166.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T18:58:04.727 INFO:teuthology.orchestra.run.trial166.stdout:Device: 6h/6d Inode: 937 Links: 1 2026-02-20T18:58:04.727 INFO:teuthology.orchestra.run.trial166.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T18:58:04.727 INFO:teuthology.orchestra.run.trial166.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T18:58:04.727 INFO:teuthology.orchestra.run.trial166.stdout:Access: 2026-02-20 18:58:02.138492943 +0000 2026-02-20T18:58:04.727 INFO:teuthology.orchestra.run.trial166.stdout:Modify: 2026-02-20 18:56:37.585049313 +0000 2026-02-20T18:58:04.727 INFO:teuthology.orchestra.run.trial166.stdout:Change: 2026-02-20 18:56:37.585049313 +0000 2026-02-20T18:58:04.727 INFO:teuthology.orchestra.run.trial166.stdout: Birth: 2026-02-20 18:56:37.585049313 +0000 2026-02-20T18:58:04.727 DEBUG:teuthology.orchestra.run.trial166:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-20T18:58:04.791 INFO:teuthology.orchestra.run.trial166.stderr:1+0 records in 2026-02-20T18:58:04.792 INFO:teuthology.orchestra.run.trial166.stderr:1+0 records out 2026-02-20T18:58:04.792 INFO:teuthology.orchestra.run.trial166.stderr:512 bytes copied, 0.000135271 s, 3.8 MB/s 2026-02-20T18:58:04.792 DEBUG:teuthology.orchestra.run.trial166:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-20T18:58:04.848 DEBUG:teuthology.orchestra.run.trial166:> stat /dev/vg_nvme/lv_3 2026-02-20T18:58:04.904 INFO:teuthology.orchestra.run.trial166.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-20T18:58:04.904 INFO:teuthology.orchestra.run.trial166.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T18:58:04.904 INFO:teuthology.orchestra.run.trial166.stdout:Device: 6h/6d Inode: 966 Links: 1 2026-02-20T18:58:04.904 INFO:teuthology.orchestra.run.trial166.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T18:58:04.905 INFO:teuthology.orchestra.run.trial166.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T18:58:04.905 INFO:teuthology.orchestra.run.trial166.stdout:Access: 2026-02-20 18:58:02.138492943 +0000 2026-02-20T18:58:04.905 INFO:teuthology.orchestra.run.trial166.stdout:Modify: 2026-02-20 18:56:37.821048354 +0000 2026-02-20T18:58:04.905 INFO:teuthology.orchestra.run.trial166.stdout:Change: 2026-02-20 18:56:37.821048354 +0000 2026-02-20T18:58:04.905 INFO:teuthology.orchestra.run.trial166.stdout: Birth: 2026-02-20 18:56:37.821048354 +0000 2026-02-20T18:58:04.905 DEBUG:teuthology.orchestra.run.trial166:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-20T18:58:04.968 INFO:teuthology.orchestra.run.trial166.stderr:1+0 records in 2026-02-20T18:58:04.968 INFO:teuthology.orchestra.run.trial166.stderr:1+0 records out 2026-02-20T18:58:04.968 INFO:teuthology.orchestra.run.trial166.stderr:512 bytes copied, 0.000156671 s, 3.3 MB/s 2026-02-20T18:58:04.970 DEBUG:teuthology.orchestra.run.trial166:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-20T18:58:05.026 DEBUG:teuthology.orchestra.run.trial166:> stat /dev/vg_nvme/lv_4 2026-02-20T18:58:05.082 INFO:teuthology.orchestra.run.trial166.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-20T18:58:05.082 INFO:teuthology.orchestra.run.trial166.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T18:58:05.082 INFO:teuthology.orchestra.run.trial166.stdout:Device: 6h/6d Inode: 991 Links: 1 2026-02-20T18:58:05.082 INFO:teuthology.orchestra.run.trial166.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T18:58:05.082 INFO:teuthology.orchestra.run.trial166.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T18:58:05.082 INFO:teuthology.orchestra.run.trial166.stdout:Access: 2026-02-20 18:58:02.138492943 +0000 2026-02-20T18:58:05.082 INFO:teuthology.orchestra.run.trial166.stdout:Modify: 2026-02-20 18:56:38.038047472 +0000 2026-02-20T18:58:05.082 INFO:teuthology.orchestra.run.trial166.stdout:Change: 2026-02-20 18:56:38.038047472 +0000 2026-02-20T18:58:05.082 INFO:teuthology.orchestra.run.trial166.stdout: Birth: 2026-02-20 18:56:38.038047472 +0000 2026-02-20T18:58:05.082 DEBUG:teuthology.orchestra.run.trial166:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-20T18:58:05.145 INFO:teuthology.orchestra.run.trial166.stderr:1+0 records in 2026-02-20T18:58:05.145 INFO:teuthology.orchestra.run.trial166.stderr:1+0 records out 2026-02-20T18:58:05.145 INFO:teuthology.orchestra.run.trial166.stderr:512 bytes copied, 0.000146743 s, 3.5 MB/s 2026-02-20T18:58:05.147 DEBUG:teuthology.orchestra.run.trial166:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-20T18:58:05.203 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-20T18:58:05.203 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial166.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2026-02-20T18:58:05.203 INFO:tasks.ceph:Generating config... 2026-02-20T18:58:05.204 INFO:tasks.ceph:[osd] osd max object name len = 400 2026-02-20T18:58:05.204 INFO:tasks.ceph:[osd] osd max object namespace len = 64 2026-02-20T18:58:05.204 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2026-02-20T18:58:05.204 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-20T18:58:05.204 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-20T18:58:05.204 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2026-02-20T18:58:05.204 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2026-02-20T18:58:05.204 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2026-02-20T18:58:05.204 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2026-02-20T18:58:05.205 INFO:tasks.ceph:[osd] osd mclock skip benchmark = True 2026-02-20T18:58:05.205 INFO:tasks.ceph:[osd] osd op queue = debug_random 2026-02-20T18:58:05.205 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2026-02-20T18:58:05.205 INFO:tasks.ceph:[global] mon election default strategy = 3 2026-02-20T18:58:05.205 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-20T18:58:05.205 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-20T18:58:05.205 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-20T18:58:05.205 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-20T18:58:05.205 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-20T18:58:05.205 INFO:tasks.ceph:[mon] mon scrub interval = 300 2026-02-20T18:58:05.205 INFO:tasks.ceph:Setting up mon.a... 2026-02-20T18:58:05.205 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-20T18:58:05.276 INFO:teuthology.orchestra.run.trial166.stdout:creating /etc/ceph/ceph.keyring 2026-02-20T18:58:05.278 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-20T18:58:05.355 DEBUG:teuthology.orchestra.run.trial166:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-20T18:58:05.420 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.166')] 2026-02-20T18:58:05.421 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.166', 'mon election default strategy': 3}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'osd max object name len': 400, 'osd max object namespace len': 64, 'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd mclock override recovery settings': True, 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon scrub interval': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}} 2026-02-20T18:58:05.422 DEBUG:teuthology.orchestra.run.trial166:> set -ex 2026-02-20T18:58:05.422 DEBUG:teuthology.orchestra.run.trial166:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-20T18:58:05.477 DEBUG:teuthology.orchestra.run.trial166:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.166 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-20T18:58:05.549 INFO:teuthology.orchestra.run.trial166.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-20T18:58:05.549 INFO:teuthology.orchestra.run.trial166.stdout:monmaptool: generated fsid cad5469e-fabd-4bbc-8156-013ef5fb2250 2026-02-20T18:58:05.549 INFO:teuthology.orchestra.run.trial166.stdout:setting min_mon_release = tentacle 2026-02-20T18:58:05.549 INFO:teuthology.orchestra.run.trial166.stdout:epoch 0 2026-02-20T18:58:05.549 INFO:teuthology.orchestra.run.trial166.stdout:fsid cad5469e-fabd-4bbc-8156-013ef5fb2250 2026-02-20T18:58:05.549 INFO:teuthology.orchestra.run.trial166.stdout:last_changed 2026-02-20T18:58:05.556948+0000 2026-02-20T18:58:05.549 INFO:teuthology.orchestra.run.trial166.stdout:created 2026-02-20T18:58:05.556948+0000 2026-02-20T18:58:05.549 INFO:teuthology.orchestra.run.trial166.stdout:min_mon_release 20 (tentacle) 2026-02-20T18:58:05.549 INFO:teuthology.orchestra.run.trial166.stdout:election_strategy: 3 2026-02-20T18:58:05.549 INFO:teuthology.orchestra.run.trial166.stdout:0: [v2:10.20.193.166:3300/0,v1:10.20.193.166:6789/0] mon.a 2026-02-20T18:58:05.549 INFO:teuthology.orchestra.run.trial166.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2026-02-20T18:58:05.550 DEBUG:teuthology.orchestra.run.trial166:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-20T18:58:05.608 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID cad5469e-fabd-4bbc-8156-013ef5fb2250... 2026-02-20T18:58:05.609 DEBUG:teuthology.orchestra.run.trial166:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-20T18:58:05.687 INFO:teuthology.orchestra.run.trial166.stdout:[global] 2026-02-20T18:58:05.687 INFO:teuthology.orchestra.run.trial166.stdout: chdir = "" 2026-02-20T18:58:05.687 INFO:teuthology.orchestra.run.trial166.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-20T18:58:05.687 INFO:teuthology.orchestra.run.trial166.stdout: auth supported = cephx 2026-02-20T18:58:05.687 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:58:05.687 INFO:teuthology.orchestra.run.trial166.stdout: filestore xattr use omap = true 2026-02-20T18:58:05.687 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:58:05.687 INFO:teuthology.orchestra.run.trial166.stdout: mon clock drift allowed = 1.000 2026-02-20T18:58:05.687 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:58:05.687 INFO:teuthology.orchestra.run.trial166.stdout: osd crush chooseleaf type = 0 2026-02-20T18:58:05.687 INFO:teuthology.orchestra.run.trial166.stdout: auth debug = true 2026-02-20T18:58:05.687 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:58:05.688 INFO:teuthology.orchestra.run.trial166.stdout: ms die on old message = true 2026-02-20T18:58:05.688 INFO:teuthology.orchestra.run.trial166.stdout: ms die on bug = true 2026-02-20T18:58:05.688 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:58:05.688 INFO:teuthology.orchestra.run.trial166.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-20T18:58:05.688 INFO:teuthology.orchestra.run.trial166.stdout: mon pg warn max object skew = 0 2026-02-20T18:58:05.688 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:58:05.688 INFO:teuthology.orchestra.run.trial166.stdout: # disable pg_autoscaler by default for new pools 2026-02-20T18:58:05.688 INFO:teuthology.orchestra.run.trial166.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-20T18:58:05.688 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:58:05.688 INFO:teuthology.orchestra.run.trial166.stdout: osd pool default size = 2 2026-02-20T18:58:05.688 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:58:05.688 INFO:teuthology.orchestra.run.trial166.stdout: mon osd allow primary affinity = true 2026-02-20T18:58:05.688 INFO:teuthology.orchestra.run.trial166.stdout: mon osd allow pg remap = true 2026-02-20T18:58:05.688 INFO:teuthology.orchestra.run.trial166.stdout: mon warn on legacy crush tunables = false 2026-02-20T18:58:05.688 INFO:teuthology.orchestra.run.trial166.stdout: mon warn on crush straw calc version zero = false 2026-02-20T18:58:05.688 INFO:teuthology.orchestra.run.trial166.stdout: mon warn on no sortbitwise = false 2026-02-20T18:58:05.688 INFO:teuthology.orchestra.run.trial166.stdout: mon warn on osd down out interval zero = false 2026-02-20T18:58:05.688 INFO:teuthology.orchestra.run.trial166.stdout: mon warn on too few osds = false 2026-02-20T18:58:05.688 INFO:teuthology.orchestra.run.trial166.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-20T18:58:05.688 INFO:teuthology.orchestra.run.trial166.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-20T18:58:05.688 INFO:teuthology.orchestra.run.trial166.stdout: mon_allow_pool_size_one = true 2026-02-20T18:58:05.688 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:58:05.688 INFO:teuthology.orchestra.run.trial166.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-20T18:58:05.688 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:58:05.688 INFO:teuthology.orchestra.run.trial166.stdout: osd default data pool replay window = 5 2026-02-20T18:58:05.688 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:58:05.688 INFO:teuthology.orchestra.run.trial166.stdout: mon allow pool delete = true 2026-02-20T18:58:05.688 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:58:05.688 INFO:teuthology.orchestra.run.trial166.stdout: mon cluster log file level = debug 2026-02-20T18:58:05.688 INFO:teuthology.orchestra.run.trial166.stdout: debug asserts on shutdown = true 2026-02-20T18:58:05.688 INFO:teuthology.orchestra.run.trial166.stdout: mon health detail to clog = false 2026-02-20T18:58:05.688 INFO:teuthology.orchestra.run.trial166.stdout: mon host = 10.20.193.166 2026-02-20T18:58:05.688 INFO:teuthology.orchestra.run.trial166.stdout: mon election default strategy = 3 2026-02-20T18:58:05.688 INFO:teuthology.orchestra.run.trial166.stdout: fsid = cad5469e-fabd-4bbc-8156-013ef5fb2250 2026-02-20T18:58:05.688 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:58:05.688 INFO:teuthology.orchestra.run.trial166.stdout:[osd] 2026-02-20T18:58:05.688 INFO:teuthology.orchestra.run.trial166.stdout: osd journal size = 100 2026-02-20T18:58:05.688 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:58:05.688 INFO:teuthology.orchestra.run.trial166.stdout: osd scrub load threshold = 5.0 2026-02-20T18:58:05.688 INFO:teuthology.orchestra.run.trial166.stdout: osd scrub max interval = 600 2026-02-20T18:58:05.688 INFO:teuthology.orchestra.run.trial166.stdout: osd mclock profile = high_recovery_ops 2026-02-20T18:58:05.688 INFO:teuthology.orchestra.run.trial166.stdout: osd mclock skip benchmark = True 2026-02-20T18:58:05.689 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:58:05.689 INFO:teuthology.orchestra.run.trial166.stdout: osd recover clone overlap = true 2026-02-20T18:58:05.689 INFO:teuthology.orchestra.run.trial166.stdout: osd recovery max chunk = 1048576 2026-02-20T18:58:05.689 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:58:05.689 INFO:teuthology.orchestra.run.trial166.stdout: osd debug shutdown = true 2026-02-20T18:58:05.689 INFO:teuthology.orchestra.run.trial166.stdout: osd debug op order = true 2026-02-20T18:58:05.689 INFO:teuthology.orchestra.run.trial166.stdout: osd debug verify stray on activate = true 2026-02-20T18:58:05.689 INFO:teuthology.orchestra.run.trial166.stdout: osd debug trim objects = true 2026-02-20T18:58:05.689 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:58:05.689 INFO:teuthology.orchestra.run.trial166.stdout: osd open classes on start = true 2026-02-20T18:58:05.689 INFO:teuthology.orchestra.run.trial166.stdout: osd debug pg log writeout = true 2026-02-20T18:58:05.689 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:58:05.689 INFO:teuthology.orchestra.run.trial166.stdout: osd deep scrub update digest min age = 30 2026-02-20T18:58:05.689 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:58:05.689 INFO:teuthology.orchestra.run.trial166.stdout: osd map max advance = 10 2026-02-20T18:58:05.689 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:58:05.689 INFO:teuthology.orchestra.run.trial166.stdout: journal zero on create = true 2026-02-20T18:58:05.689 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:58:05.689 INFO:teuthology.orchestra.run.trial166.stdout: filestore ondisk finisher threads = 3 2026-02-20T18:58:05.689 INFO:teuthology.orchestra.run.trial166.stdout: filestore apply finisher threads = 3 2026-02-20T18:58:05.689 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:58:05.689 INFO:teuthology.orchestra.run.trial166.stdout: bdev debug aio = true 2026-02-20T18:58:05.689 INFO:teuthology.orchestra.run.trial166.stdout: osd debug misdirected ops = true 2026-02-20T18:58:05.689 INFO:teuthology.orchestra.run.trial166.stdout: osd max object name len = 400 2026-02-20T18:58:05.689 INFO:teuthology.orchestra.run.trial166.stdout: osd max object namespace len = 64 2026-02-20T18:58:05.689 INFO:teuthology.orchestra.run.trial166.stdout: bluestore zero block detection = True 2026-02-20T18:58:05.689 INFO:teuthology.orchestra.run.trial166.stdout: debug ms = 1 2026-02-20T18:58:05.689 INFO:teuthology.orchestra.run.trial166.stdout: debug osd = 20 2026-02-20T18:58:05.689 INFO:teuthology.orchestra.run.trial166.stdout: osd debug verify cached snaps = True 2026-02-20T18:58:05.689 INFO:teuthology.orchestra.run.trial166.stdout: osd debug verify missing on start = True 2026-02-20T18:58:05.689 INFO:teuthology.orchestra.run.trial166.stdout: osd mclock override recovery settings = True 2026-02-20T18:58:05.689 INFO:teuthology.orchestra.run.trial166.stdout: osd op queue = debug_random 2026-02-20T18:58:05.689 INFO:teuthology.orchestra.run.trial166.stdout: osd op queue cut off = debug_random 2026-02-20T18:58:05.689 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:58:05.689 INFO:teuthology.orchestra.run.trial166.stdout:[mgr] 2026-02-20T18:58:05.689 INFO:teuthology.orchestra.run.trial166.stdout: debug ms = 1 2026-02-20T18:58:05.689 INFO:teuthology.orchestra.run.trial166.stdout: debug mgr = 20 2026-02-20T18:58:05.689 INFO:teuthology.orchestra.run.trial166.stdout: debug mon = 20 2026-02-20T18:58:05.689 INFO:teuthology.orchestra.run.trial166.stdout: debug auth = 20 2026-02-20T18:58:05.689 INFO:teuthology.orchestra.run.trial166.stdout: mon reweight min pgs per osd = 4 2026-02-20T18:58:05.689 INFO:teuthology.orchestra.run.trial166.stdout: mon reweight min bytes per osd = 10 2026-02-20T18:58:05.689 INFO:teuthology.orchestra.run.trial166.stdout: mgr/telemetry/nag = false 2026-02-20T18:58:05.689 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:58:05.689 INFO:teuthology.orchestra.run.trial166.stdout:[mon] 2026-02-20T18:58:05.690 INFO:teuthology.orchestra.run.trial166.stdout: debug ms = 1 2026-02-20T18:58:05.690 INFO:teuthology.orchestra.run.trial166.stdout: debug mon = 20 2026-02-20T18:58:05.690 INFO:teuthology.orchestra.run.trial166.stdout: debug paxos = 20 2026-02-20T18:58:05.690 INFO:teuthology.orchestra.run.trial166.stdout: debug auth = 20 2026-02-20T18:58:05.690 INFO:teuthology.orchestra.run.trial166.stdout: mon data avail warn = 5 2026-02-20T18:58:05.690 INFO:teuthology.orchestra.run.trial166.stdout: mon mgr mkfs grace = 240 2026-02-20T18:58:05.690 INFO:teuthology.orchestra.run.trial166.stdout: mon reweight min pgs per osd = 4 2026-02-20T18:58:05.690 INFO:teuthology.orchestra.run.trial166.stdout: mon osd reporter subtree level = osd 2026-02-20T18:58:05.690 INFO:teuthology.orchestra.run.trial166.stdout: mon osd prime pg temp = true 2026-02-20T18:58:05.690 INFO:teuthology.orchestra.run.trial166.stdout: mon reweight min bytes per osd = 10 2026-02-20T18:58:05.690 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:58:05.690 INFO:teuthology.orchestra.run.trial166.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-20T18:58:05.690 INFO:teuthology.orchestra.run.trial166.stdout: auth mon ticket ttl = 660 # 11m 2026-02-20T18:58:05.690 INFO:teuthology.orchestra.run.trial166.stdout: auth service ticket ttl = 240 # 4m 2026-02-20T18:58:05.690 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:58:05.690 INFO:teuthology.orchestra.run.trial166.stdout: # don't complain about insecure global_id in the test suite 2026-02-20T18:58:05.690 INFO:teuthology.orchestra.run.trial166.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-20T18:58:05.690 INFO:teuthology.orchestra.run.trial166.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-20T18:58:05.690 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:58:05.690 INFO:teuthology.orchestra.run.trial166.stdout: # 1m isn't quite enough 2026-02-20T18:58:05.690 INFO:teuthology.orchestra.run.trial166.stdout: mon_down_mkfs_grace = 2m 2026-02-20T18:58:05.690 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:58:05.690 INFO:teuthology.orchestra.run.trial166.stdout: mon_warn_on_filestore_osds = false 2026-02-20T18:58:05.690 INFO:teuthology.orchestra.run.trial166.stdout: mon scrub interval = 300 2026-02-20T18:58:05.690 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:58:05.690 INFO:teuthology.orchestra.run.trial166.stdout:[client] 2026-02-20T18:58:05.690 INFO:teuthology.orchestra.run.trial166.stdout: rgw cache enabled = true 2026-02-20T18:58:05.690 INFO:teuthology.orchestra.run.trial166.stdout: rgw enable ops log = true 2026-02-20T18:58:05.690 INFO:teuthology.orchestra.run.trial166.stdout: rgw enable usage log = true 2026-02-20T18:58:05.690 INFO:teuthology.orchestra.run.trial166.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-20T18:58:05.690 INFO:teuthology.orchestra.run.trial166.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-20T18:58:05.690 INFO:teuthology.orchestra.run.trial166.stdout:[mon.a] 2026-02-20T18:58:05.697 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-20T18:58:05.697 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-20T18:58:05.780 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-20T18:58:05.780 DEBUG:teuthology.orchestra.run.trial166:> set -ex 2026-02-20T18:58:05.781 DEBUG:teuthology.orchestra.run.trial166:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-20T18:58:05.838 DEBUG:teuthology.orchestra.run.trial166:> set -ex 2026-02-20T18:58:05.838 DEBUG:teuthology.orchestra.run.trial166:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-20T18:58:05.893 INFO:tasks.ceph:Sending monmap to node ubuntu@trial166.front.sepia.ceph.com 2026-02-20T18:58:05.893 DEBUG:teuthology.orchestra.run.trial166:> set -ex 2026-02-20T18:58:05.893 DEBUG:teuthology.orchestra.run.trial166:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-20T18:58:05.893 DEBUG:teuthology.orchestra.run.trial166:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-20T18:58:05.967 DEBUG:teuthology.orchestra.run.trial166:> set -ex 2026-02-20T18:58:05.967 DEBUG:teuthology.orchestra.run.trial166:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-20T18:58:06.023 INFO:tasks.ceph:Setting up mon nodes... 2026-02-20T18:58:06.024 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-20T18:58:06.024 DEBUG:teuthology.orchestra.run.trial166:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-20T18:58:06.107 INFO:teuthology.orchestra.run.trial166.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-20T18:58:06.109 INFO:tasks.ceph:Setting up mds nodes... 2026-02-20T18:58:06.110 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-20T18:58:06.110 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-20T18:58:06.143 INFO:teuthology.orchestra.run.trial166.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-20T18:58:06.154 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-20T18:58:06.154 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial166.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2026-02-20T18:58:06.154 DEBUG:teuthology.orchestra.run.trial166:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-20T18:58:06.219 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-20T18:58:06.219 INFO:tasks.ceph:role: osd.0 2026-02-20T18:58:06.219 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial166.front.sepia.ceph.com 2026-02-20T18:58:06.220 DEBUG:teuthology.orchestra.run.trial166:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-20T18:58:06.284 INFO:teuthology.orchestra.run.trial166.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-20T18:58:06.284 INFO:teuthology.orchestra.run.trial166.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-20T18:58:06.284 INFO:teuthology.orchestra.run.trial166.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-20T18:58:06.285 INFO:teuthology.orchestra.run.trial166.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-20T18:58:06.285 INFO:teuthology.orchestra.run.trial166.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-20T18:58:06.285 INFO:teuthology.orchestra.run.trial166.stdout: = sunit=0 swidth=0 blks 2026-02-20T18:58:06.285 INFO:teuthology.orchestra.run.trial166.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-20T18:58:06.285 INFO:teuthology.orchestra.run.trial166.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-20T18:58:06.285 INFO:teuthology.orchestra.run.trial166.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-20T18:58:06.285 INFO:teuthology.orchestra.run.trial166.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-20T18:58:06.864 INFO:teuthology.orchestra.run.trial166.stdout:Discarding blocks...Done. 2026-02-20T18:58:06.866 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial166.front.sepia.ceph.com -o noatime 2026-02-20T18:58:06.866 DEBUG:teuthology.orchestra.run.trial166:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-20T18:58:06.934 DEBUG:teuthology.orchestra.run.trial166:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-20T18:58:07.004 DEBUG:teuthology.orchestra.run.trial166:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-20T18:58:07.067 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-20T18:58:07.067 INFO:tasks.ceph:role: osd.1 2026-02-20T18:58:07.067 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial166.front.sepia.ceph.com 2026-02-20T18:58:07.067 DEBUG:teuthology.orchestra.run.trial166:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-20T18:58:07.132 INFO:teuthology.orchestra.run.trial166.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-20T18:58:07.132 INFO:teuthology.orchestra.run.trial166.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-20T18:58:07.132 INFO:teuthology.orchestra.run.trial166.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-20T18:58:07.132 INFO:teuthology.orchestra.run.trial166.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-20T18:58:07.132 INFO:teuthology.orchestra.run.trial166.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-20T18:58:07.132 INFO:teuthology.orchestra.run.trial166.stdout: = sunit=0 swidth=0 blks 2026-02-20T18:58:07.132 INFO:teuthology.orchestra.run.trial166.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-20T18:58:07.132 INFO:teuthology.orchestra.run.trial166.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-20T18:58:07.132 INFO:teuthology.orchestra.run.trial166.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-20T18:58:07.133 INFO:teuthology.orchestra.run.trial166.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-20T18:58:07.693 INFO:teuthology.orchestra.run.trial166.stdout:Discarding blocks...Done. 2026-02-20T18:58:07.695 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial166.front.sepia.ceph.com -o noatime 2026-02-20T18:58:07.695 DEBUG:teuthology.orchestra.run.trial166:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-20T18:58:07.765 DEBUG:teuthology.orchestra.run.trial166:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-20T18:58:07.830 DEBUG:teuthology.orchestra.run.trial166:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-20T18:58:07.894 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-20T18:58:07.894 INFO:tasks.ceph:role: osd.2 2026-02-20T18:58:07.894 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial166.front.sepia.ceph.com 2026-02-20T18:58:07.894 DEBUG:teuthology.orchestra.run.trial166:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-20T18:58:07.960 INFO:teuthology.orchestra.run.trial166.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-20T18:58:07.960 INFO:teuthology.orchestra.run.trial166.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-20T18:58:07.961 INFO:teuthology.orchestra.run.trial166.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-20T18:58:07.961 INFO:teuthology.orchestra.run.trial166.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-20T18:58:07.961 INFO:teuthology.orchestra.run.trial166.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-20T18:58:07.961 INFO:teuthology.orchestra.run.trial166.stdout: = sunit=0 swidth=0 blks 2026-02-20T18:58:07.961 INFO:teuthology.orchestra.run.trial166.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-20T18:58:07.961 INFO:teuthology.orchestra.run.trial166.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-20T18:58:07.961 INFO:teuthology.orchestra.run.trial166.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-20T18:58:07.961 INFO:teuthology.orchestra.run.trial166.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-20T18:58:08.529 INFO:teuthology.orchestra.run.trial166.stdout:Discarding blocks...Done. 2026-02-20T18:58:08.531 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial166.front.sepia.ceph.com -o noatime 2026-02-20T18:58:08.531 DEBUG:teuthology.orchestra.run.trial166:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2026-02-20T18:58:08.599 DEBUG:teuthology.orchestra.run.trial166:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-20T18:58:08.666 DEBUG:teuthology.orchestra.run.trial166:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-20T18:58:08.730 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-20T18:58:08.730 INFO:tasks.ceph:role: osd.3 2026-02-20T18:58:08.730 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial166.front.sepia.ceph.com 2026-02-20T18:58:08.731 DEBUG:teuthology.orchestra.run.trial166:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-20T18:58:08.796 INFO:teuthology.orchestra.run.trial166.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-20T18:58:08.797 INFO:teuthology.orchestra.run.trial166.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-20T18:58:08.797 INFO:teuthology.orchestra.run.trial166.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-20T18:58:08.797 INFO:teuthology.orchestra.run.trial166.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-20T18:58:08.797 INFO:teuthology.orchestra.run.trial166.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-20T18:58:08.797 INFO:teuthology.orchestra.run.trial166.stdout: = sunit=0 swidth=0 blks 2026-02-20T18:58:08.797 INFO:teuthology.orchestra.run.trial166.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-20T18:58:08.797 INFO:teuthology.orchestra.run.trial166.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-20T18:58:08.797 INFO:teuthology.orchestra.run.trial166.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-20T18:58:08.797 INFO:teuthology.orchestra.run.trial166.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-20T18:58:09.354 INFO:teuthology.orchestra.run.trial166.stdout:Discarding blocks...Done. 2026-02-20T18:58:09.356 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial166.front.sepia.ceph.com -o noatime 2026-02-20T18:58:09.357 DEBUG:teuthology.orchestra.run.trial166:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2026-02-20T18:58:09.425 DEBUG:teuthology.orchestra.run.trial166:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-20T18:58:09.491 DEBUG:teuthology.orchestra.run.trial166:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2026-02-20T18:58:09.555 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-20T18:58:09.555 INFO:tasks.ceph:role: osd.4 2026-02-20T18:58:09.555 DEBUG:teuthology.orchestra.run.trial166:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2026-02-20T18:58:09.620 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-20T18:58:09.621 INFO:tasks.ceph:role: osd.5 2026-02-20T18:58:09.621 DEBUG:teuthology.orchestra.run.trial166:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2026-02-20T18:58:09.685 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-20T18:58:09.685 INFO:tasks.ceph:role: osd.6 2026-02-20T18:58:09.685 DEBUG:teuthology.orchestra.run.trial166:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2026-02-20T18:58:09.750 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-20T18:58:09.750 INFO:tasks.ceph:role: osd.7 2026-02-20T18:58:09.750 DEBUG:teuthology.orchestra.run.trial166:> sudo mkdir -p /var/lib/ceph/osd/ceph-8 2026-02-20T18:58:09.813 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-20T18:58:09.814 INFO:tasks.ceph:role: osd.8 2026-02-20T18:58:09.814 DEBUG:teuthology.orchestra.run.trial166:> sudo mkdir -p /var/lib/ceph/osd/ceph-9 2026-02-20T18:58:09.877 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-20T18:58:09.877 INFO:tasks.ceph:role: osd.9 2026-02-20T18:58:09.877 DEBUG:teuthology.orchestra.run.trial166:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-20T18:58:09.954 INFO:teuthology.orchestra.run.trial166.stderr:2026-02-20T18:58:09.961+0000 7f66abcfe900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-20T18:58:09.955 INFO:teuthology.orchestra.run.trial166.stderr:2026-02-20T18:58:09.961+0000 7f66abcfe900 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-20T18:58:09.955 INFO:teuthology.orchestra.run.trial166.stderr:2026-02-20T18:58:09.961+0000 7f66abcfe900 -1 bdev(0x56347e00f800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-20T18:58:09.955 INFO:teuthology.orchestra.run.trial166.stderr:2026-02-20T18:58:09.961+0000 7f66abcfe900 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-20T18:58:10.265 DEBUG:teuthology.orchestra.run.trial166:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-20T18:58:10.330 DEBUG:teuthology.orchestra.run.trial166:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-20T18:58:10.408 INFO:teuthology.orchestra.run.trial166.stderr:2026-02-20T18:58:10.414+0000 7f8fc4d2d900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-20T18:58:10.409 INFO:teuthology.orchestra.run.trial166.stderr:2026-02-20T18:58:10.414+0000 7f8fc4d2d900 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-20T18:58:10.409 INFO:teuthology.orchestra.run.trial166.stderr:2026-02-20T18:58:10.414+0000 7f8fc4d2d900 -1 bdev(0x555ad2aef800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-20T18:58:10.409 INFO:teuthology.orchestra.run.trial166.stderr:2026-02-20T18:58:10.414+0000 7f8fc4d2d900 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-20T18:58:10.712 DEBUG:teuthology.orchestra.run.trial166:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-20T18:58:10.780 DEBUG:teuthology.orchestra.run.trial166:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-20T18:58:10.859 INFO:teuthology.orchestra.run.trial166.stderr:2026-02-20T18:58:10.864+0000 7f73683a2900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-20T18:58:10.859 INFO:teuthology.orchestra.run.trial166.stderr:2026-02-20T18:58:10.865+0000 7f73683a2900 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-20T18:58:10.859 INFO:teuthology.orchestra.run.trial166.stderr:2026-02-20T18:58:10.865+0000 7f73683a2900 -1 bdev(0x564a3d4b9800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-02-20T18:58:10.859 INFO:teuthology.orchestra.run.trial166.stderr:2026-02-20T18:58:10.865+0000 7f73683a2900 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-20T18:58:11.185 DEBUG:teuthology.orchestra.run.trial166:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-20T18:58:11.250 DEBUG:teuthology.orchestra.run.trial166:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-20T18:58:11.329 INFO:teuthology.orchestra.run.trial166.stderr:2026-02-20T18:58:11.335+0000 7f40f7ab8900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2026-02-20T18:58:11.329 INFO:teuthology.orchestra.run.trial166.stderr:2026-02-20T18:58:11.335+0000 7f40f7ab8900 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2026-02-20T18:58:11.329 INFO:teuthology.orchestra.run.trial166.stderr:2026-02-20T18:58:11.335+0000 7f40f7ab8900 -1 bdev(0x556de769d800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2026-02-20T18:58:11.329 INFO:teuthology.orchestra.run.trial166.stderr:2026-02-20T18:58:11.335+0000 7f40f7ab8900 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2026-02-20T18:58:11.641 DEBUG:teuthology.orchestra.run.trial166:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-20T18:58:11.704 DEBUG:teuthology.orchestra.run.trial166:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-20T18:58:11.782 INFO:teuthology.orchestra.run.trial166.stderr:2026-02-20T18:58:11.788+0000 7f214ce67900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2026-02-20T18:58:11.782 INFO:teuthology.orchestra.run.trial166.stderr:2026-02-20T18:58:11.788+0000 7f214ce67900 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2026-02-20T18:58:11.782 INFO:teuthology.orchestra.run.trial166.stderr:2026-02-20T18:58:11.788+0000 7f214ce67900 -1 bdev(0x55e7c5f65800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2026-02-20T18:58:11.782 INFO:teuthology.orchestra.run.trial166.stderr:2026-02-20T18:58:11.789+0000 7f214ce67900 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2026-02-20T18:58:12.099 DEBUG:teuthology.orchestra.run.trial166:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2026-02-20T18:58:12.164 DEBUG:teuthology.orchestra.run.trial166:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-20T18:58:12.242 INFO:teuthology.orchestra.run.trial166.stderr:2026-02-20T18:58:12.248+0000 7fb6b86d9900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2026-02-20T18:58:12.242 INFO:teuthology.orchestra.run.trial166.stderr:2026-02-20T18:58:12.248+0000 7fb6b86d9900 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2026-02-20T18:58:12.243 INFO:teuthology.orchestra.run.trial166.stderr:2026-02-20T18:58:12.248+0000 7fb6b86d9900 -1 bdev(0x55cbb8d67800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2026-02-20T18:58:12.243 INFO:teuthology.orchestra.run.trial166.stderr:2026-02-20T18:58:12.248+0000 7fb6b86d9900 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2026-02-20T18:58:12.573 DEBUG:teuthology.orchestra.run.trial166:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2026-02-20T18:58:12.637 DEBUG:teuthology.orchestra.run.trial166:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-20T18:58:12.716 INFO:teuthology.orchestra.run.trial166.stderr:2026-02-20T18:58:12.722+0000 7f5a9dc8f900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2026-02-20T18:58:12.717 INFO:teuthology.orchestra.run.trial166.stderr:2026-02-20T18:58:12.722+0000 7f5a9dc8f900 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2026-02-20T18:58:12.717 INFO:teuthology.orchestra.run.trial166.stderr:2026-02-20T18:58:12.723+0000 7f5a9dc8f900 -1 bdev(0x5582bd42f800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2026-02-20T18:58:12.717 INFO:teuthology.orchestra.run.trial166.stderr:2026-02-20T18:58:12.723+0000 7f5a9dc8f900 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2026-02-20T18:58:13.034 DEBUG:teuthology.orchestra.run.trial166:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2026-02-20T18:58:13.098 DEBUG:teuthology.orchestra.run.trial166:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-20T18:58:13.177 INFO:teuthology.orchestra.run.trial166.stderr:2026-02-20T18:58:13.183+0000 7f1698614900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2026-02-20T18:58:13.177 INFO:teuthology.orchestra.run.trial166.stderr:2026-02-20T18:58:13.183+0000 7f1698614900 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2026-02-20T18:58:13.177 INFO:teuthology.orchestra.run.trial166.stderr:2026-02-20T18:58:13.183+0000 7f1698614900 -1 bdev(0x561b399df800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2026-02-20T18:58:13.177 INFO:teuthology.orchestra.run.trial166.stderr:2026-02-20T18:58:13.183+0000 7f1698614900 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2026-02-20T18:58:13.508 DEBUG:teuthology.orchestra.run.trial166:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2026-02-20T18:58:13.573 DEBUG:teuthology.orchestra.run.trial166:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 8 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-20T18:58:13.653 INFO:teuthology.orchestra.run.trial166.stderr:2026-02-20T18:58:13.659+0000 7f5f174a8900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-8/keyring: can't open /var/lib/ceph/osd/ceph-8/keyring: (2) No such file or directory 2026-02-20T18:58:13.653 INFO:teuthology.orchestra.run.trial166.stderr:2026-02-20T18:58:13.659+0000 7f5f174a8900 -1 created new key in keyring /var/lib/ceph/osd/ceph-8/keyring 2026-02-20T18:58:13.653 INFO:teuthology.orchestra.run.trial166.stderr:2026-02-20T18:58:13.659+0000 7f5f174a8900 -1 bdev(0x55c8bc717800 /var/lib/ceph/osd/ceph-8/block) open stat got: (1) Operation not permitted 2026-02-20T18:58:13.653 INFO:teuthology.orchestra.run.trial166.stderr:2026-02-20T18:58:13.659+0000 7f5f174a8900 -1 bluestore(/var/lib/ceph/osd/ceph-8) _read_fsid unparsable uuid 2026-02-20T18:58:14.010 DEBUG:teuthology.orchestra.run.trial166:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-8 2026-02-20T18:58:14.075 DEBUG:teuthology.orchestra.run.trial166:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 9 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-20T18:58:14.153 INFO:teuthology.orchestra.run.trial166.stderr:2026-02-20T18:58:14.160+0000 7f158180e900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-9/keyring: can't open /var/lib/ceph/osd/ceph-9/keyring: (2) No such file or directory 2026-02-20T18:58:14.154 INFO:teuthology.orchestra.run.trial166.stderr:2026-02-20T18:58:14.160+0000 7f158180e900 -1 created new key in keyring /var/lib/ceph/osd/ceph-9/keyring 2026-02-20T18:58:14.154 INFO:teuthology.orchestra.run.trial166.stderr:2026-02-20T18:58:14.160+0000 7f158180e900 -1 bdev(0x5590e2685800 /var/lib/ceph/osd/ceph-9/block) open stat got: (1) Operation not permitted 2026-02-20T18:58:14.154 INFO:teuthology.orchestra.run.trial166.stderr:2026-02-20T18:58:14.160+0000 7f158180e900 -1 bluestore(/var/lib/ceph/osd/ceph-9) _read_fsid unparsable uuid 2026-02-20T18:58:14.464 DEBUG:teuthology.orchestra.run.trial166:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-9 2026-02-20T18:58:14.529 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-20T18:58:14.529 DEBUG:teuthology.orchestra.run.trial166:> set -ex 2026-02-20T18:58:14.530 DEBUG:teuthology.orchestra.run.trial166:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-20T18:58:14.594 DEBUG:teuthology.orchestra.run.trial166:> set -ex 2026-02-20T18:58:14.594 DEBUG:teuthology.orchestra.run.trial166:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-20T18:58:14.659 DEBUG:teuthology.orchestra.run.trial166:> set -ex 2026-02-20T18:58:14.659 DEBUG:teuthology.orchestra.run.trial166:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-20T18:58:14.723 DEBUG:teuthology.orchestra.run.trial166:> set -ex 2026-02-20T18:58:14.723 DEBUG:teuthology.orchestra.run.trial166:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-20T18:58:14.787 DEBUG:teuthology.orchestra.run.trial166:> set -ex 2026-02-20T18:58:14.787 DEBUG:teuthology.orchestra.run.trial166:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-20T18:58:14.851 DEBUG:teuthology.orchestra.run.trial166:> set -ex 2026-02-20T18:58:14.852 DEBUG:teuthology.orchestra.run.trial166:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2026-02-20T18:58:14.917 DEBUG:teuthology.orchestra.run.trial166:> set -ex 2026-02-20T18:58:14.917 DEBUG:teuthology.orchestra.run.trial166:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2026-02-20T18:58:14.980 DEBUG:teuthology.orchestra.run.trial166:> set -ex 2026-02-20T18:58:14.980 DEBUG:teuthology.orchestra.run.trial166:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2026-02-20T18:58:15.045 DEBUG:teuthology.orchestra.run.trial166:> set -ex 2026-02-20T18:58:15.045 DEBUG:teuthology.orchestra.run.trial166:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2026-02-20T18:58:15.108 DEBUG:teuthology.orchestra.run.trial166:> set -ex 2026-02-20T18:58:15.108 DEBUG:teuthology.orchestra.run.trial166:> sudo dd if=/var/lib/ceph/osd/ceph-8/keyring of=/dev/stdout 2026-02-20T18:58:15.172 DEBUG:teuthology.orchestra.run.trial166:> set -ex 2026-02-20T18:58:15.172 DEBUG:teuthology.orchestra.run.trial166:> sudo dd if=/var/lib/ceph/osd/ceph-9/keyring of=/dev/stdout 2026-02-20T18:58:15.235 DEBUG:teuthology.orchestra.run.trial166:> set -ex 2026-02-20T18:58:15.235 DEBUG:teuthology.orchestra.run.trial166:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-20T18:58:15.289 INFO:tasks.ceph:Adding keys to all mons... 2026-02-20T18:58:15.289 DEBUG:teuthology.orchestra.run.trial166:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-20T18:58:15.352 INFO:teuthology.orchestra.run.trial166.stdout:[mgr.x] 2026-02-20T18:58:15.352 INFO:teuthology.orchestra.run.trial166.stdout: key = AQC+rphpp57dBhAAPnXxEsdISHaXf4jDFkw4Ig== 2026-02-20T18:58:15.352 INFO:teuthology.orchestra.run.trial166.stdout:[osd.0] 2026-02-20T18:58:15.352 INFO:teuthology.orchestra.run.trial166.stdout: key = AQDBrphpeIddORAA+Sf/D7P9tQM6jPFb+4+nNA== 2026-02-20T18:58:15.352 INFO:teuthology.orchestra.run.trial166.stdout:[osd.1] 2026-02-20T18:58:15.352 INFO:teuthology.orchestra.run.trial166.stdout: key = AQDCrphpv0LJGBAAphTj/MEAq8fgAqBrddNuHw== 2026-02-20T18:58:15.352 INFO:teuthology.orchestra.run.trial166.stdout:[osd.2] 2026-02-20T18:58:15.352 INFO:teuthology.orchestra.run.trial166.stdout: key = AQDCrphpyAKhMxAA1VqW8vh14UAdBhCcPnkp1g== 2026-02-20T18:58:15.352 INFO:teuthology.orchestra.run.trial166.stdout:[osd.3] 2026-02-20T18:58:15.352 INFO:teuthology.orchestra.run.trial166.stdout: key = AQDDrphpgwYQFBAA3P1jQhWXNKOaYqe3bc5kEA== 2026-02-20T18:58:15.352 INFO:teuthology.orchestra.run.trial166.stdout:[osd.4] 2026-02-20T18:58:15.352 INFO:teuthology.orchestra.run.trial166.stdout: key = AQDDrphp+SkXLxAAnWTOPq26ixISzEZl9PW6tw== 2026-02-20T18:58:15.352 INFO:teuthology.orchestra.run.trial166.stdout:[osd.5] 2026-02-20T18:58:15.352 INFO:teuthology.orchestra.run.trial166.stdout: key = AQDErphpBTvlDhAABxAMLR6OvzMHg9fh1sGuEg== 2026-02-20T18:58:15.352 INFO:teuthology.orchestra.run.trial166.stdout:[osd.6] 2026-02-20T18:58:15.352 INFO:teuthology.orchestra.run.trial166.stdout: key = AQDErphpz9spKxAAvuHKz3YYg1C5B7UNBjJahw== 2026-02-20T18:58:15.352 INFO:teuthology.orchestra.run.trial166.stdout:[osd.7] 2026-02-20T18:58:15.352 INFO:teuthology.orchestra.run.trial166.stdout: key = AQDFrphpVqwACxAA1YIGTYBUojbllhEfs+NDjA== 2026-02-20T18:58:15.352 INFO:teuthology.orchestra.run.trial166.stdout:[osd.8] 2026-02-20T18:58:15.352 INFO:teuthology.orchestra.run.trial166.stdout: key = AQDFrphpvA9fJxAAzcWlrBliXlCaCc3KLQMk1A== 2026-02-20T18:58:15.352 INFO:teuthology.orchestra.run.trial166.stdout:[osd.9] 2026-02-20T18:58:15.352 INFO:teuthology.orchestra.run.trial166.stdout: key = AQDGrphpmvScCRAASldc0vGKYRi9oXB41QoLLA== 2026-02-20T18:58:15.352 INFO:teuthology.orchestra.run.trial166.stdout:[client.0] 2026-02-20T18:58:15.353 INFO:teuthology.orchestra.run.trial166.stdout: key = AQC+rphpOYgHCRAAuWCZv6LpiYXX4f1DDLDkoQ== 2026-02-20T18:58:15.353 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-20T18:58:15.434 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-20T18:58:15.512 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-20T18:58:15.592 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-20T18:58:15.672 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-20T18:58:15.750 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-20T18:58:15.832 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-20T18:58:15.910 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-20T18:58:15.991 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-20T18:58:16.072 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-20T18:58:16.149 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-20T18:58:16.228 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-20T18:58:16.309 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-20T18:58:16.310 DEBUG:teuthology.orchestra.run.trial166:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-20T18:58:16.373 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-20T18:58:16.460 DEBUG:teuthology.orchestra.run.trial166:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-20T18:58:16.485 DEBUG:teuthology.orchestra.run.trial166:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-20T18:58:16.540 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-20T18:58:16.541 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-20T18:58:16.541 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-20T18:58:16.582 INFO:tasks.ceph.mon.a:Started 2026-02-20T18:58:16.583 DEBUG:teuthology.orchestra.run.trial166:> sudo ceph config set mgr mgr_pool false --force 2026-02-20T18:58:16.690 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-20T18:58:16.690 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-20T18:58:16.691 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-20T18:58:16.693 INFO:tasks.ceph.mgr.x:Started 2026-02-20T18:58:16.693 DEBUG:tasks.ceph:set 0 configs 2026-02-20T18:58:16.694 DEBUG:teuthology.orchestra.run.trial166:> sudo ceph --cluster ceph config dump 2026-02-20T18:58:16.790 INFO:teuthology.orchestra.run.trial166.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-20T18:58:16.790 INFO:teuthology.orchestra.run.trial166.stdout:mgr dev mgr_pool false * 2026-02-20T18:58:16.798 INFO:tasks.ceph:Setting crush tunables to default 2026-02-20T18:58:16.798 DEBUG:teuthology.orchestra.run.trial166:> sudo ceph --cluster ceph osd crush tunables default 2026-02-20T18:58:16.901 INFO:teuthology.orchestra.run.trial166.stderr:adjusted tunables profile to default 2026-02-20T18:58:16.909 INFO:tasks.ceph:check_enable_crimson: False 2026-02-20T18:58:16.909 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-20T18:58:16.909 DEBUG:teuthology.orchestra.run.trial166:> set -ex 2026-02-20T18:58:16.909 DEBUG:teuthology.orchestra.run.trial166:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-20T18:58:16.934 DEBUG:teuthology.orchestra.run.trial166:> set -ex 2026-02-20T18:58:16.934 DEBUG:teuthology.orchestra.run.trial166:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-20T18:58:17.000 DEBUG:teuthology.orchestra.run.trial166:> set -ex 2026-02-20T18:58:17.000 DEBUG:teuthology.orchestra.run.trial166:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-20T18:58:17.064 DEBUG:teuthology.orchestra.run.trial166:> set -ex 2026-02-20T18:58:17.064 DEBUG:teuthology.orchestra.run.trial166:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-20T18:58:17.127 DEBUG:teuthology.orchestra.run.trial166:> set -ex 2026-02-20T18:58:17.127 DEBUG:teuthology.orchestra.run.trial166:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2026-02-20T18:58:17.193 DEBUG:teuthology.orchestra.run.trial166:> set -ex 2026-02-20T18:58:17.193 DEBUG:teuthology.orchestra.run.trial166:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2026-02-20T18:58:17.256 DEBUG:teuthology.orchestra.run.trial166:> set -ex 2026-02-20T18:58:17.256 DEBUG:teuthology.orchestra.run.trial166:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2026-02-20T18:58:17.319 DEBUG:teuthology.orchestra.run.trial166:> set -ex 2026-02-20T18:58:17.319 DEBUG:teuthology.orchestra.run.trial166:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2026-02-20T18:58:17.383 DEBUG:teuthology.orchestra.run.trial166:> set -ex 2026-02-20T18:58:17.383 DEBUG:teuthology.orchestra.run.trial166:> sudo dd if=/var/lib/ceph/osd/ceph-8/fsid of=/dev/stdout 2026-02-20T18:58:17.449 DEBUG:teuthology.orchestra.run.trial166:> set -ex 2026-02-20T18:58:17.449 DEBUG:teuthology.orchestra.run.trial166:> sudo dd if=/var/lib/ceph/osd/ceph-9/fsid of=/dev/stdout 2026-02-20T18:58:17.511 DEBUG:teuthology.orchestra.run.trial166:> sudo ceph --cluster ceph osd new 92ce9555-6fcf-4f5e-a007-9167538c59c8 0 2026-02-20T18:58:17.561 INFO:tasks.ceph.mgr.x.trial166.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-20T18:58:17.561 INFO:tasks.ceph.mgr.x.trial166.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-20T18:58:17.561 INFO:tasks.ceph.mgr.x.trial166.stderr: from numpy import show_config as show_numpy_config 2026-02-20T18:58:17.657 INFO:teuthology.orchestra.run.trial166.stdout:0 2026-02-20T18:58:17.663 DEBUG:teuthology.orchestra.run.trial166:> sudo ceph --cluster ceph osd new c4cb9591-7027-4bca-a8c9-46044a72651a 1 2026-02-20T18:58:17.807 INFO:teuthology.orchestra.run.trial166.stdout:1 2026-02-20T18:58:17.815 DEBUG:teuthology.orchestra.run.trial166:> sudo ceph --cluster ceph osd new 464f1ff2-d581-48ca-b7fc-47e5e1f73f53 2 2026-02-20T18:58:17.918 INFO:teuthology.orchestra.run.trial166.stdout:2 2026-02-20T18:58:17.927 DEBUG:teuthology.orchestra.run.trial166:> sudo ceph --cluster ceph osd new 2981907b-df6b-4331-bd7e-530329b58dbd 3 2026-02-20T18:58:18.030 INFO:teuthology.orchestra.run.trial166.stdout:3 2026-02-20T18:58:18.039 DEBUG:teuthology.orchestra.run.trial166:> sudo ceph --cluster ceph osd new a116886c-d214-430c-8bd4-133b3f8b9c44 4 2026-02-20T18:58:18.143 INFO:teuthology.orchestra.run.trial166.stdout:4 2026-02-20T18:58:18.152 DEBUG:teuthology.orchestra.run.trial166:> sudo ceph --cluster ceph osd new 3cf9e90b-a16c-4bc4-a3e8-c4a3561cad76 5 2026-02-20T18:58:18.256 INFO:teuthology.orchestra.run.trial166.stdout:5 2026-02-20T18:58:18.264 DEBUG:teuthology.orchestra.run.trial166:> sudo ceph --cluster ceph osd new 48b3a52d-4c9d-41cf-bc51-5fc760c673c9 6 2026-02-20T18:58:18.368 INFO:teuthology.orchestra.run.trial166.stdout:6 2026-02-20T18:58:18.377 DEBUG:teuthology.orchestra.run.trial166:> sudo ceph --cluster ceph osd new d35fdf64-6e54-4df1-9acd-38d4fb0bf6e3 7 2026-02-20T18:58:18.481 INFO:teuthology.orchestra.run.trial166.stdout:7 2026-02-20T18:58:18.490 DEBUG:teuthology.orchestra.run.trial166:> sudo ceph --cluster ceph osd new a3864bdb-1f20-4948-92f7-b6a378ea6405 8 2026-02-20T18:58:18.595 INFO:teuthology.orchestra.run.trial166.stdout:8 2026-02-20T18:58:18.603 DEBUG:teuthology.orchestra.run.trial166:> sudo ceph --cluster ceph osd new ccd7f123-3afc-48d1-9e53-f5f501c96165 9 2026-02-20T18:58:18.708 INFO:teuthology.orchestra.run.trial166.stdout:9 2026-02-20T18:58:18.715 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-20T18:58:18.716 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-20T18:58:18.717 INFO:tasks.ceph.osd.0:Started 2026-02-20T18:58:18.717 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-20T18:58:18.717 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-02-20T18:58:18.719 INFO:tasks.ceph.osd.1:Started 2026-02-20T18:58:18.719 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-20T18:58:18.719 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2026-02-20T18:58:18.720 INFO:tasks.ceph.osd.2:Started 2026-02-20T18:58:18.721 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-20T18:58:18.721 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2026-02-20T18:58:18.722 INFO:tasks.ceph.osd.3:Started 2026-02-20T18:58:18.722 INFO:tasks.ceph.osd.4:Restarting daemon 2026-02-20T18:58:18.722 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2026-02-20T18:58:18.723 INFO:tasks.ceph.osd.4:Started 2026-02-20T18:58:18.724 INFO:tasks.ceph.osd.5:Restarting daemon 2026-02-20T18:58:18.724 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2026-02-20T18:58:18.725 INFO:tasks.ceph.osd.5:Started 2026-02-20T18:58:18.725 INFO:tasks.ceph.osd.6:Restarting daemon 2026-02-20T18:58:18.725 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2026-02-20T18:58:18.727 INFO:tasks.ceph.osd.6:Started 2026-02-20T18:58:18.727 INFO:tasks.ceph.osd.7:Restarting daemon 2026-02-20T18:58:18.727 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2026-02-20T18:58:18.728 INFO:tasks.ceph.osd.7:Started 2026-02-20T18:58:18.728 INFO:tasks.ceph.osd.8:Restarting daemon 2026-02-20T18:58:18.728 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 8 2026-02-20T18:58:18.730 INFO:tasks.ceph.osd.8:Started 2026-02-20T18:58:18.730 INFO:tasks.ceph.osd.9:Restarting daemon 2026-02-20T18:58:18.730 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 9 2026-02-20T18:58:18.731 INFO:tasks.ceph.osd.9:Started 2026-02-20T18:58:18.732 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T18:58:18.836 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:58:18.836 INFO:teuthology.orchestra.run.trial166.stdout:{"epoch":12,"fsid":"cad5469e-fabd-4bbc-8156-013ef5fb2250","created":"2026-02-20T18:58:16.652637+0000","modified":"2026-02-20T18:58:18.715356+0000","last_up_change":"0.000000","last_in_change":"2026-02-20T18:58:18.715356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":10,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"92ce9555-6fcf-4f5e-a007-9167538c59c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c4cb9591-7027-4bca-a8c9-46044a72651a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"464f1ff2-d581-48ca-b7fc-47e5e1f73f53","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2981907b-df6b-4331-bd7e-530329b58dbd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a116886c-d214-430c-8bd4-133b3f8b9c44","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3cf9e90b-a16c-4bc4-a3e8-c4a3561cad76","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"48b3a52d-4c9d-41cf-bc51-5fc760c673c9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d35fdf64-6e54-4df1-9acd-38d4fb0bf6e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"a3864bdb-1f20-4948-92f7-b6a378ea6405","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"ccd7f123-3afc-48d1-9e53-f5f501c96165","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T18:58:18.844 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-20T18:58:18.844 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-20T18:58:18.949 INFO:tasks.ceph.osd.3.trial166.stderr:2026-02-20T18:58:18.955+0000 7fe4ff01c900 -1 Falling back to public interface 2026-02-20T18:58:18.949 INFO:tasks.ceph.osd.1.trial166.stderr:2026-02-20T18:58:18.956+0000 7f9a665e0900 -1 Falling back to public interface 2026-02-20T18:58:18.957 INFO:tasks.ceph.osd.2.trial166.stderr:2026-02-20T18:58:18.963+0000 7f3fecb2d900 -1 Falling back to public interface 2026-02-20T18:58:18.957 INFO:tasks.ceph.osd.4.trial166.stderr:2026-02-20T18:58:18.963+0000 7fee7026b900 -1 Falling back to public interface 2026-02-20T18:58:18.957 INFO:tasks.ceph.osd.7.trial166.stderr:2026-02-20T18:58:18.963+0000 7f76ae222900 -1 Falling back to public interface 2026-02-20T18:58:18.958 INFO:tasks.ceph.osd.6.trial166.stderr:2026-02-20T18:58:18.963+0000 7f1ef8d2d900 -1 Falling back to public interface 2026-02-20T18:58:18.958 INFO:tasks.ceph.osd.2.trial166.stderr:2026-02-20T18:58:18.964+0000 7f3febad4640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6818/0: (98) Address already in use 2026-02-20T18:58:18.958 INFO:tasks.ceph.osd.2.trial166.stderr:2026-02-20T18:58:18.964+0000 7f3febad4640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6828/0: (98) Address already in use 2026-02-20T18:58:18.959 INFO:tasks.ceph.osd.6.trial166.stderr:2026-02-20T18:58:18.965+0000 7f1ef7cd4640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6835/0: (98) Address already in use 2026-02-20T18:58:18.962 INFO:tasks.ceph.osd.5.trial166.stderr:2026-02-20T18:58:18.969+0000 7fb3b740d900 -1 Falling back to public interface 2026-02-20T18:58:18.963 INFO:tasks.ceph.osd.9.trial166.stderr:2026-02-20T18:58:18.969+0000 7fdcb980e900 -1 Falling back to public interface 2026-02-20T18:58:18.977 INFO:tasks.ceph.osd.8.trial166.stderr:2026-02-20T18:58:18.983+0000 7f2bb2383900 -1 Falling back to public interface 2026-02-20T18:58:18.977 INFO:tasks.ceph.osd.0.trial166.stderr:2026-02-20T18:58:18.984+0000 7efc9a81b900 -1 Falling back to public interface 2026-02-20T18:58:19.315 INFO:tasks.ceph.osd.1.trial166.stderr:2026-02-20T18:58:19.321+0000 7f9a665e0900 -1 osd.1 0 log_to_monitors true 2026-02-20T18:58:19.331 INFO:tasks.ceph.osd.3.trial166.stderr:2026-02-20T18:58:19.338+0000 7fe4ff01c900 -1 osd.3 0 log_to_monitors true 2026-02-20T18:58:19.342 INFO:tasks.ceph.osd.4.trial166.stderr:2026-02-20T18:58:19.348+0000 7fee7026b900 -1 osd.4 0 log_to_monitors true 2026-02-20T18:58:19.343 INFO:tasks.ceph.osd.2.trial166.stderr:2026-02-20T18:58:19.350+0000 7f3fecb2d900 -1 osd.2 0 log_to_monitors true 2026-02-20T18:58:19.356 INFO:tasks.ceph.osd.6.trial166.stderr:2026-02-20T18:58:19.362+0000 7f1ef8d2d900 -1 osd.6 0 log_to_monitors true 2026-02-20T18:58:19.357 INFO:tasks.ceph.osd.5.trial166.stderr:2026-02-20T18:58:19.363+0000 7fb3b740d900 -1 osd.5 0 log_to_monitors true 2026-02-20T18:58:19.360 INFO:tasks.ceph.osd.9.trial166.stderr:2026-02-20T18:58:19.366+0000 7fdcb980e900 -1 osd.9 0 log_to_monitors true 2026-02-20T18:58:19.368 INFO:tasks.ceph.osd.8.trial166.stderr:2026-02-20T18:58:19.375+0000 7f2bb2383900 -1 osd.8 0 log_to_monitors true 2026-02-20T18:58:19.371 INFO:tasks.ceph.osd.0.trial166.stderr:2026-02-20T18:58:19.378+0000 7efc9a81b900 -1 osd.0 0 log_to_monitors true 2026-02-20T18:58:19.372 INFO:tasks.ceph.osd.7.trial166.stderr:2026-02-20T18:58:19.379+0000 7f76ae222900 -1 osd.7 0 log_to_monitors true 2026-02-20T18:58:19.733 INFO:tasks.ceph.mgr.x.trial166.stderr:2026-02-20T18:58:19.739+0000 7f9f1a202640 -1 mgr.server handle_report got status from non-daemon mon.a 2026-02-20T18:58:19.850 DEBUG:teuthology.orchestra.run.trial166:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-20T18:58:20.024 INFO:teuthology.misc.health.trial166.stdout: 2026-02-20T18:58:20.025 INFO:teuthology.misc.health.trial166.stdout:{"epoch":13,"fsid":"cad5469e-fabd-4bbc-8156-013ef5fb2250","created":"2026-02-20T18:58:16.652637+0000","modified":"2026-02-20T18:58:19.760993+0000","last_up_change":"0.000000","last_in_change":"2026-02-20T18:58:18.715356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":10,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"92ce9555-6fcf-4f5e-a007-9167538c59c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c4cb9591-7027-4bca-a8c9-46044a72651a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"464f1ff2-d581-48ca-b7fc-47e5e1f73f53","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2981907b-df6b-4331-bd7e-530329b58dbd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a116886c-d214-430c-8bd4-133b3f8b9c44","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3cf9e90b-a16c-4bc4-a3e8-c4a3561cad76","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"48b3a52d-4c9d-41cf-bc51-5fc760c673c9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d35fdf64-6e54-4df1-9acd-38d4fb0bf6e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"a3864bdb-1f20-4948-92f7-b6a378ea6405","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"ccd7f123-3afc-48d1-9e53-f5f501c96165","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T18:58:20.032 DEBUG:teuthology.misc:0 of 10 OSDs are up 2026-02-20T18:58:20.758 INFO:tasks.ceph.osd.4.trial166.stderr:2026-02-20T18:58:20.764+0000 7fee6c1f9640 -1 osd.4 0 waiting for initial osdmap 2026-02-20T18:58:20.758 INFO:tasks.ceph.osd.3.trial166.stderr:2026-02-20T18:58:20.764+0000 7fe4fa7c3640 -1 osd.3 0 waiting for initial osdmap 2026-02-20T18:58:20.759 INFO:tasks.ceph.osd.2.trial166.stderr:2026-02-20T18:58:20.764+0000 7f3fe8abd640 -1 osd.2 0 waiting for initial osdmap 2026-02-20T18:58:20.770 INFO:tasks.ceph.osd.7.trial166.stderr:2026-02-20T18:58:20.777+0000 7f76a99ae640 -1 osd.7 0 waiting for initial osdmap 2026-02-20T18:58:20.770 INFO:tasks.ceph.osd.9.trial166.stderr:2026-02-20T18:58:20.777+0000 7fdcb4e9b640 -1 osd.9 0 waiting for initial osdmap 2026-02-20T18:58:20.772 INFO:tasks.ceph.osd.7.trial166.stderr:2026-02-20T18:58:20.779+0000 7f76a0fac640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T18:58:20.772 INFO:tasks.ceph.osd.9.trial166.stderr:2026-02-20T18:58:20.779+0000 7fdcb04a1640 -1 osd.9 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T18:58:20.775 INFO:tasks.ceph.osd.8.trial166.stderr:2026-02-20T18:58:20.782+0000 7f2bae311640 -1 osd.8 0 waiting for initial osdmap 2026-02-20T18:58:20.775 INFO:tasks.ceph.osd.5.trial166.stderr:2026-02-20T18:58:20.782+0000 7fb3b2b74640 -1 osd.5 0 waiting for initial osdmap 2026-02-20T18:58:20.776 INFO:tasks.ceph.osd.1.trial166.stderr:2026-02-20T18:58:20.783+0000 7f9a6256e640 -1 osd.1 0 waiting for initial osdmap 2026-02-20T18:58:20.776 INFO:tasks.ceph.osd.0.trial166.stderr:2026-02-20T18:58:20.783+0000 7efc95faa640 -1 osd.0 0 waiting for initial osdmap 2026-02-20T18:58:20.777 INFO:tasks.ceph.osd.6.trial166.stderr:2026-02-20T18:58:20.783+0000 7f1ef4cbd640 -1 osd.6 0 waiting for initial osdmap 2026-02-20T18:58:20.777 INFO:tasks.ceph.osd.2.trial166.stderr:2026-02-20T18:58:20.783+0000 7f3fe00bb640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T18:58:20.777 INFO:tasks.ceph.osd.4.trial166.stderr:2026-02-20T18:58:20.783+0000 7fee677ff640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T18:58:20.778 INFO:tasks.ceph.osd.3.trial166.stderr:2026-02-20T18:58:20.783+0000 7fe4f1dc1640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T18:58:20.778 INFO:tasks.ceph.osd.8.trial166.stderr:2026-02-20T18:58:20.783+0000 7f2ba9917640 -1 osd.8 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T18:58:20.778 INFO:tasks.ceph.osd.5.trial166.stderr:2026-02-20T18:58:20.784+0000 7fb3aa172640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T18:58:20.778 INFO:tasks.ceph.osd.0.trial166.stderr:2026-02-20T18:58:20.784+0000 7efc915b0640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T18:58:20.779 INFO:tasks.ceph.osd.1.trial166.stderr:2026-02-20T18:58:20.785+0000 7f9a59b6c640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T18:58:20.779 INFO:tasks.ceph.osd.6.trial166.stderr:2026-02-20T18:58:20.785+0000 7f1ef02c3640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T18:58:27.038 DEBUG:teuthology.orchestra.run.trial166:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-20T18:58:27.212 INFO:teuthology.misc.health.trial166.stdout: 2026-02-20T18:58:27.212 INFO:teuthology.misc.health.trial166.stdout:{"epoch":15,"fsid":"cad5469e-fabd-4bbc-8156-013ef5fb2250","created":"2026-02-20T18:58:16.652637+0000","modified":"2026-02-20T18:58:21.763654+0000","last_up_change":"2026-02-20T18:58:21.763654+0000","last_in_change":"2026-02-20T18:58:18.715356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":10,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"92ce9555-6fcf-4f5e-a007-9167538c59c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6867","nonce":3847440710},{"type":"v1","addr":"10.20.193.166:6869","nonce":3847440710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6871","nonce":3847440710},{"type":"v1","addr":"10.20.193.166:6873","nonce":3847440710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6879","nonce":3847440710},{"type":"v1","addr":"10.20.193.166:6881","nonce":3847440710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6875","nonce":3847440710},{"type":"v1","addr":"10.20.193.166:6877","nonce":3847440710}]},"public_addr":"10.20.193.166:6869/3847440710","cluster_addr":"10.20.193.166:6873/3847440710","heartbeat_back_addr":"10.20.193.166:6881/3847440710","heartbeat_front_addr":"10.20.193.166:6877/3847440710","state":["exists","up"]},{"osd":1,"uuid":"c4cb9591-7027-4bca-a8c9-46044a72651a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6810","nonce":392026077},{"type":"v1","addr":"10.20.193.166:6811","nonce":392026077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6812","nonce":392026077},{"type":"v1","addr":"10.20.193.166:6813","nonce":392026077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6816","nonce":392026077},{"type":"v1","addr":"10.20.193.166:6817","nonce":392026077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6814","nonce":392026077},{"type":"v1","addr":"10.20.193.166:6815","nonce":392026077}]},"public_addr":"10.20.193.166:6811/392026077","cluster_addr":"10.20.193.166:6813/392026077","heartbeat_back_addr":"10.20.193.166:6817/392026077","heartbeat_front_addr":"10.20.193.166:6815/392026077","state":["exists","up"]},{"osd":2,"uuid":"464f1ff2-d581-48ca-b7fc-47e5e1f73f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6820","nonce":3964298921},{"type":"v1","addr":"10.20.193.166:6824","nonce":3964298921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6829","nonce":3964298921},{"type":"v1","addr":"10.20.193.166:6833","nonce":3964298921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6846","nonce":3964298921},{"type":"v1","addr":"10.20.193.166:6849","nonce":3964298921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6837","nonce":3964298921},{"type":"v1","addr":"10.20.193.166:6842","nonce":3964298921}]},"public_addr":"10.20.193.166:6824/3964298921","cluster_addr":"10.20.193.166:6833/3964298921","heartbeat_back_addr":"10.20.193.166:6849/3964298921","heartbeat_front_addr":"10.20.193.166:6842/3964298921","state":["exists","up"]},{"osd":3,"uuid":"2981907b-df6b-4331-bd7e-530329b58dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6802","nonce":1425610951},{"type":"v1","addr":"10.20.193.166:6803","nonce":1425610951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6804","nonce":1425610951},{"type":"v1","addr":"10.20.193.166:6805","nonce":1425610951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6808","nonce":1425610951},{"type":"v1","addr":"10.20.193.166:6809","nonce":1425610951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6806","nonce":1425610951},{"type":"v1","addr":"10.20.193.166:6807","nonce":1425610951}]},"public_addr":"10.20.193.166:6803/1425610951","cluster_addr":"10.20.193.166:6805/1425610951","heartbeat_back_addr":"10.20.193.166:6809/1425610951","heartbeat_front_addr":"10.20.193.166:6807/1425610951","state":["exists","up"]},{"osd":4,"uuid":"a116886c-d214-430c-8bd4-133b3f8b9c44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6818","nonce":3868831983},{"type":"v1","addr":"10.20.193.166:6822","nonce":3868831983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6826","nonce":3868831983},{"type":"v1","addr":"10.20.193.166:6830","nonce":3868831983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6841","nonce":3868831983},{"type":"v1","addr":"10.20.193.166:6844","nonce":3868831983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6834","nonce":3868831983},{"type":"v1","addr":"10.20.193.166:6838","nonce":3868831983}]},"public_addr":"10.20.193.166:6822/3868831983","cluster_addr":"10.20.193.166:6830/3868831983","heartbeat_back_addr":"10.20.193.166:6844/3868831983","heartbeat_front_addr":"10.20.193.166:6838/3868831983","state":["exists","up"]},{"osd":5,"uuid":"3cf9e90b-a16c-4bc4-a3e8-c4a3561cad76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6851","nonce":210540616},{"type":"v1","addr":"10.20.193.166:6853","nonce":210540616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6855","nonce":210540616},{"type":"v1","addr":"10.20.193.166:6858","nonce":210540616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6864","nonce":210540616},{"type":"v1","addr":"10.20.193.166:6865","nonce":210540616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6860","nonce":210540616},{"type":"v1","addr":"10.20.193.166:6862","nonce":210540616}]},"public_addr":"10.20.193.166:6853/210540616","cluster_addr":"10.20.193.166:6858/210540616","heartbeat_back_addr":"10.20.193.166:6865/210540616","heartbeat_front_addr":"10.20.193.166:6862/210540616","state":["exists","up"]},{"osd":6,"uuid":"48b3a52d-4c9d-41cf-bc51-5fc760c673c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6821","nonce":4000130133},{"type":"v1","addr":"10.20.193.166:6825","nonce":4000130133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6828","nonce":4000130133},{"type":"v1","addr":"10.20.193.166:6831","nonce":4000130133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6845","nonce":4000130133},{"type":"v1","addr":"10.20.193.166:6848","nonce":4000130133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6836","nonce":4000130133},{"type":"v1","addr":"10.20.193.166:6840","nonce":4000130133}]},"public_addr":"10.20.193.166:6825/4000130133","cluster_addr":"10.20.193.166:6831/4000130133","heartbeat_back_addr":"10.20.193.166:6848/4000130133","heartbeat_front_addr":"10.20.193.166:6840/4000130133","state":["exists","up"]},{"osd":7,"uuid":"d35fdf64-6e54-4df1-9acd-38d4fb0bf6e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6819","nonce":2437073090},{"type":"v1","addr":"10.20.193.166:6823","nonce":2437073090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6827","nonce":2437073090},{"type":"v1","addr":"10.20.193.166:6832","nonce":2437073090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6843","nonce":2437073090},{"type":"v1","addr":"10.20.193.166:6847","nonce":2437073090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6835","nonce":2437073090},{"type":"v1","addr":"10.20.193.166:6839","nonce":2437073090}]},"public_addr":"10.20.193.166:6823/2437073090","cluster_addr":"10.20.193.166:6832/2437073090","heartbeat_back_addr":"10.20.193.166:6847/2437073090","heartbeat_front_addr":"10.20.193.166:6839/2437073090","state":["exists","up"]},{"osd":8,"uuid":"a3864bdb-1f20-4948-92f7-b6a378ea6405","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6866","nonce":4074914287},{"type":"v1","addr":"10.20.193.166:6868","nonce":4074914287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6870","nonce":4074914287},{"type":"v1","addr":"10.20.193.166:6872","nonce":4074914287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6878","nonce":4074914287},{"type":"v1","addr":"10.20.193.166:6880","nonce":4074914287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6874","nonce":4074914287},{"type":"v1","addr":"10.20.193.166:6876","nonce":4074914287}]},"public_addr":"10.20.193.166:6868/4074914287","cluster_addr":"10.20.193.166:6872/4074914287","heartbeat_back_addr":"10.20.193.166:6880/4074914287","heartbeat_front_addr":"10.20.193.166:6876/4074914287","state":["exists","up"]},{"osd":9,"uuid":"ccd7f123-3afc-48d1-9e53-f5f501c96165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6850","nonce":4119295131},{"type":"v1","addr":"10.20.193.166:6852","nonce":4119295131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6854","nonce":4119295131},{"type":"v1","addr":"10.20.193.166:6856","nonce":4119295131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6861","nonce":4119295131},{"type":"v1","addr":"10.20.193.166:6863","nonce":4119295131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6857","nonce":4119295131},{"type":"v1","addr":"10.20.193.166:6859","nonce":4119295131}]},"public_addr":"10.20.193.166:6852/4119295131","cluster_addr":"10.20.193.166:6856/4119295131","heartbeat_back_addr":"10.20.193.166:6863/4119295131","heartbeat_front_addr":"10.20.193.166:6859/4119295131","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T18:58:27.220 DEBUG:teuthology.misc:10 of 10 OSDs are up 2026-02-20T18:58:27.220 INFO:tasks.ceph:Creating RBD pool 2026-02-20T18:58:27.220 DEBUG:teuthology.orchestra.run.trial166:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-20T18:58:27.799 INFO:teuthology.orchestra.run.trial166.stderr:pool 'rbd' created 2026-02-20T18:58:27.810 DEBUG:teuthology.orchestra.run.trial166:> rbd --cluster ceph pool init rbd 2026-02-20T18:58:30.810 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-20T18:58:30.811 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2026-02-20T18:58:30.811 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-20T18:58:30.990 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:58:30.998 INFO:teuthology.orchestra.run.trial166.stdout:[{"version":2,"timestamp":"2026-02-20T18:58:16.689409+0000","name":"","changes":[{"name":"mgr/mgr_pool","new_value":"false"}]}] 2026-02-20T18:58:30.999 INFO:tasks.ceph_manager:config epoch is 2 2026-02-20T18:58:30.999 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-20T18:58:30.999 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-20T18:58:30.999 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-20T18:58:31.209 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:58:31.216 INFO:teuthology.orchestra.run.trial166.stdout:{"epoch":4,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6800","nonce":1097931809},{"type":"v1","addr":"10.20.193.166:6801","nonce":1097931809}]},"active_addr":"10.20.193.166:6801/1097931809","active_change":"2026-02-20T18:58:18.736712+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[],"modules":["iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self certificates generated and signed by cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.5","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:ceph20-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:ceph20-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"how frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.166:0","nonce":2638426731}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.166:0","nonce":1916174311}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.166:0","nonce":1002090688}]}]} 2026-02-20T18:58:31.220 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-20T18:58:31.221 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-20T18:58:31.221 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T18:58:31.399 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:58:31.399 INFO:teuthology.orchestra.run.trial166.stdout:{"epoch":19,"fsid":"cad5469e-fabd-4bbc-8156-013ef5fb2250","created":"2026-02-20T18:58:16.652637+0000","modified":"2026-02-20T18:58:30.810778+0000","last_up_change":"2026-02-20T18:58:21.763654+0000","last_in_change":"2026-02-20T18:58:18.715356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":10,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-20T18:58:27.409785+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":0.89999997615814209,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1.0000001192092896,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"92ce9555-6fcf-4f5e-a007-9167538c59c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6867","nonce":3847440710},{"type":"v1","addr":"10.20.193.166:6869","nonce":3847440710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6871","nonce":3847440710},{"type":"v1","addr":"10.20.193.166:6873","nonce":3847440710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6879","nonce":3847440710},{"type":"v1","addr":"10.20.193.166:6881","nonce":3847440710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6875","nonce":3847440710},{"type":"v1","addr":"10.20.193.166:6877","nonce":3847440710}]},"public_addr":"10.20.193.166:6869/3847440710","cluster_addr":"10.20.193.166:6873/3847440710","heartbeat_back_addr":"10.20.193.166:6881/3847440710","heartbeat_front_addr":"10.20.193.166:6877/3847440710","state":["exists","up"]},{"osd":1,"uuid":"c4cb9591-7027-4bca-a8c9-46044a72651a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6810","nonce":392026077},{"type":"v1","addr":"10.20.193.166:6811","nonce":392026077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6812","nonce":392026077},{"type":"v1","addr":"10.20.193.166:6813","nonce":392026077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6816","nonce":392026077},{"type":"v1","addr":"10.20.193.166:6817","nonce":392026077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6814","nonce":392026077},{"type":"v1","addr":"10.20.193.166:6815","nonce":392026077}]},"public_addr":"10.20.193.166:6811/392026077","cluster_addr":"10.20.193.166:6813/392026077","heartbeat_back_addr":"10.20.193.166:6817/392026077","heartbeat_front_addr":"10.20.193.166:6815/392026077","state":["exists","up"]},{"osd":2,"uuid":"464f1ff2-d581-48ca-b7fc-47e5e1f73f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6820","nonce":3964298921},{"type":"v1","addr":"10.20.193.166:6824","nonce":3964298921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6829","nonce":3964298921},{"type":"v1","addr":"10.20.193.166:6833","nonce":3964298921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6846","nonce":3964298921},{"type":"v1","addr":"10.20.193.166:6849","nonce":3964298921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6837","nonce":3964298921},{"type":"v1","addr":"10.20.193.166:6842","nonce":3964298921}]},"public_addr":"10.20.193.166:6824/3964298921","cluster_addr":"10.20.193.166:6833/3964298921","heartbeat_back_addr":"10.20.193.166:6849/3964298921","heartbeat_front_addr":"10.20.193.166:6842/3964298921","state":["exists","up"]},{"osd":3,"uuid":"2981907b-df6b-4331-bd7e-530329b58dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6802","nonce":1425610951},{"type":"v1","addr":"10.20.193.166:6803","nonce":1425610951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6804","nonce":1425610951},{"type":"v1","addr":"10.20.193.166:6805","nonce":1425610951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6808","nonce":1425610951},{"type":"v1","addr":"10.20.193.166:6809","nonce":1425610951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6806","nonce":1425610951},{"type":"v1","addr":"10.20.193.166:6807","nonce":1425610951}]},"public_addr":"10.20.193.166:6803/1425610951","cluster_addr":"10.20.193.166:6805/1425610951","heartbeat_back_addr":"10.20.193.166:6809/1425610951","heartbeat_front_addr":"10.20.193.166:6807/1425610951","state":["exists","up"]},{"osd":4,"uuid":"a116886c-d214-430c-8bd4-133b3f8b9c44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6818","nonce":3868831983},{"type":"v1","addr":"10.20.193.166:6822","nonce":3868831983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6826","nonce":3868831983},{"type":"v1","addr":"10.20.193.166:6830","nonce":3868831983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6841","nonce":3868831983},{"type":"v1","addr":"10.20.193.166:6844","nonce":3868831983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6834","nonce":3868831983},{"type":"v1","addr":"10.20.193.166:6838","nonce":3868831983}]},"public_addr":"10.20.193.166:6822/3868831983","cluster_addr":"10.20.193.166:6830/3868831983","heartbeat_back_addr":"10.20.193.166:6844/3868831983","heartbeat_front_addr":"10.20.193.166:6838/3868831983","state":["exists","up"]},{"osd":5,"uuid":"3cf9e90b-a16c-4bc4-a3e8-c4a3561cad76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6851","nonce":210540616},{"type":"v1","addr":"10.20.193.166:6853","nonce":210540616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6855","nonce":210540616},{"type":"v1","addr":"10.20.193.166:6858","nonce":210540616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6864","nonce":210540616},{"type":"v1","addr":"10.20.193.166:6865","nonce":210540616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6860","nonce":210540616},{"type":"v1","addr":"10.20.193.166:6862","nonce":210540616}]},"public_addr":"10.20.193.166:6853/210540616","cluster_addr":"10.20.193.166:6858/210540616","heartbeat_back_addr":"10.20.193.166:6865/210540616","heartbeat_front_addr":"10.20.193.166:6862/210540616","state":["exists","up"]},{"osd":6,"uuid":"48b3a52d-4c9d-41cf-bc51-5fc760c673c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6821","nonce":4000130133},{"type":"v1","addr":"10.20.193.166:6825","nonce":4000130133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6828","nonce":4000130133},{"type":"v1","addr":"10.20.193.166:6831","nonce":4000130133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6845","nonce":4000130133},{"type":"v1","addr":"10.20.193.166:6848","nonce":4000130133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6836","nonce":4000130133},{"type":"v1","addr":"10.20.193.166:6840","nonce":4000130133}]},"public_addr":"10.20.193.166:6825/4000130133","cluster_addr":"10.20.193.166:6831/4000130133","heartbeat_back_addr":"10.20.193.166:6848/4000130133","heartbeat_front_addr":"10.20.193.166:6840/4000130133","state":["exists","up"]},{"osd":7,"uuid":"d35fdf64-6e54-4df1-9acd-38d4fb0bf6e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6819","nonce":2437073090},{"type":"v1","addr":"10.20.193.166:6823","nonce":2437073090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6827","nonce":2437073090},{"type":"v1","addr":"10.20.193.166:6832","nonce":2437073090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6843","nonce":2437073090},{"type":"v1","addr":"10.20.193.166:6847","nonce":2437073090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6835","nonce":2437073090},{"type":"v1","addr":"10.20.193.166:6839","nonce":2437073090}]},"public_addr":"10.20.193.166:6823/2437073090","cluster_addr":"10.20.193.166:6832/2437073090","heartbeat_back_addr":"10.20.193.166:6847/2437073090","heartbeat_front_addr":"10.20.193.166:6839/2437073090","state":["exists","up"]},{"osd":8,"uuid":"a3864bdb-1f20-4948-92f7-b6a378ea6405","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6866","nonce":4074914287},{"type":"v1","addr":"10.20.193.166:6868","nonce":4074914287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6870","nonce":4074914287},{"type":"v1","addr":"10.20.193.166:6872","nonce":4074914287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6878","nonce":4074914287},{"type":"v1","addr":"10.20.193.166:6880","nonce":4074914287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6874","nonce":4074914287},{"type":"v1","addr":"10.20.193.166:6876","nonce":4074914287}]},"public_addr":"10.20.193.166:6868/4074914287","cluster_addr":"10.20.193.166:6872/4074914287","heartbeat_back_addr":"10.20.193.166:6880/4074914287","heartbeat_front_addr":"10.20.193.166:6876/4074914287","state":["exists","up"]},{"osd":9,"uuid":"ccd7f123-3afc-48d1-9e53-f5f501c96165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6850","nonce":4119295131},{"type":"v1","addr":"10.20.193.166:6852","nonce":4119295131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6854","nonce":4119295131},{"type":"v1","addr":"10.20.193.166:6856","nonce":4119295131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6861","nonce":4119295131},{"type":"v1","addr":"10.20.193.166:6863","nonce":4119295131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6857","nonce":4119295131},{"type":"v1","addr":"10.20.193.166:6859","nonce":4119295131}]},"public_addr":"10.20.193.166:6852/4119295131","cluster_addr":"10.20.193.166:6856/4119295131","heartbeat_back_addr":"10.20.193.166:6863/4119295131","heartbeat_front_addr":"10.20.193.166:6859/4119295131","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T18:58:20.409665+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T18:58:20.290561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T18:58:20.328680+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T18:58:20.389212+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T18:58:20.373929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T18:58:20.322523+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T18:58:20.357584+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T18:58:20.389930+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T18:58:20.375293+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T18:58:20.320301+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T18:58:31.407 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-20T18:58:31.408 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T18:58:31.586 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:58:31.587 INFO:teuthology.orchestra.run.trial166.stdout:{"epoch":19,"fsid":"cad5469e-fabd-4bbc-8156-013ef5fb2250","created":"2026-02-20T18:58:16.652637+0000","modified":"2026-02-20T18:58:30.810778+0000","last_up_change":"2026-02-20T18:58:21.763654+0000","last_in_change":"2026-02-20T18:58:18.715356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":10,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-20T18:58:27.409785+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":0.89999997615814209,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1.0000001192092896,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"92ce9555-6fcf-4f5e-a007-9167538c59c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6867","nonce":3847440710},{"type":"v1","addr":"10.20.193.166:6869","nonce":3847440710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6871","nonce":3847440710},{"type":"v1","addr":"10.20.193.166:6873","nonce":3847440710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6879","nonce":3847440710},{"type":"v1","addr":"10.20.193.166:6881","nonce":3847440710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6875","nonce":3847440710},{"type":"v1","addr":"10.20.193.166:6877","nonce":3847440710}]},"public_addr":"10.20.193.166:6869/3847440710","cluster_addr":"10.20.193.166:6873/3847440710","heartbeat_back_addr":"10.20.193.166:6881/3847440710","heartbeat_front_addr":"10.20.193.166:6877/3847440710","state":["exists","up"]},{"osd":1,"uuid":"c4cb9591-7027-4bca-a8c9-46044a72651a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6810","nonce":392026077},{"type":"v1","addr":"10.20.193.166:6811","nonce":392026077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6812","nonce":392026077},{"type":"v1","addr":"10.20.193.166:6813","nonce":392026077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6816","nonce":392026077},{"type":"v1","addr":"10.20.193.166:6817","nonce":392026077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6814","nonce":392026077},{"type":"v1","addr":"10.20.193.166:6815","nonce":392026077}]},"public_addr":"10.20.193.166:6811/392026077","cluster_addr":"10.20.193.166:6813/392026077","heartbeat_back_addr":"10.20.193.166:6817/392026077","heartbeat_front_addr":"10.20.193.166:6815/392026077","state":["exists","up"]},{"osd":2,"uuid":"464f1ff2-d581-48ca-b7fc-47e5e1f73f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6820","nonce":3964298921},{"type":"v1","addr":"10.20.193.166:6824","nonce":3964298921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6829","nonce":3964298921},{"type":"v1","addr":"10.20.193.166:6833","nonce":3964298921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6846","nonce":3964298921},{"type":"v1","addr":"10.20.193.166:6849","nonce":3964298921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6837","nonce":3964298921},{"type":"v1","addr":"10.20.193.166:6842","nonce":3964298921}]},"public_addr":"10.20.193.166:6824/3964298921","cluster_addr":"10.20.193.166:6833/3964298921","heartbeat_back_addr":"10.20.193.166:6849/3964298921","heartbeat_front_addr":"10.20.193.166:6842/3964298921","state":["exists","up"]},{"osd":3,"uuid":"2981907b-df6b-4331-bd7e-530329b58dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6802","nonce":1425610951},{"type":"v1","addr":"10.20.193.166:6803","nonce":1425610951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6804","nonce":1425610951},{"type":"v1","addr":"10.20.193.166:6805","nonce":1425610951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6808","nonce":1425610951},{"type":"v1","addr":"10.20.193.166:6809","nonce":1425610951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6806","nonce":1425610951},{"type":"v1","addr":"10.20.193.166:6807","nonce":1425610951}]},"public_addr":"10.20.193.166:6803/1425610951","cluster_addr":"10.20.193.166:6805/1425610951","heartbeat_back_addr":"10.20.193.166:6809/1425610951","heartbeat_front_addr":"10.20.193.166:6807/1425610951","state":["exists","up"]},{"osd":4,"uuid":"a116886c-d214-430c-8bd4-133b3f8b9c44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6818","nonce":3868831983},{"type":"v1","addr":"10.20.193.166:6822","nonce":3868831983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6826","nonce":3868831983},{"type":"v1","addr":"10.20.193.166:6830","nonce":3868831983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6841","nonce":3868831983},{"type":"v1","addr":"10.20.193.166:6844","nonce":3868831983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6834","nonce":3868831983},{"type":"v1","addr":"10.20.193.166:6838","nonce":3868831983}]},"public_addr":"10.20.193.166:6822/3868831983","cluster_addr":"10.20.193.166:6830/3868831983","heartbeat_back_addr":"10.20.193.166:6844/3868831983","heartbeat_front_addr":"10.20.193.166:6838/3868831983","state":["exists","up"]},{"osd":5,"uuid":"3cf9e90b-a16c-4bc4-a3e8-c4a3561cad76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6851","nonce":210540616},{"type":"v1","addr":"10.20.193.166:6853","nonce":210540616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6855","nonce":210540616},{"type":"v1","addr":"10.20.193.166:6858","nonce":210540616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6864","nonce":210540616},{"type":"v1","addr":"10.20.193.166:6865","nonce":210540616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6860","nonce":210540616},{"type":"v1","addr":"10.20.193.166:6862","nonce":210540616}]},"public_addr":"10.20.193.166:6853/210540616","cluster_addr":"10.20.193.166:6858/210540616","heartbeat_back_addr":"10.20.193.166:6865/210540616","heartbeat_front_addr":"10.20.193.166:6862/210540616","state":["exists","up"]},{"osd":6,"uuid":"48b3a52d-4c9d-41cf-bc51-5fc760c673c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6821","nonce":4000130133},{"type":"v1","addr":"10.20.193.166:6825","nonce":4000130133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6828","nonce":4000130133},{"type":"v1","addr":"10.20.193.166:6831","nonce":4000130133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6845","nonce":4000130133},{"type":"v1","addr":"10.20.193.166:6848","nonce":4000130133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6836","nonce":4000130133},{"type":"v1","addr":"10.20.193.166:6840","nonce":4000130133}]},"public_addr":"10.20.193.166:6825/4000130133","cluster_addr":"10.20.193.166:6831/4000130133","heartbeat_back_addr":"10.20.193.166:6848/4000130133","heartbeat_front_addr":"10.20.193.166:6840/4000130133","state":["exists","up"]},{"osd":7,"uuid":"d35fdf64-6e54-4df1-9acd-38d4fb0bf6e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6819","nonce":2437073090},{"type":"v1","addr":"10.20.193.166:6823","nonce":2437073090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6827","nonce":2437073090},{"type":"v1","addr":"10.20.193.166:6832","nonce":2437073090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6843","nonce":2437073090},{"type":"v1","addr":"10.20.193.166:6847","nonce":2437073090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6835","nonce":2437073090},{"type":"v1","addr":"10.20.193.166:6839","nonce":2437073090}]},"public_addr":"10.20.193.166:6823/2437073090","cluster_addr":"10.20.193.166:6832/2437073090","heartbeat_back_addr":"10.20.193.166:6847/2437073090","heartbeat_front_addr":"10.20.193.166:6839/2437073090","state":["exists","up"]},{"osd":8,"uuid":"a3864bdb-1f20-4948-92f7-b6a378ea6405","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6866","nonce":4074914287},{"type":"v1","addr":"10.20.193.166:6868","nonce":4074914287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6870","nonce":4074914287},{"type":"v1","addr":"10.20.193.166:6872","nonce":4074914287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6878","nonce":4074914287},{"type":"v1","addr":"10.20.193.166:6880","nonce":4074914287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6874","nonce":4074914287},{"type":"v1","addr":"10.20.193.166:6876","nonce":4074914287}]},"public_addr":"10.20.193.166:6868/4074914287","cluster_addr":"10.20.193.166:6872/4074914287","heartbeat_back_addr":"10.20.193.166:6880/4074914287","heartbeat_front_addr":"10.20.193.166:6876/4074914287","state":["exists","up"]},{"osd":9,"uuid":"ccd7f123-3afc-48d1-9e53-f5f501c96165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6850","nonce":4119295131},{"type":"v1","addr":"10.20.193.166:6852","nonce":4119295131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6854","nonce":4119295131},{"type":"v1","addr":"10.20.193.166:6856","nonce":4119295131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6861","nonce":4119295131},{"type":"v1","addr":"10.20.193.166:6863","nonce":4119295131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6857","nonce":4119295131},{"type":"v1","addr":"10.20.193.166:6859","nonce":4119295131}]},"public_addr":"10.20.193.166:6852/4119295131","cluster_addr":"10.20.193.166:6856/4119295131","heartbeat_back_addr":"10.20.193.166:6863/4119295131","heartbeat_front_addr":"10.20.193.166:6859/4119295131","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T18:58:20.409665+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T18:58:20.290561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T18:58:20.328680+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T18:58:20.389212+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T18:58:20.373929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T18:58:20.322523+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T18:58:20.357584+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T18:58:20.389930+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T18:58:20.375293+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T18:58:20.320301+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T18:58:31.596 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-20T18:58:31.597 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-20T18:58:31.598 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-20T18:58:31.598 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-20T18:58:31.599 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2026-02-20T18:58:31.599 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2026-02-20T18:58:31.600 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2026-02-20T18:58:31.600 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2026-02-20T18:58:31.600 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 flush_pg_stats 2026-02-20T18:58:31.601 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 flush_pg_stats 2026-02-20T18:58:31.697 INFO:teuthology.orchestra.run.trial166.stdout:64424509444 2026-02-20T18:58:31.698 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-20T18:58:31.700 INFO:teuthology.orchestra.run.trial166.stdout:64424509444 2026-02-20T18:58:31.701 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2026-02-20T18:58:31.702 INFO:teuthology.orchestra.run.trial166.stdout:64424509443 2026-02-20T18:58:31.702 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-20T18:58:31.703 INFO:teuthology.orchestra.run.trial166.stdout:64424509444 2026-02-20T18:58:31.704 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-20T18:58:31.705 INFO:teuthology.orchestra.run.trial166.stdout:64424509443 2026-02-20T18:58:31.706 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2026-02-20T18:58:31.707 INFO:teuthology.orchestra.run.trial166.stdout:64424509444 2026-02-20T18:58:31.708 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-20T18:58:31.716 INFO:teuthology.orchestra.run.trial166.stdout:64424509444 2026-02-20T18:58:31.716 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-20T18:58:31.718 INFO:teuthology.orchestra.run.trial166.stdout:64424509444 2026-02-20T18:58:31.719 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-20T18:58:31.720 INFO:teuthology.orchestra.run.trial166.stdout:64424509444 2026-02-20T18:58:31.721 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2026-02-20T18:58:31.721 INFO:teuthology.orchestra.run.trial166.stdout:64424509444 2026-02-20T18:58:31.722 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2026-02-20T18:58:31.900 INFO:teuthology.orchestra.run.trial166.stdout:64424509443 2026-02-20T18:58:31.902 INFO:teuthology.orchestra.run.trial166.stdout:64424509443 2026-02-20T18:58:31.907 INFO:teuthology.orchestra.run.trial166.stdout:64424509443 2026-02-20T18:58:31.908 INFO:teuthology.orchestra.run.trial166.stdout:64424509442 2026-02-20T18:58:31.912 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.2 2026-02-20T18:58:31.912 INFO:teuthology.orchestra.run.trial166.stdout:64424509442 2026-02-20T18:58:31.914 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.7 2026-02-20T18:58:31.919 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.3 2026-02-20T18:58:31.920 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509442 for osd.4 2026-02-20T18:58:31.923 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509442 for osd.6 2026-02-20T18:58:31.927 INFO:teuthology.orchestra.run.trial166.stdout:64424509443 2026-02-20T18:58:31.929 INFO:teuthology.orchestra.run.trial166.stdout:64424509443 2026-02-20T18:58:31.939 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.5 2026-02-20T18:58:31.940 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.0 2026-02-20T18:58:31.957 INFO:teuthology.orchestra.run.trial166.stdout:64424509443 2026-02-20T18:58:31.957 INFO:teuthology.orchestra.run.trial166.stdout:64424509443 2026-02-20T18:58:31.964 INFO:teuthology.orchestra.run.trial166.stdout:64424509443 2026-02-20T18:58:31.968 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.8 2026-02-20T18:58:31.969 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.9 2026-02-20T18:58:31.975 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.1 2026-02-20T18:58:32.912 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-20T18:58:32.915 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2026-02-20T18:58:32.920 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-20T18:58:32.921 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-20T18:58:32.924 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2026-02-20T18:58:32.939 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-20T18:58:32.942 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-20T18:58:32.968 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2026-02-20T18:58:32.969 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2026-02-20T18:58:32.976 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-20T18:58:33.108 INFO:teuthology.orchestra.run.trial166.stdout:64424509445 2026-02-20T18:58:33.112 INFO:teuthology.orchestra.run.trial166.stdout:64424509444 2026-02-20T18:58:33.120 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509445 for osd.7 2026-02-20T18:58:33.121 DEBUG:teuthology.parallel:result is None 2026-02-20T18:58:33.122 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509444 for osd.2 2026-02-20T18:58:33.122 DEBUG:teuthology.parallel:result is None 2026-02-20T18:58:33.156 INFO:teuthology.orchestra.run.trial166.stdout:64424509444 2026-02-20T18:58:33.157 INFO:teuthology.orchestra.run.trial166.stdout:64424509445 2026-02-20T18:58:33.157 INFO:teuthology.orchestra.run.trial166.stdout:64424509445 2026-02-20T18:58:33.161 INFO:teuthology.orchestra.run.trial166.stdout:64424509444 2026-02-20T18:58:33.167 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509444 for osd.3 2026-02-20T18:58:33.167 DEBUG:teuthology.parallel:result is None 2026-02-20T18:58:33.169 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509445 for osd.5 2026-02-20T18:58:33.169 DEBUG:teuthology.parallel:result is None 2026-02-20T18:58:33.170 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509445 for osd.0 2026-02-20T18:58:33.170 INFO:teuthology.orchestra.run.trial166.stdout:64424509443 2026-02-20T18:58:33.170 DEBUG:teuthology.parallel:result is None 2026-02-20T18:58:33.173 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509444 for osd.6 2026-02-20T18:58:33.173 DEBUG:teuthology.parallel:result is None 2026-02-20T18:58:33.180 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509443 for osd.4 2026-02-20T18:58:33.181 DEBUG:teuthology.parallel:result is None 2026-02-20T18:58:33.197 INFO:teuthology.orchestra.run.trial166.stdout:64424509445 2026-02-20T18:58:33.200 INFO:teuthology.orchestra.run.trial166.stdout:64424509445 2026-02-20T18:58:33.204 INFO:teuthology.orchestra.run.trial166.stdout:64424509445 2026-02-20T18:58:33.209 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509445 for osd.9 2026-02-20T18:58:33.209 DEBUG:teuthology.parallel:result is None 2026-02-20T18:58:33.213 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509445 for osd.8 2026-02-20T18:58:33.214 DEBUG:teuthology.parallel:result is None 2026-02-20T18:58:33.215 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509445 for osd.1 2026-02-20T18:58:33.215 DEBUG:teuthology.parallel:result is None 2026-02-20T18:58:33.216 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-20T18:58:33.216 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T18:58:33.431 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:58:33.431 INFO:teuthology.orchestra.run.trial166.stderr:dumped all 2026-02-20T18:58:33.440 INFO:teuthology.orchestra.run.trial166.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2026-02-20T18:58:32.740650+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":9,"kb":1048576000,"kb_used":271408,"kb_used_data":1808,"kb_used_omap":63,"kb_used_meta":269376,"kb_avail":1048304592,"statfs":{"total":1073741824000,"available":1073463902208,"internally_reserved":0,"allocated":1851392,"data_stored":601678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":64995,"internal_metadata":275841565},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-20T18:58:30.842940+0000","last_change":"2026-02-20T18:58:30.842940+0000","last_active":"2026-02-20T18:58:30.842940+0000","last_peered":"2026-02-20T18:58:30.842940+0000","last_clean":"2026-02-20T18:58:30.842940+0000","last_became_active":"2026-02-20T18:58:28.811768+0000","last_became_peered":"2026-02-20T18:58:28.811768+0000","last_unstale":"2026-02-20T18:58:30.842940+0000","last_undegraded":"2026-02-20T18:58:30.842940+0000","last_fullsized":"2026-02-20T18:58:30.842940+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T06:18:49.999634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000220731,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-20T18:58:30.842925+0000","last_change":"2026-02-20T18:58:30.842925+0000","last_active":"2026-02-20T18:58:30.842925+0000","last_peered":"2026-02-20T18:58:30.842925+0000","last_clean":"2026-02-20T18:58:30.842925+0000","last_became_active":"2026-02-20T18:58:29.350637+0000","last_became_peered":"2026-02-20T18:58:29.350637+0000","last_unstale":"2026-02-20T18:58:30.842925+0000","last_undegraded":"2026-02-20T18:58:30.842925+0000","last_fullsized":"2026-02-20T18:58:30.842925+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:50:33.527643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021133299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9],"acting":[6,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-20T18:58:30.842861+0000","last_change":"2026-02-20T18:58:30.842861+0000","last_active":"2026-02-20T18:58:30.842861+0000","last_peered":"2026-02-20T18:58:30.842861+0000","last_clean":"2026-02-20T18:58:30.842861+0000","last_became_active":"2026-02-20T18:58:28.811795+0000","last_became_peered":"2026-02-20T18:58:28.811795+0000","last_unstale":"2026-02-20T18:58:30.842861+0000","last_undegraded":"2026-02-20T18:58:30.842861+0000","last_fullsized":"2026-02-20T18:58:30.842861+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:50:33.527643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000249194,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-20T18:58:30.812754+0000","last_change":"2026-02-20T18:58:30.812754+0000","last_active":"2026-02-20T18:58:30.812754+0000","last_peered":"2026-02-20T18:58:30.812754+0000","last_clean":"2026-02-20T18:58:30.812754+0000","last_became_active":"2026-02-20T18:58:28.811707+0000","last_became_peered":"2026-02-20T18:58:28.811707+0000","last_unstale":"2026-02-20T18:58:30.812754+0000","last_undegraded":"2026-02-20T18:58:30.812754+0000","last_fullsized":"2026-02-20T18:58:30.812754+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:03:29.581497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021416800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.3","version":"17'1","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-20T18:58:30.842913+0000","last_change":"2026-02-20T18:58:30.842913+0000","last_active":"2026-02-20T18:58:30.842913+0000","last_peered":"2026-02-20T18:58:30.842913+0000","last_clean":"2026-02-20T18:58:30.842913+0000","last_became_active":"2026-02-20T18:58:29.156343+0000","last_became_peered":"2026-02-20T18:58:29.156343+0000","last_unstale":"2026-02-20T18:58:30.842913+0000","last_undegraded":"2026-02-20T18:58:30.842913+0000","last_fullsized":"2026-02-20T18:58:30.842913+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T06:18:49.999634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031905300000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.2","version":"19'2","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-20T18:58:30.814147+0000","last_change":"2026-02-20T18:58:30.813830+0000","last_active":"2026-02-20T18:58:30.814147+0000","last_peered":"2026-02-20T18:58:30.814147+0000","last_clean":"2026-02-20T18:58:30.814147+0000","last_became_active":"2026-02-20T18:58:28.811814+0000","last_became_peered":"2026-02-20T18:58:28.811814+0000","last_unstale":"2026-02-20T18:58:30.814147+0000","last_undegraded":"2026-02-20T18:58:30.814147+0000","last_fullsized":"2026-02-20T18:58:30.814147+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T06:12:36.945291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000423428,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.1","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-20T18:58:30.842844+0000","last_change":"2026-02-20T18:58:30.842844+0000","last_active":"2026-02-20T18:58:30.842844+0000","last_peered":"2026-02-20T18:58:30.842844+0000","last_clean":"2026-02-20T18:58:30.842844+0000","last_became_active":"2026-02-20T18:58:28.811556+0000","last_became_peered":"2026-02-20T18:58:28.811556+0000","last_unstale":"2026-02-20T18:58:30.842844+0000","last_undegraded":"2026-02-20T18:58:30.842844+0000","last_fullsized":"2026-02-20T18:58:30.842844+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:33:22.141040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025154799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8],"acting":[5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-20T18:58:30.842957+0000","last_change":"2026-02-20T18:58:30.842957+0000","last_active":"2026-02-20T18:58:30.842957+0000","last_peered":"2026-02-20T18:58:30.842957+0000","last_clean":"2026-02-20T18:58:30.842957+0000","last_became_active":"2026-02-20T18:58:28.811743+0000","last_became_peered":"2026-02-20T18:58:28.811743+0000","last_unstale":"2026-02-20T18:58:30.842957+0000","last_undegraded":"2026-02-20T18:58:30.842957+0000","last_fullsized":"2026-02-20T18:58:30.842957+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T06:12:36.945291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00020400999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27140,"kb_used_data":180,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830460,"statfs":{"total":107374182400,"available":107346391040,"internally_reserved":0,"allocated":184320,"data_stored":60164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6829,"internal_metadata":27583827},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":15,"seq":64424509445,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27140,"kb_used_data":180,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830460,"statfs":{"total":107374182400,"available":107346391040,"internally_reserved":0,"allocated":184320,"data_stored":60164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6824,"internal_metadata":27583832},"hb_peers":[0,1,2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27144,"kb_used_data":184,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830456,"statfs":{"total":107374182400,"available":107346386944,"internally_reserved":0,"allocated":188416,"data_stored":60183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6820,"internal_metadata":27583836},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27140,"kb_used_data":180,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830460,"statfs":{"total":107374182400,"available":107346391040,"internally_reserved":0,"allocated":184320,"data_stored":60164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6824,"internal_metadata":27583832},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27140,"kb_used_data":180,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830460,"statfs":{"total":107374182400,"available":107346391040,"internally_reserved":0,"allocated":184320,"data_stored":60164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6825,"internal_metadata":27583831},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509443,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27140,"kb_used_data":180,"kb_used_omap":4,"kb_used_meta":26939,"kb_avail":104830460,"statfs":{"total":107374182400,"available":107346391040,"internally_reserved":0,"allocated":184320,"data_stored":60164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4875,"internal_metadata":27585781},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27140,"kb_used_data":180,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830460,"statfs":{"total":107374182400,"available":107346391040,"internally_reserved":0,"allocated":184320,"data_stored":60164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6173,"internal_metadata":27584483},"hb_peers":[0,1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27140,"kb_used_data":180,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830460,"statfs":{"total":107374182400,"available":107346391040,"internally_reserved":0,"allocated":184320,"data_stored":60164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6825,"internal_metadata":27583831},"hb_peers":[0,1,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27140,"kb_used_data":180,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830460,"statfs":{"total":107374182400,"available":107346391040,"internally_reserved":0,"allocated":184320,"data_stored":60164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6175,"internal_metadata":27584481},"hb_peers":[0,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27144,"kb_used_data":184,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830456,"statfs":{"total":107374182400,"available":107346386944,"internally_reserved":0,"allocated":188416,"data_stored":60183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6825,"internal_metadata":27583831},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T18:58:33.442 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T18:58:33.621 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:58:33.621 INFO:teuthology.orchestra.run.trial166.stderr:dumped all 2026-02-20T18:58:33.630 INFO:teuthology.orchestra.run.trial166.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2026-02-20T18:58:32.740650+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":9,"kb":1048576000,"kb_used":271408,"kb_used_data":1808,"kb_used_omap":63,"kb_used_meta":269376,"kb_avail":1048304592,"statfs":{"total":1073741824000,"available":1073463902208,"internally_reserved":0,"allocated":1851392,"data_stored":601678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":64995,"internal_metadata":275841565},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-20T18:58:30.842940+0000","last_change":"2026-02-20T18:58:30.842940+0000","last_active":"2026-02-20T18:58:30.842940+0000","last_peered":"2026-02-20T18:58:30.842940+0000","last_clean":"2026-02-20T18:58:30.842940+0000","last_became_active":"2026-02-20T18:58:28.811768+0000","last_became_peered":"2026-02-20T18:58:28.811768+0000","last_unstale":"2026-02-20T18:58:30.842940+0000","last_undegraded":"2026-02-20T18:58:30.842940+0000","last_fullsized":"2026-02-20T18:58:30.842940+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T06:18:49.999634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000220731,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-20T18:58:30.842925+0000","last_change":"2026-02-20T18:58:30.842925+0000","last_active":"2026-02-20T18:58:30.842925+0000","last_peered":"2026-02-20T18:58:30.842925+0000","last_clean":"2026-02-20T18:58:30.842925+0000","last_became_active":"2026-02-20T18:58:29.350637+0000","last_became_peered":"2026-02-20T18:58:29.350637+0000","last_unstale":"2026-02-20T18:58:30.842925+0000","last_undegraded":"2026-02-20T18:58:30.842925+0000","last_fullsized":"2026-02-20T18:58:30.842925+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:50:33.527643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021133299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9],"acting":[6,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-20T18:58:30.842861+0000","last_change":"2026-02-20T18:58:30.842861+0000","last_active":"2026-02-20T18:58:30.842861+0000","last_peered":"2026-02-20T18:58:30.842861+0000","last_clean":"2026-02-20T18:58:30.842861+0000","last_became_active":"2026-02-20T18:58:28.811795+0000","last_became_peered":"2026-02-20T18:58:28.811795+0000","last_unstale":"2026-02-20T18:58:30.842861+0000","last_undegraded":"2026-02-20T18:58:30.842861+0000","last_fullsized":"2026-02-20T18:58:30.842861+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:50:33.527643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000249194,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-20T18:58:30.812754+0000","last_change":"2026-02-20T18:58:30.812754+0000","last_active":"2026-02-20T18:58:30.812754+0000","last_peered":"2026-02-20T18:58:30.812754+0000","last_clean":"2026-02-20T18:58:30.812754+0000","last_became_active":"2026-02-20T18:58:28.811707+0000","last_became_peered":"2026-02-20T18:58:28.811707+0000","last_unstale":"2026-02-20T18:58:30.812754+0000","last_undegraded":"2026-02-20T18:58:30.812754+0000","last_fullsized":"2026-02-20T18:58:30.812754+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:03:29.581497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021416800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.3","version":"17'1","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-20T18:58:30.842913+0000","last_change":"2026-02-20T18:58:30.842913+0000","last_active":"2026-02-20T18:58:30.842913+0000","last_peered":"2026-02-20T18:58:30.842913+0000","last_clean":"2026-02-20T18:58:30.842913+0000","last_became_active":"2026-02-20T18:58:29.156343+0000","last_became_peered":"2026-02-20T18:58:29.156343+0000","last_unstale":"2026-02-20T18:58:30.842913+0000","last_undegraded":"2026-02-20T18:58:30.842913+0000","last_fullsized":"2026-02-20T18:58:30.842913+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T06:18:49.999634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031905300000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.2","version":"19'2","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-20T18:58:30.814147+0000","last_change":"2026-02-20T18:58:30.813830+0000","last_active":"2026-02-20T18:58:30.814147+0000","last_peered":"2026-02-20T18:58:30.814147+0000","last_clean":"2026-02-20T18:58:30.814147+0000","last_became_active":"2026-02-20T18:58:28.811814+0000","last_became_peered":"2026-02-20T18:58:28.811814+0000","last_unstale":"2026-02-20T18:58:30.814147+0000","last_undegraded":"2026-02-20T18:58:30.814147+0000","last_fullsized":"2026-02-20T18:58:30.814147+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T06:12:36.945291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000423428,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.1","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-20T18:58:30.842844+0000","last_change":"2026-02-20T18:58:30.842844+0000","last_active":"2026-02-20T18:58:30.842844+0000","last_peered":"2026-02-20T18:58:30.842844+0000","last_clean":"2026-02-20T18:58:30.842844+0000","last_became_active":"2026-02-20T18:58:28.811556+0000","last_became_peered":"2026-02-20T18:58:28.811556+0000","last_unstale":"2026-02-20T18:58:30.842844+0000","last_undegraded":"2026-02-20T18:58:30.842844+0000","last_fullsized":"2026-02-20T18:58:30.842844+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:33:22.141040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025154799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8],"acting":[5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-20T18:58:30.842957+0000","last_change":"2026-02-20T18:58:30.842957+0000","last_active":"2026-02-20T18:58:30.842957+0000","last_peered":"2026-02-20T18:58:30.842957+0000","last_clean":"2026-02-20T18:58:30.842957+0000","last_became_active":"2026-02-20T18:58:28.811743+0000","last_became_peered":"2026-02-20T18:58:28.811743+0000","last_unstale":"2026-02-20T18:58:30.842957+0000","last_undegraded":"2026-02-20T18:58:30.842957+0000","last_fullsized":"2026-02-20T18:58:30.842957+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T06:12:36.945291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00020400999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27140,"kb_used_data":180,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830460,"statfs":{"total":107374182400,"available":107346391040,"internally_reserved":0,"allocated":184320,"data_stored":60164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6829,"internal_metadata":27583827},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":15,"seq":64424509445,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27140,"kb_used_data":180,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830460,"statfs":{"total":107374182400,"available":107346391040,"internally_reserved":0,"allocated":184320,"data_stored":60164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6824,"internal_metadata":27583832},"hb_peers":[0,1,2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27144,"kb_used_data":184,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830456,"statfs":{"total":107374182400,"available":107346386944,"internally_reserved":0,"allocated":188416,"data_stored":60183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6820,"internal_metadata":27583836},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27140,"kb_used_data":180,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830460,"statfs":{"total":107374182400,"available":107346391040,"internally_reserved":0,"allocated":184320,"data_stored":60164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6824,"internal_metadata":27583832},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27140,"kb_used_data":180,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830460,"statfs":{"total":107374182400,"available":107346391040,"internally_reserved":0,"allocated":184320,"data_stored":60164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6825,"internal_metadata":27583831},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509443,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27140,"kb_used_data":180,"kb_used_omap":4,"kb_used_meta":26939,"kb_avail":104830460,"statfs":{"total":107374182400,"available":107346391040,"internally_reserved":0,"allocated":184320,"data_stored":60164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4875,"internal_metadata":27585781},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27140,"kb_used_data":180,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830460,"statfs":{"total":107374182400,"available":107346391040,"internally_reserved":0,"allocated":184320,"data_stored":60164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6173,"internal_metadata":27584483},"hb_peers":[0,1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27140,"kb_used_data":180,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830460,"statfs":{"total":107374182400,"available":107346391040,"internally_reserved":0,"allocated":184320,"data_stored":60164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6825,"internal_metadata":27583831},"hb_peers":[0,1,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27140,"kb_used_data":180,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830460,"statfs":{"total":107374182400,"available":107346391040,"internally_reserved":0,"allocated":184320,"data_stored":60164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6175,"internal_metadata":27584481},"hb_peers":[0,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27144,"kb_used_data":184,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830456,"statfs":{"total":107374182400,"available":107346386944,"internally_reserved":0,"allocated":188416,"data_stored":60183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6825,"internal_metadata":27583831},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T18:58:33.631 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-20T18:58:33.631 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-20T18:58:33.632 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-20T18:58:33.632 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-20T18:58:33.834 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:58:33.834 INFO:teuthology.orchestra.run.trial166.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-20T18:58:33.843 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-20T18:58:33.844 INFO:teuthology.run_tasks:Running task workunit... 2026-02-20T18:58:33.857 INFO:tasks.workunit:Pulling workunits from ref f7870454149f22574086dd2ff55d050585136531 2026-02-20T18:58:33.858 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-20T18:58:33.858 INFO:tasks.workunit:timeout=3h 2026-02-20T18:58:33.858 INFO:tasks.workunit:cleanup=True 2026-02-20T18:58:33.858 DEBUG:teuthology.orchestra.run.trial166:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-20T18:58:33.874 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T18:58:33.875 INFO:teuthology.orchestra.run.trial166.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-20T18:58:33.875 DEBUG:teuthology.orchestra.run.trial166:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-20T18:58:33.930 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-20T18:58:33.931 DEBUG:teuthology.orchestra.run.trial166:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-20T18:58:33.986 DEBUG:teuthology.orchestra.run.trial166:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout f7870454149f22574086dd2ff55d050585136531 2026-02-20T18:58:34.050 INFO:tasks.workunit.client.0.trial166.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-20T18:58:54.612 INFO:tasks.workunit.client.0.trial166.stderr:Note: switching to 'f7870454149f22574086dd2ff55d050585136531'. 2026-02-20T18:58:54.613 INFO:tasks.workunit.client.0.trial166.stderr: 2026-02-20T18:58:54.613 INFO:tasks.workunit.client.0.trial166.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-20T18:58:54.613 INFO:tasks.workunit.client.0.trial166.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-20T18:58:54.613 INFO:tasks.workunit.client.0.trial166.stderr:state without impacting any branches by switching back to a branch. 2026-02-20T18:58:54.613 INFO:tasks.workunit.client.0.trial166.stderr: 2026-02-20T18:58:54.613 INFO:tasks.workunit.client.0.trial166.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-20T18:58:54.613 INFO:tasks.workunit.client.0.trial166.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-20T18:58:54.613 INFO:tasks.workunit.client.0.trial166.stderr: 2026-02-20T18:58:54.613 INFO:tasks.workunit.client.0.trial166.stderr: git switch -c 2026-02-20T18:58:54.613 INFO:tasks.workunit.client.0.trial166.stderr: 2026-02-20T18:58:54.613 INFO:tasks.workunit.client.0.trial166.stderr:Or undo this operation with: 2026-02-20T18:58:54.613 INFO:tasks.workunit.client.0.trial166.stderr: 2026-02-20T18:58:54.613 INFO:tasks.workunit.client.0.trial166.stderr: git switch - 2026-02-20T18:58:54.613 INFO:tasks.workunit.client.0.trial166.stderr: 2026-02-20T18:58:54.613 INFO:tasks.workunit.client.0.trial166.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-20T18:58:54.613 INFO:tasks.workunit.client.0.trial166.stderr: 2026-02-20T18:58:54.613 INFO:tasks.workunit.client.0.trial166.stderr:HEAD is now at f7870454149 ceph-dev-pipeline: configure 2026-02-20T18:58:54.620 DEBUG:teuthology.orchestra.run.trial166:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-20T18:58:54.677 INFO:tasks.workunit.client.0.trial166.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2026-02-20T18:58:54.679 INFO:tasks.workunit.client.0.trial166.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-20T18:58:54.679 INFO:tasks.workunit.client.0.trial166.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2026-02-20T18:58:54.767 INFO:tasks.workunit.client.0.trial166.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2026-02-20T18:58:54.799 INFO:tasks.workunit.client.0.trial166.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2026-02-20T18:58:54.825 INFO:tasks.workunit.client.0.trial166.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-20T18:58:54.826 INFO:tasks.workunit.client.0.trial166.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-20T18:58:54.826 INFO:tasks.workunit.client.0.trial166.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2026-02-20T18:58:54.849 INFO:tasks.workunit.client.0.trial166.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-20T18:58:54.853 DEBUG:teuthology.orchestra.run.trial166:> set -ex 2026-02-20T18:58:54.853 DEBUG:teuthology.orchestra.run.trial166:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-20T18:58:54.910 INFO:tasks.workunit:Running workunits matching rados/test_health_warnings.sh on client.0... 2026-02-20T18:58:54.912 INFO:tasks.workunit:Running workunit rados/test_health_warnings.sh... 2026-02-20T18:58:54.912 DEBUG:teuthology.orchestra.run.trial166:workunit test rados/test_health_warnings.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f7870454149f22574086dd2ff55d050585136531 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_health_warnings.sh 2026-02-20T18:58:54.969 INFO:tasks.workunit.client.0.trial166.stderr:+ crushtool -o crushmap --build --num_osds 10 host straw 2 rack straw 2 row straw 2 root straw 0 2026-02-20T18:58:54.981 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph osd setcrushmap -i crushmap 2026-02-20T18:58:56.803 INFO:tasks.workunit.client.0.trial166.stderr:6 2026-02-20T18:58:56.813 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph osd tree 2026-02-20T18:58:57.027 INFO:tasks.workunit.client.0.trial166.stdout:ID CLASS WEIGHT TYPE NAME STATUS REWEIGHT PRI-AFF 2026-02-20T18:58:57.028 INFO:tasks.workunit.client.0.trial166.stdout:-11 10.00000 root root 2026-02-20T18:58:57.028 INFO:tasks.workunit.client.0.trial166.stdout: -9 8.00000 row row0 2026-02-20T18:58:57.028 INFO:tasks.workunit.client.0.trial166.stdout: -6 4.00000 rack rack0 2026-02-20T18:58:57.028 INFO:tasks.workunit.client.0.trial166.stdout: -1 2.00000 host host0 2026-02-20T18:58:57.028 INFO:tasks.workunit.client.0.trial166.stdout: 0 1.00000 osd.0 up 1.00000 1.00000 2026-02-20T18:58:57.028 INFO:tasks.workunit.client.0.trial166.stdout: 1 1.00000 osd.1 up 1.00000 1.00000 2026-02-20T18:58:57.028 INFO:tasks.workunit.client.0.trial166.stdout: -2 2.00000 host host1 2026-02-20T18:58:57.029 INFO:tasks.workunit.client.0.trial166.stdout: 2 1.00000 osd.2 up 1.00000 1.00000 2026-02-20T18:58:57.029 INFO:tasks.workunit.client.0.trial166.stdout: 3 1.00000 osd.3 up 1.00000 1.00000 2026-02-20T18:58:57.029 INFO:tasks.workunit.client.0.trial166.stdout: -7 4.00000 rack rack1 2026-02-20T18:58:57.029 INFO:tasks.workunit.client.0.trial166.stdout: -3 2.00000 host host2 2026-02-20T18:58:57.029 INFO:tasks.workunit.client.0.trial166.stdout: 4 1.00000 osd.4 up 1.00000 1.00000 2026-02-20T18:58:57.029 INFO:tasks.workunit.client.0.trial166.stdout: 5 1.00000 osd.5 up 1.00000 1.00000 2026-02-20T18:58:57.029 INFO:tasks.workunit.client.0.trial166.stdout: -4 2.00000 host host3 2026-02-20T18:58:57.029 INFO:tasks.workunit.client.0.trial166.stdout: 6 1.00000 osd.6 up 1.00000 1.00000 2026-02-20T18:58:57.029 INFO:tasks.workunit.client.0.trial166.stdout: 7 1.00000 osd.7 up 1.00000 1.00000 2026-02-20T18:58:57.030 INFO:tasks.workunit.client.0.trial166.stdout:-10 2.00000 row row1 2026-02-20T18:58:57.030 INFO:tasks.workunit.client.0.trial166.stdout: -8 2.00000 rack rack2 2026-02-20T18:58:57.030 INFO:tasks.workunit.client.0.trial166.stdout: -5 2.00000 host host4 2026-02-20T18:58:57.030 INFO:tasks.workunit.client.0.trial166.stdout: 8 1.00000 osd.8 up 1.00000 1.00000 2026-02-20T18:58:57.030 INFO:tasks.workunit.client.0.trial166.stdout: 9 1.00000 osd.9 up 1.00000 1.00000 2026-02-20T18:58:57.034 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph tell 'osd.*' injectargs --osd_max_markdown_count 1024 --osd_max_markdown_period 1 2026-02-20T18:58:57.099 INFO:tasks.workunit.client.0.trial166.stdout:osd.0: {} 2026-02-20T18:58:57.115 INFO:tasks.workunit.client.0.trial166.stdout:osd.1: {} 2026-02-20T18:58:57.131 INFO:tasks.workunit.client.0.trial166.stdout:osd.2: {} 2026-02-20T18:58:57.147 INFO:tasks.workunit.client.0.trial166.stdout:osd.3: {} 2026-02-20T18:58:57.163 INFO:tasks.workunit.client.0.trial166.stdout:osd.4: {} 2026-02-20T18:58:57.180 INFO:tasks.workunit.client.0.trial166.stdout:osd.5: {} 2026-02-20T18:58:57.195 INFO:tasks.workunit.client.0.trial166.stdout:osd.6: {} 2026-02-20T18:58:57.211 INFO:tasks.workunit.client.0.trial166.stdout:osd.7: {} 2026-02-20T18:58:57.228 INFO:tasks.workunit.client.0.trial166.stdout:osd.8: {} 2026-02-20T18:58:57.244 INFO:tasks.workunit.client.0.trial166.stdout:osd.9: {} 2026-02-20T18:58:57.250 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph osd set noout 2026-02-20T18:58:58.807 INFO:tasks.workunit.client.0.trial166.stderr:noout is set 2026-02-20T18:58:58.815 INFO:tasks.workunit.client.0.trial166.stderr:+ test_mark_two_osds_same_host_down 2026-02-20T18:58:58.815 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph osd set noup 2026-02-20T18:59:00.810 INFO:tasks.workunit.client.0.trial166.stderr:noup is set 2026-02-20T18:59:00.819 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph osd down osd.0 osd.1 2026-02-20T18:59:00.980 INFO:tasks.ceph.mon.a.trial166.stderr:2026-02-20T18:59:00.986+0000 7f0a9f1dd640 -1 mon.a@0(leader).osd e26 definitely_dead 0 2026-02-20T18:59:01.876 INFO:tasks.ceph.mon.a.trial166.stderr:2026-02-20T18:59:01.883+0000 7f0a9f1dd640 -1 mon.a@0(leader).osd e27 definitely_dead 0 2026-02-20T18:59:01.877 INFO:tasks.workunit.client.0.trial166.stderr:osd.0 is already down. osd.1 is already down. 2026-02-20T18:59:01.885 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph health detail 2026-02-20T18:59:02.187 INFO:tasks.workunit.client.0.trial166.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down 2026-02-20T18:59:02.187 INFO:tasks.workunit.client.0.trial166.stdout:[WRN] OSDMAP_FLAGS: noup,noout flag(s) set 2026-02-20T18:59:02.188 INFO:tasks.workunit.client.0.trial166.stdout:[WRN] OSD_DOWN: 2 osds down 2026-02-20T18:59:02.188 INFO:tasks.workunit.client.0.trial166.stdout: osd.0 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-20T18:59:02.188 INFO:tasks.workunit.client.0.trial166.stdout: osd.1 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-20T18:59:02.188 INFO:tasks.workunit.client.0.trial166.stdout:[WRN] OSD_HOST_DOWN: 1 host (2 osds) down 2026-02-20T18:59:02.188 INFO:tasks.workunit.client.0.trial166.stdout: host host0 (root=root,row=row0,rack=rack0) (2 osds) is down 2026-02-20T18:59:02.195 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph health 2026-02-20T18:59:02.195 INFO:tasks.workunit.client.0.trial166.stderr:+ grep '1 host' 2026-02-20T18:59:02.471 INFO:tasks.workunit.client.0.trial166.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down 2026-02-20T18:59:02.472 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph health 2026-02-20T18:59:02.472 INFO:tasks.workunit.client.0.trial166.stderr:+ grep '2 osds' 2026-02-20T18:59:02.748 INFO:tasks.workunit.client.0.trial166.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down 2026-02-20T18:59:02.748 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph health detail 2026-02-20T18:59:02.748 INFO:tasks.workunit.client.0.trial166.stderr:+ grep osd.0 2026-02-20T18:59:02.771 INFO:tasks.ceph.osd.0.trial166.stderr:2026-02-20T18:59:02.778+0000 7efc967bc640 -1 osd.0 27 osdmap NOUP flag is set, waiting for it to clear 2026-02-20T18:59:02.814 INFO:tasks.ceph.osd.0.trial166.stderr:2026-02-20T18:59:02.821+0000 7efc89377640 -1 osd.0 28 osdmap NOUP flag is set, waiting for it to clear 2026-02-20T18:59:03.058 INFO:tasks.workunit.client.0.trial166.stdout: osd.0 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-20T18:59:03.058 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph health detail 2026-02-20T18:59:03.059 INFO:tasks.workunit.client.0.trial166.stderr:+ grep osd.1 2026-02-20T18:59:03.370 INFO:tasks.workunit.client.0.trial166.stdout: osd.1 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-20T18:59:03.370 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph osd unset noup 2026-02-20T18:59:03.815 INFO:tasks.ceph.osd.0.trial166.stderr:2026-02-20T18:59:03.822+0000 7efc915b0640 -1 osd.0 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T18:59:04.817 INFO:tasks.workunit.client.0.trial166.stderr:noup is unset 2026-02-20T18:59:04.826 INFO:tasks.workunit.client.0.trial166.stderr:+ wait_for_healthy 2026-02-20T18:59:04.826 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph health 2026-02-20T18:59:04.827 INFO:tasks.workunit.client.0.trial166.stderr:+ grep down 2026-02-20T18:59:05.103 INFO:tasks.workunit.client.0.trial166.stdout:HEALTH_WARN noout flag(s) set; 1 osds down 2026-02-20T18:59:05.104 INFO:tasks.workunit.client.0.trial166.stderr:+ sleep 1 2026-02-20T18:59:06.104 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph health 2026-02-20T18:59:06.105 INFO:tasks.workunit.client.0.trial166.stderr:+ grep down 2026-02-20T18:59:06.186 INFO:tasks.ceph.osd.1.trial166.stderr:2026-02-20T18:59:06.193+0000 7f9a59b6c640 -1 osd.1 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T18:59:06.386 INFO:tasks.workunit.client.0.trial166.stdout:HEALTH_WARN noout flag(s) set; 1 osds down 2026-02-20T18:59:06.387 INFO:tasks.workunit.client.0.trial166.stderr:+ sleep 1 2026-02-20T18:59:07.388 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph health 2026-02-20T18:59:07.389 INFO:tasks.workunit.client.0.trial166.stderr:+ grep down 2026-02-20T18:59:07.662 INFO:tasks.workunit.client.0.trial166.stderr:+ test_mark_two_osds_same_rack_down 2026-02-20T18:59:07.662 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph osd set noup 2026-02-20T18:59:09.825 INFO:tasks.workunit.client.0.trial166.stderr:noup is set 2026-02-20T18:59:09.833 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph osd down osd.8 osd.9 2026-02-20T18:59:09.994 INFO:tasks.ceph.mon.a.trial166.stderr:2026-02-20T18:59:10.000+0000 7f0a9f1dd640 -1 mon.a@0(leader).osd e35 definitely_dead 0 2026-02-20T18:59:10.890 INFO:tasks.ceph.mon.a.trial166.stderr:2026-02-20T18:59:10.896+0000 7f0a9f1dd640 -1 mon.a@0(leader).osd e36 definitely_dead 0 2026-02-20T18:59:10.891 INFO:tasks.workunit.client.0.trial166.stderr:osd.8 is already down. osd.9 is already down. 2026-02-20T18:59:10.899 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph health detail 2026-02-20T18:59:11.200 INFO:tasks.workunit.client.0.trial166.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down; 1 rack (2 osds) down; 1 row (2 osds) down 2026-02-20T18:59:11.200 INFO:tasks.workunit.client.0.trial166.stdout:[WRN] OSDMAP_FLAGS: noup,noout flag(s) set 2026-02-20T18:59:11.200 INFO:tasks.workunit.client.0.trial166.stdout:[WRN] OSD_DOWN: 2 osds down 2026-02-20T18:59:11.200 INFO:tasks.workunit.client.0.trial166.stdout: osd.8 (root=root,row=row1,rack=rack2,host=host4) is down 2026-02-20T18:59:11.200 INFO:tasks.workunit.client.0.trial166.stdout: osd.9 (root=root,row=row1,rack=rack2,host=host4) is down 2026-02-20T18:59:11.200 INFO:tasks.workunit.client.0.trial166.stdout:[WRN] OSD_HOST_DOWN: 1 host (2 osds) down 2026-02-20T18:59:11.200 INFO:tasks.workunit.client.0.trial166.stdout: host host4 (root=root,row=row1,rack=rack2) (2 osds) is down 2026-02-20T18:59:11.200 INFO:tasks.workunit.client.0.trial166.stdout:[WRN] OSD_RACK_DOWN: 1 rack (2 osds) down 2026-02-20T18:59:11.200 INFO:tasks.workunit.client.0.trial166.stdout: rack rack2 (root=root,row=row1) (2 osds) is down 2026-02-20T18:59:11.200 INFO:tasks.workunit.client.0.trial166.stdout:[WRN] OSD_ROW_DOWN: 1 row (2 osds) down 2026-02-20T18:59:11.200 INFO:tasks.workunit.client.0.trial166.stdout: row row1 (root=root) (2 osds) is down 2026-02-20T18:59:11.208 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph health 2026-02-20T18:59:11.208 INFO:tasks.workunit.client.0.trial166.stderr:+ grep '1 host' 2026-02-20T18:59:11.405 INFO:tasks.ceph.osd.8.trial166.stderr:2026-02-20T18:59:11.412+0000 7f2baeb23640 -1 osd.8 36 osdmap NOUP flag is set, waiting for it to clear 2026-02-20T18:59:11.479 INFO:tasks.workunit.client.0.trial166.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down; 1 rack (2 osds) down; 1 row (2 osds) down 2026-02-20T18:59:11.479 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph health 2026-02-20T18:59:11.479 INFO:tasks.workunit.client.0.trial166.stderr:+ grep '1 rack' 2026-02-20T18:59:11.586 INFO:tasks.ceph.osd.9.trial166.stderr:2026-02-20T18:59:11.593+0000 7fdcb56ad640 -1 osd.9 36 osdmap NOUP flag is set, waiting for it to clear 2026-02-20T18:59:11.755 INFO:tasks.workunit.client.0.trial166.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down; 1 rack (2 osds) down; 1 row (2 osds) down 2026-02-20T18:59:11.756 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph health 2026-02-20T18:59:11.756 INFO:tasks.workunit.client.0.trial166.stderr:+ grep '1 row' 2026-02-20T18:59:11.830 INFO:tasks.ceph.osd.8.trial166.stderr:2026-02-20T18:59:11.836+0000 7f2ba16de640 -1 osd.8 37 osdmap NOUP flag is set, waiting for it to clear 2026-02-20T18:59:11.830 INFO:tasks.ceph.osd.9.trial166.stderr:2026-02-20T18:59:11.836+0000 7fdca8268640 -1 osd.9 37 osdmap NOUP flag is set, waiting for it to clear 2026-02-20T18:59:12.033 INFO:tasks.workunit.client.0.trial166.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down; 1 rack (2 osds) down; 1 row (2 osds) down 2026-02-20T18:59:12.033 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph health 2026-02-20T18:59:12.033 INFO:tasks.workunit.client.0.trial166.stderr:+ grep '2 osds' 2026-02-20T18:59:12.307 INFO:tasks.workunit.client.0.trial166.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down; 1 rack (2 osds) down; 1 row (2 osds) down 2026-02-20T18:59:12.307 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph health detail 2026-02-20T18:59:12.307 INFO:tasks.workunit.client.0.trial166.stderr:+ grep osd.8 2026-02-20T18:59:12.612 INFO:tasks.workunit.client.0.trial166.stdout: osd.8 (root=root,row=row1,rack=rack2,host=host4) is down 2026-02-20T18:59:12.613 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph health detail 2026-02-20T18:59:12.614 INFO:tasks.workunit.client.0.trial166.stderr:+ grep osd.9 2026-02-20T18:59:12.921 INFO:tasks.workunit.client.0.trial166.stdout: osd.9 (root=root,row=row1,rack=rack2,host=host4) is down 2026-02-20T18:59:12.922 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph osd unset noup 2026-02-20T18:59:13.834 INFO:tasks.ceph.osd.8.trial166.stderr:2026-02-20T18:59:13.840+0000 7f2ba9917640 -1 osd.8 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T18:59:13.834 INFO:tasks.ceph.osd.9.trial166.stderr:2026-02-20T18:59:13.840+0000 7fdcb04a1640 -1 osd.9 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T18:59:14.833 INFO:tasks.workunit.client.0.trial166.stderr:noup is unset 2026-02-20T18:59:14.844 INFO:tasks.workunit.client.0.trial166.stderr:+ wait_for_healthy 2026-02-20T18:59:14.844 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph health 2026-02-20T18:59:14.844 INFO:tasks.workunit.client.0.trial166.stderr:+ grep down 2026-02-20T18:59:15.121 INFO:tasks.workunit.client.0.trial166.stderr:+ test_mark_all_but_last_osds_down 2026-02-20T18:59:15.121 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph osd set noup 2026-02-20T18:59:16.837 INFO:tasks.workunit.client.0.trial166.stderr:noup is set 2026-02-20T18:59:16.847 INFO:tasks.workunit.client.0.trial166.stderr:++ ceph osd ls 2026-02-20T18:59:16.847 INFO:tasks.workunit.client.0.trial166.stderr:++ sed '$d' 2026-02-20T18:59:17.070 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph osd down 0 1 2 3 4 5 6 7 8 2026-02-20T18:59:17.235 INFO:tasks.ceph.mon.a.trial166.stderr:2026-02-20T18:59:17.241+0000 7f0a9f1dd640 -1 mon.a@0(leader).osd e41 definitely_dead 0 2026-02-20T18:59:17.905 INFO:tasks.ceph.mon.a.trial166.stderr:2026-02-20T18:59:17.909+0000 7f0a9f1dd640 -1 mon.a@0(leader).osd e42 definitely_dead 0 2026-02-20T18:59:17.907 INFO:tasks.workunit.client.0.trial166.stderr:osd.0 is already down. osd.1 is already down. osd.2 is already down. osd.3 is already down. osd.4 is already down. osd.5 is already down. osd.6 is already down. osd.7 is already down. osd.8 is already down. 2026-02-20T18:59:17.911 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph health detail 2026-02-20T18:59:18.215 INFO:tasks.workunit.client.0.trial166.stdout:HEALTH_WARN noup,noout flag(s) set; 9 osds down; 4 hosts (8 osds) down; 2 racks (8 osds) down; 1 row (8 osds) down 2026-02-20T18:59:18.215 INFO:tasks.workunit.client.0.trial166.stdout:[WRN] OSDMAP_FLAGS: noup,noout flag(s) set 2026-02-20T18:59:18.216 INFO:tasks.workunit.client.0.trial166.stdout:[WRN] OSD_DOWN: 9 osds down 2026-02-20T18:59:18.216 INFO:tasks.workunit.client.0.trial166.stdout: osd.0 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-20T18:59:18.216 INFO:tasks.workunit.client.0.trial166.stdout: osd.1 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-20T18:59:18.216 INFO:tasks.workunit.client.0.trial166.stdout: osd.2 (root=root,row=row0,rack=rack0,host=host1) is down 2026-02-20T18:59:18.216 INFO:tasks.workunit.client.0.trial166.stdout: osd.3 (root=root,row=row0,rack=rack0,host=host1) is down 2026-02-20T18:59:18.216 INFO:tasks.workunit.client.0.trial166.stdout: osd.4 (root=root,row=row0,rack=rack1,host=host2) is down 2026-02-20T18:59:18.216 INFO:tasks.workunit.client.0.trial166.stdout: osd.5 (root=root,row=row0,rack=rack1,host=host2) is down 2026-02-20T18:59:18.216 INFO:tasks.workunit.client.0.trial166.stdout: osd.6 (root=root,row=row0,rack=rack1,host=host3) is down 2026-02-20T18:59:18.216 INFO:tasks.workunit.client.0.trial166.stdout: osd.7 (root=root,row=row0,rack=rack1,host=host3) is down 2026-02-20T18:59:18.216 INFO:tasks.workunit.client.0.trial166.stdout: osd.8 (root=root,row=row1,rack=rack2,host=host4) is down 2026-02-20T18:59:18.216 INFO:tasks.workunit.client.0.trial166.stdout:[WRN] OSD_HOST_DOWN: 4 hosts (8 osds) down 2026-02-20T18:59:18.216 INFO:tasks.workunit.client.0.trial166.stdout: host host0 (root=root,row=row0,rack=rack0) (2 osds) is down 2026-02-20T18:59:18.216 INFO:tasks.workunit.client.0.trial166.stdout: host host1 (root=root,row=row0,rack=rack0) (2 osds) is down 2026-02-20T18:59:18.216 INFO:tasks.workunit.client.0.trial166.stdout: host host2 (root=root,row=row0,rack=rack1) (2 osds) is down 2026-02-20T18:59:18.216 INFO:tasks.workunit.client.0.trial166.stdout: host host3 (root=root,row=row0,rack=rack1) (2 osds) is down 2026-02-20T18:59:18.216 INFO:tasks.workunit.client.0.trial166.stdout:[WRN] OSD_RACK_DOWN: 2 racks (8 osds) down 2026-02-20T18:59:18.216 INFO:tasks.workunit.client.0.trial166.stdout: rack rack0 (root=root,row=row0) (4 osds) is down 2026-02-20T18:59:18.216 INFO:tasks.workunit.client.0.trial166.stdout: rack rack1 (root=root,row=row0) (4 osds) is down 2026-02-20T18:59:18.216 INFO:tasks.workunit.client.0.trial166.stdout:[WRN] OSD_ROW_DOWN: 1 row (8 osds) down 2026-02-20T18:59:18.216 INFO:tasks.workunit.client.0.trial166.stdout: row row0 (root=root) (8 osds) is down 2026-02-20T18:59:18.223 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph health 2026-02-20T18:59:18.224 INFO:tasks.workunit.client.0.trial166.stderr:+ grep '1 row' 2026-02-20T18:59:18.341 INFO:tasks.ceph.osd.8.trial166.stderr:2026-02-20T18:59:18.347+0000 7f2bae311640 -1 osd.8 42 osdmap NOUP flag is set, waiting for it to clear 2026-02-20T18:59:18.500 INFO:tasks.workunit.client.0.trial166.stdout:HEALTH_WARN noup,noout flag(s) set; 9 osds down; 4 hosts (8 osds) down; 2 racks (8 osds) down; 1 row (8 osds) down 2026-02-20T18:59:18.501 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph health 2026-02-20T18:59:18.501 INFO:tasks.workunit.client.0.trial166.stderr:+ grep '2 racks' 2026-02-20T18:59:18.625 INFO:tasks.ceph.osd.6.trial166.stderr:2026-02-20T18:59:18.632+0000 7f1ef54cf640 -1 osd.6 42 osdmap NOUP flag is set, waiting for it to clear 2026-02-20T18:59:18.777 INFO:tasks.workunit.client.0.trial166.stdout:HEALTH_WARN noup,noout flag(s) set; 9 osds down; 4 hosts (8 osds) down; 2 racks (8 osds) down; 1 row (8 osds) down 2026-02-20T18:59:18.777 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph health 2026-02-20T18:59:18.777 INFO:tasks.workunit.client.0.trial166.stderr:+ grep '4 hosts' 2026-02-20T18:59:18.841 INFO:tasks.ceph.osd.6.trial166.stderr:2026-02-20T18:59:18.847+0000 7f1ee808a640 -1 osd.6 43 osdmap NOUP flag is set, waiting for it to clear 2026-02-20T18:59:18.841 INFO:tasks.ceph.osd.8.trial166.stderr:2026-02-20T18:59:18.847+0000 7f2ba16de640 -1 osd.8 43 osdmap NOUP flag is set, waiting for it to clear 2026-02-20T18:59:19.055 INFO:tasks.workunit.client.0.trial166.stdout:HEALTH_WARN noup,noout flag(s) set; 9 osds down; 4 hosts (8 osds) down; 2 racks (8 osds) down; 1 row (8 osds) down 2026-02-20T18:59:19.055 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph health 2026-02-20T18:59:19.055 INFO:tasks.workunit.client.0.trial166.stderr:+ grep '9 osds' 2026-02-20T18:59:19.332 INFO:tasks.workunit.client.0.trial166.stdout:HEALTH_WARN noup,noout flag(s) set; 9 osds down; 4 hosts (8 osds) down; 2 racks (8 osds) down; 1 row (8 osds) down 2026-02-20T18:59:19.333 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph osd unset noup 2026-02-20T18:59:19.370 INFO:tasks.ceph.osd.2.trial166.stderr:2026-02-20T18:59:19.376+0000 7f3fe92cf640 -1 osd.2 43 osdmap NOUP flag is set, waiting for it to clear 2026-02-20T18:59:19.493 INFO:tasks.ceph.osd.7.trial166.stderr:2026-02-20T18:59:19.499+0000 7f76aa1c0640 -1 osd.7 43 osdmap NOUP flag is set, waiting for it to clear 2026-02-20T18:59:19.693 INFO:tasks.ceph.osd.0.trial166.stderr:2026-02-20T18:59:19.699+0000 7efc95faa640 -1 osd.0 43 osdmap NOUP flag is set, waiting for it to clear 2026-02-20T18:59:19.843 INFO:tasks.ceph.osd.8.trial166.stderr:2026-02-20T18:59:19.850+0000 7f2ba9917640 -1 osd.8 44 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T18:59:19.843 INFO:tasks.ceph.osd.0.trial166.stderr:2026-02-20T18:59:19.850+0000 7efc915b0640 -1 osd.0 44 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T18:59:19.844 INFO:tasks.ceph.osd.2.trial166.stderr:2026-02-20T18:59:19.850+0000 7f3fe00bb640 -1 osd.2 44 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T18:59:19.844 INFO:tasks.ceph.osd.6.trial166.stderr:2026-02-20T18:59:19.850+0000 7f1ef02c3640 -1 osd.6 44 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T18:59:19.844 INFO:tasks.ceph.osd.7.trial166.stderr:2026-02-20T18:59:19.850+0000 7f76a0fac640 -1 osd.7 44 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T18:59:20.226 INFO:tasks.ceph.osd.1.trial166.stderr:2026-02-20T18:59:20.233+0000 7f9a59b6c640 -1 osd.1 44 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T18:59:20.538 INFO:tasks.ceph.osd.4.trial166.stderr:2026-02-20T18:59:20.545+0000 7fee677ff640 -1 osd.4 44 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T18:59:20.843 INFO:tasks.workunit.client.0.trial166.stderr:noup is unset 2026-02-20T18:59:20.853 INFO:tasks.workunit.client.0.trial166.stderr:+ wait_for_healthy 2026-02-20T18:59:20.854 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph health 2026-02-20T18:59:20.854 INFO:tasks.workunit.client.0.trial166.stderr:+ grep down 2026-02-20T18:59:21.134 INFO:tasks.workunit.client.0.trial166.stdout:HEALTH_WARN noout flag(s) set; 2 osds down 2026-02-20T18:59:21.135 INFO:tasks.workunit.client.0.trial166.stderr:+ sleep 1 2026-02-20T18:59:22.136 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph health 2026-02-20T18:59:22.136 INFO:tasks.workunit.client.0.trial166.stderr:+ grep down 2026-02-20T18:59:22.377 INFO:tasks.ceph.osd.5.trial166.stderr:2026-02-20T18:59:22.384+0000 7fb3aa172640 -1 osd.5 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T18:59:22.408 INFO:tasks.workunit.client.0.trial166.stdout:HEALTH_WARN noout flag(s) set; 2 osds down 2026-02-20T18:59:22.408 INFO:tasks.workunit.client.0.trial166.stderr:+ sleep 1 2026-02-20T18:59:22.747 INFO:tasks.ceph.osd.3.trial166.stderr:2026-02-20T18:59:22.754+0000 7fe4f1dc1640 -1 osd.3 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T18:59:23.409 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph health 2026-02-20T18:59:23.409 INFO:tasks.workunit.client.0.trial166.stderr:+ grep down 2026-02-20T18:59:23.684 INFO:tasks.workunit.client.0.trial166.stderr:+ test_mark_two_osds_same_host_down_with_classes 2026-02-20T18:59:23.685 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph osd set noup 2026-02-20T18:59:24.849 INFO:tasks.workunit.client.0.trial166.stderr:noup is set 2026-02-20T18:59:24.859 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph osd crush set-device-class ssd osd.0 osd.2 osd.4 osd.6 osd.8 2026-02-20T18:59:26.854 INFO:tasks.workunit.client.0.trial166.stderr:osd.0 already set to class ssd. set-device-class item id 0 name 'osd.0' device_class 'ssd': no change. osd.2 already set to class ssd. set-device-class item id 2 name 'osd.2' device_class 'ssd': no change. osd.4 already set to class ssd. set-device-class item id 4 name 'osd.4' device_class 'ssd': no change. osd.6 already set to class ssd. set-device-class item id 6 name 'osd.6' device_class 'ssd': no change. osd.8 already set to class ssd. set-device-class item id 8 name 'osd.8' device_class 'ssd': no change. set osd(s) to class 'ssd' 2026-02-20T18:59:26.863 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph osd crush set-device-class hdd osd.1 osd.3 osd.5 osd.7 osd.9 2026-02-20T18:59:28.857 INFO:tasks.workunit.client.0.trial166.stderr:osd.1 already set to class hdd. set-device-class item id 1 name 'osd.1' device_class 'hdd': no change. osd.3 already set to class hdd. set-device-class item id 3 name 'osd.3' device_class 'hdd': no change. osd.5 already set to class hdd. set-device-class item id 5 name 'osd.5' device_class 'hdd': no change. osd.7 already set to class hdd. set-device-class item id 7 name 'osd.7' device_class 'hdd': no change. osd.9 already set to class hdd. set-device-class item id 9 name 'osd.9' device_class 'hdd': no change. set osd(s) to class 'hdd' 2026-02-20T18:59:28.867 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph osd down osd.0 osd.1 2026-02-20T18:59:29.026 INFO:tasks.ceph.mon.a.trial166.stderr:2026-02-20T18:59:29.033+0000 7f0a9f1dd640 -1 mon.a@0(leader).osd e53 definitely_dead 0 2026-02-20T18:59:29.924 INFO:tasks.ceph.mon.a.trial166.stderr:2026-02-20T18:59:29.930+0000 7f0a9f1dd640 -1 mon.a@0(leader).osd e54 definitely_dead 0 2026-02-20T18:59:29.924 INFO:tasks.workunit.client.0.trial166.stderr:osd.0 is already down. osd.1 is already down. 2026-02-20T18:59:29.933 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph health detail 2026-02-20T18:59:30.236 INFO:tasks.workunit.client.0.trial166.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down 2026-02-20T18:59:30.237 INFO:tasks.workunit.client.0.trial166.stdout:[WRN] OSDMAP_FLAGS: noup,noout flag(s) set 2026-02-20T18:59:30.237 INFO:tasks.workunit.client.0.trial166.stdout:[WRN] OSD_DOWN: 2 osds down 2026-02-20T18:59:30.237 INFO:tasks.workunit.client.0.trial166.stdout: osd.0 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-20T18:59:30.237 INFO:tasks.workunit.client.0.trial166.stdout: osd.1 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-20T18:59:30.237 INFO:tasks.workunit.client.0.trial166.stdout:[WRN] OSD_HOST_DOWN: 1 host (2 osds) down 2026-02-20T18:59:30.237 INFO:tasks.workunit.client.0.trial166.stdout: host host0 (root=root,row=row0,rack=rack0) (2 osds) is down 2026-02-20T18:59:30.244 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph health 2026-02-20T18:59:30.245 INFO:tasks.workunit.client.0.trial166.stderr:+ grep '1 host' 2026-02-20T18:59:30.521 INFO:tasks.workunit.client.0.trial166.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down 2026-02-20T18:59:30.522 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph health 2026-02-20T18:59:30.522 INFO:tasks.workunit.client.0.trial166.stderr:+ grep '2 osds' 2026-02-20T18:59:30.803 INFO:tasks.workunit.client.0.trial166.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down 2026-02-20T18:59:30.803 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph health detail 2026-02-20T18:59:30.803 INFO:tasks.workunit.client.0.trial166.stderr:+ grep osd.0 2026-02-20T18:59:31.110 INFO:tasks.workunit.client.0.trial166.stdout: osd.0 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-20T18:59:31.111 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph health detail 2026-02-20T18:59:31.111 INFO:tasks.workunit.client.0.trial166.stderr:+ grep osd.1 2026-02-20T18:59:31.300 INFO:tasks.ceph.osd.1.trial166.stderr:2026-02-20T18:59:31.306+0000 7f9a62d80640 -1 osd.1 55 osdmap NOUP flag is set, waiting for it to clear 2026-02-20T18:59:31.421 INFO:tasks.workunit.client.0.trial166.stdout: osd.1 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-20T18:59:31.422 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph osd unset noup 2026-02-20T18:59:31.862 INFO:tasks.ceph.osd.1.trial166.stderr:2026-02-20T18:59:31.869+0000 7f9a59b6c640 -1 osd.1 56 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T18:59:32.864 INFO:tasks.workunit.client.0.trial166.stderr:noup is unset 2026-02-20T18:59:32.873 INFO:tasks.workunit.client.0.trial166.stderr:+ wait_for_healthy 2026-02-20T18:59:32.874 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph health 2026-02-20T18:59:32.874 INFO:tasks.workunit.client.0.trial166.stderr:+ grep down 2026-02-20T18:59:33.152 INFO:tasks.workunit.client.0.trial166.stdout:HEALTH_WARN noout flag(s) set; 1 osds down 2026-02-20T18:59:33.152 INFO:tasks.workunit.client.0.trial166.stderr:+ sleep 1 2026-02-20T18:59:34.153 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph health 2026-02-20T18:59:34.153 INFO:tasks.workunit.client.0.trial166.stderr:+ grep down 2026-02-20T18:59:34.429 INFO:tasks.workunit.client.0.trial166.stdout:HEALTH_WARN noout flag(s) set; 1 osds down 2026-02-20T18:59:34.429 INFO:tasks.workunit.client.0.trial166.stderr:+ sleep 1 2026-02-20T18:59:34.756 INFO:tasks.ceph.osd.0.trial166.stderr:2026-02-20T18:59:34.762+0000 7efc915b0640 -1 osd.0 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T18:59:35.430 INFO:tasks.workunit.client.0.trial166.stderr:+ ceph health 2026-02-20T18:59:35.430 INFO:tasks.workunit.client.0.trial166.stderr:+ grep down 2026-02-20T18:59:35.705 INFO:tasks.workunit.client.0.trial166.stderr:+ exit 0 2026-02-20T18:59:35.706 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-20T18:59:35.706 DEBUG:teuthology.orchestra.run.trial166:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-20T18:59:35.769 INFO:tasks.workunit:Stopping ['rados/test_health_warnings.sh'] on client.0... 2026-02-20T18:59:35.769 DEBUG:teuthology.orchestra.run.trial166:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-20T18:59:36.116 DEBUG:teuthology.parallel:result is None 2026-02-20T18:59:36.116 DEBUG:teuthology.orchestra.run.trial166:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2026-02-20T18:59:36.140 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2026-02-20T18:59:36.140 DEBUG:teuthology.orchestra.run.trial166:> rmdir -- /home/ubuntu/cephtest/mnt.0 2026-02-20T18:59:36.196 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2026-02-20T18:59:36.196 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-20T18:59:36.225 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-20T18:59:36.226 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T18:59:36.417 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:59:36.417 INFO:teuthology.orchestra.run.trial166.stderr:dumped all 2026-02-20T18:59:36.426 INFO:teuthology.orchestra.run.trial166.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2026-02-20T18:59:35.879136+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":275680,"kb_used_data":6080,"kb_used_omap":246,"kb_used_meta":269193,"kb_avail":1048300320,"statfs":{"total":1073741824000,"available":1073459527680,"internally_reserved":0,"allocated":6225920,"data_stored":2936024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":252026,"internal_metadata":275654534},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.009554"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":74,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-20T18:59:31.870339+0000","last_change":"2026-02-20T18:59:24.059743+0000","last_active":"2026-02-20T18:59:31.870339+0000","last_peered":"2026-02-20T18:59:31.870339+0000","last_clean":"2026-02-20T18:59:31.870339+0000","last_became_active":"2026-02-20T18:59:24.059643+0000","last_became_peered":"2026-02-20T18:59:24.059643+0000","last_unstale":"2026-02-20T18:59:31.870339+0000","last_undegraded":"2026-02-20T18:59:31.870339+0000","last_fullsized":"2026-02-20T18:59:31.870339+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T05:02:55.325323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000220731,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":95,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-20T18:59:30.870118+0000","last_change":"2026-02-20T18:59:21.853706+0000","last_active":"2026-02-20T18:59:30.870118+0000","last_peered":"2026-02-20T18:59:30.870118+0000","last_clean":"2026-02-20T18:59:30.870118+0000","last_became_active":"2026-02-20T18:59:21.853581+0000","last_became_peered":"2026-02-20T18:59:21.853581+0000","last_unstale":"2026-02-20T18:59:30.870118+0000","last_undegraded":"2026-02-20T18:59:30.870118+0000","last_fullsized":"2026-02-20T18:59:30.870118+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:25:32.002379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021133299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":97,"reported_epoch":55,"state":"active+undersized+wait","last_fresh":"2026-02-20T18:59:30.870084+0000","last_change":"2026-02-20T18:59:30.869950+0000","last_active":"2026-02-20T18:59:30.870084+0000","last_peered":"2026-02-20T18:59:30.870084+0000","last_clean":"2026-02-20T18:59:30.362908+0000","last_became_active":"2026-02-20T18:59:30.869950+0000","last_became_peered":"2026-02-20T18:59:30.869950+0000","last_unstale":"2026-02-20T18:59:30.870084+0000","last_undegraded":"2026-02-20T18:59:30.870084+0000","last_fullsized":"2026-02-20T18:59:30.869702+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:35:43.039850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000249194,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9],"acting":[9],"avail_no_missing":["9"],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":53,"reported_epoch":55,"state":"active+undersized","last_fresh":"2026-02-20T18:59:30.870433+0000","last_change":"2026-02-20T18:59:30.870357+0000","last_active":"2026-02-20T18:59:30.870433+0000","last_peered":"2026-02-20T18:59:30.870433+0000","last_clean":"2026-02-20T18:59:19.257604+0000","last_became_active":"2026-02-20T18:59:30.870357+0000","last_became_peered":"2026-02-20T18:59:30.870357+0000","last_unstale":"2026-02-20T18:59:30.870433+0000","last_undegraded":"2026-02-20T18:59:30.870433+0000","last_fullsized":"2026-02-20T18:59:30.870144+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:29:49.641457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6],"acting":[6],"avail_no_missing":["6"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.3","version":"17'1","reported_seq":90,"reported_epoch":56,"state":"active+undersized+degraded","last_fresh":"2026-02-20T18:59:31.870317+0000","last_change":"2026-02-20T18:59:30.869872+0000","last_active":"2026-02-20T18:59:31.870317+0000","last_peered":"2026-02-20T18:59:31.870317+0000","last_clean":"2026-02-20T18:59:30.362536+0000","last_became_active":"2026-02-20T18:59:30.869872+0000","last_became_peered":"2026-02-20T18:59:30.869872+0000","last_unstale":"2026-02-20T18:59:31.870317+0000","last_undegraded":"2026-02-20T18:59:30.869708+0000","last_fullsized":"2026-02-20T18:59:30.869669+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:05:43.626018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":1}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"19'2","reported_seq":95,"reported_epoch":56,"state":"active+undersized+degraded","last_fresh":"2026-02-20T18:59:32.315165+0000","last_change":"2026-02-20T18:59:30.870429+0000","last_active":"2026-02-20T18:59:32.315165+0000","last_peered":"2026-02-20T18:59:32.315165+0000","last_clean":"2026-02-20T18:59:29.860028+0000","last_became_active":"2026-02-20T18:59:30.870429+0000","last_became_peered":"2026-02-20T18:59:30.870429+0000","last_unstale":"2026-02-20T18:59:32.315165+0000","last_undegraded":"2026-02-20T18:59:30.870236+0000","last_fullsized":"2026-02-20T18:59:30.870202+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T04:29:34.733799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000423428,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":1}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-20T18:59:30.362567+0000","last_change":"2026-02-20T18:59:23.856920+0000","last_active":"2026-02-20T18:59:30.362567+0000","last_peered":"2026-02-20T18:59:30.362567+0000","last_clean":"2026-02-20T18:59:30.362567+0000","last_became_active":"2026-02-20T18:59:23.856817+0000","last_became_peered":"2026-02-20T18:59:23.856817+0000","last_unstale":"2026-02-20T18:59:30.362567+0000","last_undegraded":"2026-02-20T18:59:30.362567+0000","last_fullsized":"2026-02-20T18:59:30.362567+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:31:01.223867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025154799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":78,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-20T18:59:30.869592+0000","last_change":"2026-02-20T18:59:24.017114+0000","last_active":"2026-02-20T18:59:30.869592+0000","last_peered":"2026-02-20T18:59:30.869592+0000","last_clean":"2026-02-20T18:59:30.869592+0000","last_became_active":"2026-02-20T18:59:24.016989+0000","last_became_peered":"2026-02-20T18:59:24.016989+0000","last_unstale":"2026-02-20T18:59:30.869592+0000","last_undegraded":"2026-02-20T18:59:30.869592+0000","last_fullsized":"2026-02-20T18:59:30.869592+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:13:07.590533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":39,"seq":167503724561,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":296695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27746,"internal_metadata":27562910},"hb_peers":[2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":45,"seq":193273528337,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27560,"kb_used_data":600,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830040,"statfs":{"total":107374182400,"available":107345960960,"internally_reserved":0,"allocated":614400,"data_stored":288979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25788,"internal_metadata":27564868},"hb_peers":[2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528337,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27560,"kb_used_data":600,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830040,"statfs":{"total":107374182400,"available":107345960960,"internally_reserved":0,"allocated":614400,"data_stored":288979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26435,"internal_metadata":27564221},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528336,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":296695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28392,"internal_metadata":27562264},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":47,"seq":201863462929,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":24,"kb_used_meta":26919,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":296695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25138,"internal_metadata":27565518},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":45,"seq":193273528336,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27576,"kb_used_data":616,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830024,"statfs":{"total":107374182400,"available":107345944576,"internally_reserved":0,"allocated":630784,"data_stored":296714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27742,"internal_metadata":27562914},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":47,"seq":201863462929,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27584,"kb_used_data":624,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830016,"statfs":{"total":107374182400,"available":107345936384,"internally_reserved":0,"allocated":638976,"data_stored":304329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27740,"internal_metadata":27562916},"hb_peers":[2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":45,"seq":193273528337,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27560,"kb_used_data":600,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830040,"statfs":{"total":107374182400,"available":107345960960,"internally_reserved":0,"allocated":614400,"data_stored":288979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25789,"internal_metadata":27564867},"hb_peers":[3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":0,"seq":17,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27576,"kb_used_data":616,"kb_used_omap":18,"kb_used_meta":26925,"kb_avail":104830024,"statfs":{"total":107374182400,"available":107345944576,"internally_reserved":0,"allocated":630784,"data_stored":296714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19279,"internal_metadata":27571377},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":45,"seq":193273528337,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27548,"kb_used_data":588,"kb_used_omap":17,"kb_used_meta":26926,"kb_avail":104830052,"statfs":{"total":107374182400,"available":107345973248,"internally_reserved":0,"allocated":602112,"data_stored":281245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17977,"internal_metadata":27572679},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T18:59:36.427 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T18:59:36.606 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:59:36.607 INFO:teuthology.orchestra.run.trial166.stderr:dumped all 2026-02-20T18:59:36.615 INFO:teuthology.orchestra.run.trial166.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2026-02-20T18:59:35.879136+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":275680,"kb_used_data":6080,"kb_used_omap":246,"kb_used_meta":269193,"kb_avail":1048300320,"statfs":{"total":1073741824000,"available":1073459527680,"internally_reserved":0,"allocated":6225920,"data_stored":2936024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":252026,"internal_metadata":275654534},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.009554"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":74,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-20T18:59:31.870339+0000","last_change":"2026-02-20T18:59:24.059743+0000","last_active":"2026-02-20T18:59:31.870339+0000","last_peered":"2026-02-20T18:59:31.870339+0000","last_clean":"2026-02-20T18:59:31.870339+0000","last_became_active":"2026-02-20T18:59:24.059643+0000","last_became_peered":"2026-02-20T18:59:24.059643+0000","last_unstale":"2026-02-20T18:59:31.870339+0000","last_undegraded":"2026-02-20T18:59:31.870339+0000","last_fullsized":"2026-02-20T18:59:31.870339+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T05:02:55.325323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000220731,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":95,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-20T18:59:30.870118+0000","last_change":"2026-02-20T18:59:21.853706+0000","last_active":"2026-02-20T18:59:30.870118+0000","last_peered":"2026-02-20T18:59:30.870118+0000","last_clean":"2026-02-20T18:59:30.870118+0000","last_became_active":"2026-02-20T18:59:21.853581+0000","last_became_peered":"2026-02-20T18:59:21.853581+0000","last_unstale":"2026-02-20T18:59:30.870118+0000","last_undegraded":"2026-02-20T18:59:30.870118+0000","last_fullsized":"2026-02-20T18:59:30.870118+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:25:32.002379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021133299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":97,"reported_epoch":55,"state":"active+undersized+wait","last_fresh":"2026-02-20T18:59:30.870084+0000","last_change":"2026-02-20T18:59:30.869950+0000","last_active":"2026-02-20T18:59:30.870084+0000","last_peered":"2026-02-20T18:59:30.870084+0000","last_clean":"2026-02-20T18:59:30.362908+0000","last_became_active":"2026-02-20T18:59:30.869950+0000","last_became_peered":"2026-02-20T18:59:30.869950+0000","last_unstale":"2026-02-20T18:59:30.870084+0000","last_undegraded":"2026-02-20T18:59:30.870084+0000","last_fullsized":"2026-02-20T18:59:30.869702+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:35:43.039850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000249194,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9],"acting":[9],"avail_no_missing":["9"],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":53,"reported_epoch":55,"state":"active+undersized","last_fresh":"2026-02-20T18:59:30.870433+0000","last_change":"2026-02-20T18:59:30.870357+0000","last_active":"2026-02-20T18:59:30.870433+0000","last_peered":"2026-02-20T18:59:30.870433+0000","last_clean":"2026-02-20T18:59:19.257604+0000","last_became_active":"2026-02-20T18:59:30.870357+0000","last_became_peered":"2026-02-20T18:59:30.870357+0000","last_unstale":"2026-02-20T18:59:30.870433+0000","last_undegraded":"2026-02-20T18:59:30.870433+0000","last_fullsized":"2026-02-20T18:59:30.870144+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:29:49.641457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6],"acting":[6],"avail_no_missing":["6"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.3","version":"17'1","reported_seq":90,"reported_epoch":56,"state":"active+undersized+degraded","last_fresh":"2026-02-20T18:59:31.870317+0000","last_change":"2026-02-20T18:59:30.869872+0000","last_active":"2026-02-20T18:59:31.870317+0000","last_peered":"2026-02-20T18:59:31.870317+0000","last_clean":"2026-02-20T18:59:30.362536+0000","last_became_active":"2026-02-20T18:59:30.869872+0000","last_became_peered":"2026-02-20T18:59:30.869872+0000","last_unstale":"2026-02-20T18:59:31.870317+0000","last_undegraded":"2026-02-20T18:59:30.869708+0000","last_fullsized":"2026-02-20T18:59:30.869669+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:05:43.626018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":1}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"19'2","reported_seq":95,"reported_epoch":56,"state":"active+undersized+degraded","last_fresh":"2026-02-20T18:59:32.315165+0000","last_change":"2026-02-20T18:59:30.870429+0000","last_active":"2026-02-20T18:59:32.315165+0000","last_peered":"2026-02-20T18:59:32.315165+0000","last_clean":"2026-02-20T18:59:29.860028+0000","last_became_active":"2026-02-20T18:59:30.870429+0000","last_became_peered":"2026-02-20T18:59:30.870429+0000","last_unstale":"2026-02-20T18:59:32.315165+0000","last_undegraded":"2026-02-20T18:59:30.870236+0000","last_fullsized":"2026-02-20T18:59:30.870202+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T04:29:34.733799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000423428,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":1}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-20T18:59:30.362567+0000","last_change":"2026-02-20T18:59:23.856920+0000","last_active":"2026-02-20T18:59:30.362567+0000","last_peered":"2026-02-20T18:59:30.362567+0000","last_clean":"2026-02-20T18:59:30.362567+0000","last_became_active":"2026-02-20T18:59:23.856817+0000","last_became_peered":"2026-02-20T18:59:23.856817+0000","last_unstale":"2026-02-20T18:59:30.362567+0000","last_undegraded":"2026-02-20T18:59:30.362567+0000","last_fullsized":"2026-02-20T18:59:30.362567+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:31:01.223867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025154799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":78,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-20T18:59:30.869592+0000","last_change":"2026-02-20T18:59:24.017114+0000","last_active":"2026-02-20T18:59:30.869592+0000","last_peered":"2026-02-20T18:59:30.869592+0000","last_clean":"2026-02-20T18:59:30.869592+0000","last_became_active":"2026-02-20T18:59:24.016989+0000","last_became_peered":"2026-02-20T18:59:24.016989+0000","last_unstale":"2026-02-20T18:59:30.869592+0000","last_undegraded":"2026-02-20T18:59:30.869592+0000","last_fullsized":"2026-02-20T18:59:30.869592+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:13:07.590533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":39,"seq":167503724561,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":296695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27746,"internal_metadata":27562910},"hb_peers":[2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":45,"seq":193273528337,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27560,"kb_used_data":600,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830040,"statfs":{"total":107374182400,"available":107345960960,"internally_reserved":0,"allocated":614400,"data_stored":288979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25788,"internal_metadata":27564868},"hb_peers":[2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528337,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27560,"kb_used_data":600,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830040,"statfs":{"total":107374182400,"available":107345960960,"internally_reserved":0,"allocated":614400,"data_stored":288979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26435,"internal_metadata":27564221},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528336,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":296695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28392,"internal_metadata":27562264},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":47,"seq":201863462929,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":24,"kb_used_meta":26919,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":296695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25138,"internal_metadata":27565518},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":45,"seq":193273528336,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27576,"kb_used_data":616,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830024,"statfs":{"total":107374182400,"available":107345944576,"internally_reserved":0,"allocated":630784,"data_stored":296714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27742,"internal_metadata":27562914},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":47,"seq":201863462929,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27584,"kb_used_data":624,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830016,"statfs":{"total":107374182400,"available":107345936384,"internally_reserved":0,"allocated":638976,"data_stored":304329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27740,"internal_metadata":27562916},"hb_peers":[2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":45,"seq":193273528337,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27560,"kb_used_data":600,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830040,"statfs":{"total":107374182400,"available":107345960960,"internally_reserved":0,"allocated":614400,"data_stored":288979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25789,"internal_metadata":27564867},"hb_peers":[3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":0,"seq":17,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27576,"kb_used_data":616,"kb_used_omap":18,"kb_used_meta":26925,"kb_avail":104830024,"statfs":{"total":107374182400,"available":107345944576,"internally_reserved":0,"allocated":630784,"data_stored":296714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19279,"internal_metadata":27571377},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":45,"seq":193273528337,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27548,"kb_used_data":588,"kb_used_omap":17,"kb_used_meta":26926,"kb_avail":104830052,"statfs":{"total":107374182400,"available":107345973248,"internally_reserved":0,"allocated":602112,"data_stored":281245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17977,"internal_metadata":27572679},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T18:59:36.616 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T18:59:36.792 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:59:36.792 INFO:teuthology.orchestra.run.trial166.stderr:dumped all 2026-02-20T18:59:36.801 INFO:teuthology.orchestra.run.trial166.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2026-02-20T18:59:36.748580+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":275680,"kb_used_data":6080,"kb_used_omap":246,"kb_used_meta":269193,"kb_avail":1048300320,"statfs":{"total":1073741824000,"available":1073459527680,"internally_reserved":0,"allocated":6225920,"data_stored":2936024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":252026,"internal_metadata":275654534},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000447"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":74,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-20T18:59:31.870339+0000","last_change":"2026-02-20T18:59:24.059743+0000","last_active":"2026-02-20T18:59:31.870339+0000","last_peered":"2026-02-20T18:59:31.870339+0000","last_clean":"2026-02-20T18:59:31.870339+0000","last_became_active":"2026-02-20T18:59:24.059643+0000","last_became_peered":"2026-02-20T18:59:24.059643+0000","last_unstale":"2026-02-20T18:59:31.870339+0000","last_undegraded":"2026-02-20T18:59:31.870339+0000","last_fullsized":"2026-02-20T18:59:31.870339+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T05:02:55.325323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000220731,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":95,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-20T18:59:30.870118+0000","last_change":"2026-02-20T18:59:21.853706+0000","last_active":"2026-02-20T18:59:30.870118+0000","last_peered":"2026-02-20T18:59:30.870118+0000","last_clean":"2026-02-20T18:59:30.870118+0000","last_became_active":"2026-02-20T18:59:21.853581+0000","last_became_peered":"2026-02-20T18:59:21.853581+0000","last_unstale":"2026-02-20T18:59:30.870118+0000","last_undegraded":"2026-02-20T18:59:30.870118+0000","last_fullsized":"2026-02-20T18:59:30.870118+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:25:32.002379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021133299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":97,"reported_epoch":55,"state":"active+undersized+wait","last_fresh":"2026-02-20T18:59:30.870084+0000","last_change":"2026-02-20T18:59:30.869950+0000","last_active":"2026-02-20T18:59:30.870084+0000","last_peered":"2026-02-20T18:59:30.870084+0000","last_clean":"2026-02-20T18:59:30.362908+0000","last_became_active":"2026-02-20T18:59:30.869950+0000","last_became_peered":"2026-02-20T18:59:30.869950+0000","last_unstale":"2026-02-20T18:59:30.870084+0000","last_undegraded":"2026-02-20T18:59:30.870084+0000","last_fullsized":"2026-02-20T18:59:30.869702+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:35:43.039850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000249194,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9],"acting":[9],"avail_no_missing":["9"],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":53,"reported_epoch":55,"state":"active+undersized","last_fresh":"2026-02-20T18:59:30.870433+0000","last_change":"2026-02-20T18:59:30.870357+0000","last_active":"2026-02-20T18:59:30.870433+0000","last_peered":"2026-02-20T18:59:30.870433+0000","last_clean":"2026-02-20T18:59:19.257604+0000","last_became_active":"2026-02-20T18:59:30.870357+0000","last_became_peered":"2026-02-20T18:59:30.870357+0000","last_unstale":"2026-02-20T18:59:30.870433+0000","last_undegraded":"2026-02-20T18:59:30.870433+0000","last_fullsized":"2026-02-20T18:59:30.870144+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:29:49.641457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6],"acting":[6],"avail_no_missing":["6"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.3","version":"17'1","reported_seq":90,"reported_epoch":56,"state":"active+undersized+degraded","last_fresh":"2026-02-20T18:59:31.870317+0000","last_change":"2026-02-20T18:59:30.869872+0000","last_active":"2026-02-20T18:59:31.870317+0000","last_peered":"2026-02-20T18:59:31.870317+0000","last_clean":"2026-02-20T18:59:30.362536+0000","last_became_active":"2026-02-20T18:59:30.869872+0000","last_became_peered":"2026-02-20T18:59:30.869872+0000","last_unstale":"2026-02-20T18:59:31.870317+0000","last_undegraded":"2026-02-20T18:59:30.869708+0000","last_fullsized":"2026-02-20T18:59:30.869669+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:05:43.626018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":1}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"19'2","reported_seq":95,"reported_epoch":56,"state":"active+undersized+degraded","last_fresh":"2026-02-20T18:59:32.315165+0000","last_change":"2026-02-20T18:59:30.870429+0000","last_active":"2026-02-20T18:59:32.315165+0000","last_peered":"2026-02-20T18:59:32.315165+0000","last_clean":"2026-02-20T18:59:29.860028+0000","last_became_active":"2026-02-20T18:59:30.870429+0000","last_became_peered":"2026-02-20T18:59:30.870429+0000","last_unstale":"2026-02-20T18:59:32.315165+0000","last_undegraded":"2026-02-20T18:59:30.870236+0000","last_fullsized":"2026-02-20T18:59:30.870202+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T04:29:34.733799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000423428,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":1}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-20T18:59:30.362567+0000","last_change":"2026-02-20T18:59:23.856920+0000","last_active":"2026-02-20T18:59:30.362567+0000","last_peered":"2026-02-20T18:59:30.362567+0000","last_clean":"2026-02-20T18:59:30.362567+0000","last_became_active":"2026-02-20T18:59:23.856817+0000","last_became_peered":"2026-02-20T18:59:23.856817+0000","last_unstale":"2026-02-20T18:59:30.362567+0000","last_undegraded":"2026-02-20T18:59:30.362567+0000","last_fullsized":"2026-02-20T18:59:30.362567+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:31:01.223867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025154799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":78,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-20T18:59:30.869592+0000","last_change":"2026-02-20T18:59:24.017114+0000","last_active":"2026-02-20T18:59:30.869592+0000","last_peered":"2026-02-20T18:59:30.869592+0000","last_clean":"2026-02-20T18:59:30.869592+0000","last_became_active":"2026-02-20T18:59:24.016989+0000","last_became_peered":"2026-02-20T18:59:24.016989+0000","last_unstale":"2026-02-20T18:59:30.869592+0000","last_undegraded":"2026-02-20T18:59:30.869592+0000","last_fullsized":"2026-02-20T18:59:30.869592+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:13:07.590533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":39,"seq":167503724561,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":296695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27746,"internal_metadata":27562910},"hb_peers":[2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":45,"seq":193273528337,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27560,"kb_used_data":600,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830040,"statfs":{"total":107374182400,"available":107345960960,"internally_reserved":0,"allocated":614400,"data_stored":288979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25788,"internal_metadata":27564868},"hb_peers":[2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528337,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27560,"kb_used_data":600,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830040,"statfs":{"total":107374182400,"available":107345960960,"internally_reserved":0,"allocated":614400,"data_stored":288979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26435,"internal_metadata":27564221},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528336,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":296695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28392,"internal_metadata":27562264},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":47,"seq":201863462929,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":24,"kb_used_meta":26919,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":296695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25138,"internal_metadata":27565518},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":45,"seq":193273528336,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27576,"kb_used_data":616,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830024,"statfs":{"total":107374182400,"available":107345944576,"internally_reserved":0,"allocated":630784,"data_stored":296714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27742,"internal_metadata":27562914},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":47,"seq":201863462929,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27584,"kb_used_data":624,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830016,"statfs":{"total":107374182400,"available":107345936384,"internally_reserved":0,"allocated":638976,"data_stored":304329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27740,"internal_metadata":27562916},"hb_peers":[2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":45,"seq":193273528337,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27560,"kb_used_data":600,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830040,"statfs":{"total":107374182400,"available":107345960960,"internally_reserved":0,"allocated":614400,"data_stored":288979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25789,"internal_metadata":27564867},"hb_peers":[3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":0,"seq":17,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27576,"kb_used_data":616,"kb_used_omap":18,"kb_used_meta":26925,"kb_avail":104830024,"statfs":{"total":107374182400,"available":107345944576,"internally_reserved":0,"allocated":630784,"data_stored":296714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19279,"internal_metadata":27571377},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":45,"seq":193273528337,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27548,"kb_used_data":588,"kb_used_omap":17,"kb_used_meta":26926,"kb_avail":104830052,"statfs":{"total":107374182400,"available":107345973248,"internally_reserved":0,"allocated":602112,"data_stored":281245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17977,"internal_metadata":27572679},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T18:59:36.803 INFO:tasks.ceph.ceph_manager.ceph:PG 1.5 is not active+clean 2026-02-20T18:59:36.803 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '1.5', 'version': "0'0", 'reported_seq': 97, 'reported_epoch': 55, 'state': 'active+undersized+wait', 'last_fresh': '2026-02-20T18:59:30.870084+0000', 'last_change': '2026-02-20T18:59:30.869950+0000', 'last_active': '2026-02-20T18:59:30.870084+0000', 'last_peered': '2026-02-20T18:59:30.870084+0000', 'last_clean': '2026-02-20T18:59:30.362908+0000', 'last_became_active': '2026-02-20T18:59:30.869950+0000', 'last_became_peered': '2026-02-20T18:59:30.869950+0000', 'last_unstale': '2026-02-20T18:59:30.870084+0000', 'last_undegraded': '2026-02-20T18:59:30.870084+0000', 'last_fullsized': '2026-02-20T18:59:30.869702+0000', 'mapping_epoch': 54, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 46, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-20T18:58:27.804883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-20T18:58:27.804883+0000', 'last_clean_scrub_stamp': '2026-02-20T18:58:27.804883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2026-02-21T21:35:43.039850+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0.000249194, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [9], 'acting': [9], 'avail_no_missing': ['9'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 9, 'acting_primary': 9, 'purged_snaps': []} 2026-02-20T18:59:36.803 INFO:tasks.ceph.ceph_manager.ceph:PG 1.4 is not active+clean 2026-02-20T18:59:36.803 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '1.4', 'version': "0'0", 'reported_seq': 53, 'reported_epoch': 55, 'state': 'active+undersized', 'last_fresh': '2026-02-20T18:59:30.870433+0000', 'last_change': '2026-02-20T18:59:30.870357+0000', 'last_active': '2026-02-20T18:59:30.870433+0000', 'last_peered': '2026-02-20T18:59:30.870433+0000', 'last_clean': '2026-02-20T18:59:19.257604+0000', 'last_became_active': '2026-02-20T18:59:30.870357+0000', 'last_became_peered': '2026-02-20T18:59:30.870357+0000', 'last_unstale': '2026-02-20T18:59:30.870433+0000', 'last_undegraded': '2026-02-20T18:59:30.870433+0000', 'last_fullsized': '2026-02-20T18:59:30.870144+0000', 'mapping_epoch': 54, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 46, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-20T18:58:27.804883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-20T18:58:27.804883+0000', 'last_clean_scrub_stamp': '2026-02-20T18:58:27.804883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2026-02-21T20:29:49.641457+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6], 'acting': [6], 'avail_no_missing': ['6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2026-02-20T18:59:36.804 INFO:tasks.ceph.ceph_manager.ceph:PG 1.3 is not active+clean 2026-02-20T18:59:36.804 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '1.3', 'version': "17'1", 'reported_seq': 90, 'reported_epoch': 56, 'state': 'active+undersized+degraded', 'last_fresh': '2026-02-20T18:59:31.870317+0000', 'last_change': '2026-02-20T18:59:30.869872+0000', 'last_active': '2026-02-20T18:59:31.870317+0000', 'last_peered': '2026-02-20T18:59:31.870317+0000', 'last_clean': '2026-02-20T18:59:30.362536+0000', 'last_became_active': '2026-02-20T18:59:30.869872+0000', 'last_became_peered': '2026-02-20T18:59:30.869872+0000', 'last_unstale': '2026-02-20T18:59:31.870317+0000', 'last_undegraded': '2026-02-20T18:59:30.869708+0000', 'last_fullsized': '2026-02-20T18:59:30.869669+0000', 'mapping_epoch': 54, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 48, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-20T18:58:27.804883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-20T18:58:27.804883+0000', 'last_clean_scrub_stamp': '2026-02-20T18:58:27.804883+0000', 'objects_scrubbed': 0, 'log_size': 1, 'log_dups_size': 0, 'ondisk_log_size': 1, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2026-02-22T00:05:43.626018+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 1, 'num_object_clones': 0, 'num_object_copies': 2, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 1, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 1, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3], 'acting': [3], 'avail_no_missing': ['3'], 'object_location_counts': [{'shards': '3', 'objects': 1}], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2026-02-20T18:59:36.804 INFO:tasks.ceph.ceph_manager.ceph:PG 1.2 is not active+clean 2026-02-20T18:59:36.804 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '1.2', 'version': "19'2", 'reported_seq': 95, 'reported_epoch': 56, 'state': 'active+undersized+degraded', 'last_fresh': '2026-02-20T18:59:32.315165+0000', 'last_change': '2026-02-20T18:59:30.870429+0000', 'last_active': '2026-02-20T18:59:32.315165+0000', 'last_peered': '2026-02-20T18:59:32.315165+0000', 'last_clean': '2026-02-20T18:59:29.860028+0000', 'last_became_active': '2026-02-20T18:59:30.870429+0000', 'last_became_peered': '2026-02-20T18:59:30.870429+0000', 'last_unstale': '2026-02-20T18:59:32.315165+0000', 'last_undegraded': '2026-02-20T18:59:30.870236+0000', 'last_fullsized': '2026-02-20T18:59:30.870202+0000', 'mapping_epoch': 54, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 46, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-20T18:58:27.804883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-20T18:58:27.804883+0000', 'last_clean_scrub_stamp': '2026-02-20T18:58:27.804883+0000', 'objects_scrubbed': 0, 'log_size': 2, 'log_dups_size': 0, 'ondisk_log_size': 2, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2026-02-22T04:29:34.733799+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0.000423428, 'stat_sum': {'num_bytes': 19, 'num_objects': 1, 'num_object_clones': 0, 'num_object_copies': 2, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 1, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 1, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 2, 'num_write_kb': 2, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 1, 'num_bytes_recovered': 19, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4], 'acting': [4], 'avail_no_missing': ['4'], 'object_location_counts': [{'shards': '4', 'objects': 1}], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2026-02-20T18:59:36.804 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2026-02-20T18:59:37.025 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:59:37.025 INFO:teuthology.orchestra.run.trial166.stdout:{"fsid":"cad5469e-fabd-4bbc-8156-013ef5fb2250","health":{"status":"HEALTH_WARN","checks":{"OSDMAP_FLAGS":{"severity":"HEALTH_WARN","summary":{"message":"noout flag(s) set","count":5},"muted":false},"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 2/4 objects degraded (50.000%), 2 pgs degraded","count":2},"muted":false}},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":80,"monmap":{"epoch":1,"min_mon_release_name":"tentacle","num_mons":1},"osdmap":{"epoch":60,"num_osds":10,"num_up_osds":10,"osd_up_since":1771613974,"num_in_osds":10,"osd_in_since":1771613898,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":4},{"state_name":"active+undersized+degraded","count":2},{"state_name":"active+undersized+wait","count":1},{"state_name":"active+undersized","count":1}],"num_pgs":8,"num_pools":1,"num_objects":2,"data_bytes":19,"bytes_used":282296320,"bytes_avail":1073459527680,"bytes_total":1073741824000,"degraded_objects":2,"degraded_total":4,"degraded_ratio":0.5},"fsmap":{"epoch":1,"btime":"2026-02-20T18:58:16:652499+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs"],"services":{}},"servicemap":{"epoch":4,"modified":"2026-02-20T18:59:24.747300+0000","services":{}},"progress_events":{}} 2026-02-20T18:59:37.034 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2026-02-20T18:59:37.034 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T18:59:37.211 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:59:37.211 INFO:teuthology.orchestra.run.trial166.stderr:dumped all 2026-02-20T18:59:37.219 INFO:teuthology.orchestra.run.trial166.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2026-02-20T18:59:36.748580+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":275680,"kb_used_data":6080,"kb_used_omap":246,"kb_used_meta":269193,"kb_avail":1048300320,"statfs":{"total":1073741824000,"available":1073459527680,"internally_reserved":0,"allocated":6225920,"data_stored":2936024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":252026,"internal_metadata":275654534},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000447"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":74,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-20T18:59:31.870339+0000","last_change":"2026-02-20T18:59:24.059743+0000","last_active":"2026-02-20T18:59:31.870339+0000","last_peered":"2026-02-20T18:59:31.870339+0000","last_clean":"2026-02-20T18:59:31.870339+0000","last_became_active":"2026-02-20T18:59:24.059643+0000","last_became_peered":"2026-02-20T18:59:24.059643+0000","last_unstale":"2026-02-20T18:59:31.870339+0000","last_undegraded":"2026-02-20T18:59:31.870339+0000","last_fullsized":"2026-02-20T18:59:31.870339+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T05:02:55.325323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000220731,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":95,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-20T18:59:30.870118+0000","last_change":"2026-02-20T18:59:21.853706+0000","last_active":"2026-02-20T18:59:30.870118+0000","last_peered":"2026-02-20T18:59:30.870118+0000","last_clean":"2026-02-20T18:59:30.870118+0000","last_became_active":"2026-02-20T18:59:21.853581+0000","last_became_peered":"2026-02-20T18:59:21.853581+0000","last_unstale":"2026-02-20T18:59:30.870118+0000","last_undegraded":"2026-02-20T18:59:30.870118+0000","last_fullsized":"2026-02-20T18:59:30.870118+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:25:32.002379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021133299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":97,"reported_epoch":55,"state":"active+undersized+wait","last_fresh":"2026-02-20T18:59:30.870084+0000","last_change":"2026-02-20T18:59:30.869950+0000","last_active":"2026-02-20T18:59:30.870084+0000","last_peered":"2026-02-20T18:59:30.870084+0000","last_clean":"2026-02-20T18:59:30.362908+0000","last_became_active":"2026-02-20T18:59:30.869950+0000","last_became_peered":"2026-02-20T18:59:30.869950+0000","last_unstale":"2026-02-20T18:59:30.870084+0000","last_undegraded":"2026-02-20T18:59:30.870084+0000","last_fullsized":"2026-02-20T18:59:30.869702+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:35:43.039850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000249194,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9],"acting":[9],"avail_no_missing":["9"],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":53,"reported_epoch":55,"state":"active+undersized","last_fresh":"2026-02-20T18:59:30.870433+0000","last_change":"2026-02-20T18:59:30.870357+0000","last_active":"2026-02-20T18:59:30.870433+0000","last_peered":"2026-02-20T18:59:30.870433+0000","last_clean":"2026-02-20T18:59:19.257604+0000","last_became_active":"2026-02-20T18:59:30.870357+0000","last_became_peered":"2026-02-20T18:59:30.870357+0000","last_unstale":"2026-02-20T18:59:30.870433+0000","last_undegraded":"2026-02-20T18:59:30.870433+0000","last_fullsized":"2026-02-20T18:59:30.870144+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:29:49.641457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6],"acting":[6],"avail_no_missing":["6"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.3","version":"17'1","reported_seq":90,"reported_epoch":56,"state":"active+undersized+degraded","last_fresh":"2026-02-20T18:59:31.870317+0000","last_change":"2026-02-20T18:59:30.869872+0000","last_active":"2026-02-20T18:59:31.870317+0000","last_peered":"2026-02-20T18:59:31.870317+0000","last_clean":"2026-02-20T18:59:30.362536+0000","last_became_active":"2026-02-20T18:59:30.869872+0000","last_became_peered":"2026-02-20T18:59:30.869872+0000","last_unstale":"2026-02-20T18:59:31.870317+0000","last_undegraded":"2026-02-20T18:59:30.869708+0000","last_fullsized":"2026-02-20T18:59:30.869669+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:05:43.626018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":1}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"19'2","reported_seq":95,"reported_epoch":56,"state":"active+undersized+degraded","last_fresh":"2026-02-20T18:59:32.315165+0000","last_change":"2026-02-20T18:59:30.870429+0000","last_active":"2026-02-20T18:59:32.315165+0000","last_peered":"2026-02-20T18:59:32.315165+0000","last_clean":"2026-02-20T18:59:29.860028+0000","last_became_active":"2026-02-20T18:59:30.870429+0000","last_became_peered":"2026-02-20T18:59:30.870429+0000","last_unstale":"2026-02-20T18:59:32.315165+0000","last_undegraded":"2026-02-20T18:59:30.870236+0000","last_fullsized":"2026-02-20T18:59:30.870202+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T04:29:34.733799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000423428,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":1}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-20T18:59:30.362567+0000","last_change":"2026-02-20T18:59:23.856920+0000","last_active":"2026-02-20T18:59:30.362567+0000","last_peered":"2026-02-20T18:59:30.362567+0000","last_clean":"2026-02-20T18:59:30.362567+0000","last_became_active":"2026-02-20T18:59:23.856817+0000","last_became_peered":"2026-02-20T18:59:23.856817+0000","last_unstale":"2026-02-20T18:59:30.362567+0000","last_undegraded":"2026-02-20T18:59:30.362567+0000","last_fullsized":"2026-02-20T18:59:30.362567+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:31:01.223867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025154799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":78,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-20T18:59:30.869592+0000","last_change":"2026-02-20T18:59:24.017114+0000","last_active":"2026-02-20T18:59:30.869592+0000","last_peered":"2026-02-20T18:59:30.869592+0000","last_clean":"2026-02-20T18:59:30.869592+0000","last_became_active":"2026-02-20T18:59:24.016989+0000","last_became_peered":"2026-02-20T18:59:24.016989+0000","last_unstale":"2026-02-20T18:59:30.869592+0000","last_undegraded":"2026-02-20T18:59:30.869592+0000","last_fullsized":"2026-02-20T18:59:30.869592+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:13:07.590533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":39,"seq":167503724561,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":296695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27746,"internal_metadata":27562910},"hb_peers":[2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":45,"seq":193273528337,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27560,"kb_used_data":600,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830040,"statfs":{"total":107374182400,"available":107345960960,"internally_reserved":0,"allocated":614400,"data_stored":288979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25788,"internal_metadata":27564868},"hb_peers":[2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528337,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27560,"kb_used_data":600,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830040,"statfs":{"total":107374182400,"available":107345960960,"internally_reserved":0,"allocated":614400,"data_stored":288979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26435,"internal_metadata":27564221},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528336,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":296695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28392,"internal_metadata":27562264},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":47,"seq":201863462929,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":24,"kb_used_meta":26919,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":296695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25138,"internal_metadata":27565518},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":45,"seq":193273528336,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27576,"kb_used_data":616,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830024,"statfs":{"total":107374182400,"available":107345944576,"internally_reserved":0,"allocated":630784,"data_stored":296714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27742,"internal_metadata":27562914},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":47,"seq":201863462929,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27584,"kb_used_data":624,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830016,"statfs":{"total":107374182400,"available":107345936384,"internally_reserved":0,"allocated":638976,"data_stored":304329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27740,"internal_metadata":27562916},"hb_peers":[2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":45,"seq":193273528337,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27560,"kb_used_data":600,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830040,"statfs":{"total":107374182400,"available":107345960960,"internally_reserved":0,"allocated":614400,"data_stored":288979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25789,"internal_metadata":27564867},"hb_peers":[3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":0,"seq":17,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27576,"kb_used_data":616,"kb_used_omap":18,"kb_used_meta":26925,"kb_avail":104830024,"statfs":{"total":107374182400,"available":107345944576,"internally_reserved":0,"allocated":630784,"data_stored":296714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19279,"internal_metadata":27571377},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":45,"seq":193273528337,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27548,"kb_used_data":588,"kb_used_omap":17,"kb_used_meta":26926,"kb_avail":104830052,"statfs":{"total":107374182400,"available":107345973248,"internally_reserved":0,"allocated":602112,"data_stored":281245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17977,"internal_metadata":27572679},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T18:59:40.221 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T18:59:40.402 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:59:40.403 INFO:teuthology.orchestra.run.trial166.stderr:dumped all 2026-02-20T18:59:40.410 INFO:teuthology.orchestra.run.trial166.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2026-02-20T18:59:38.748829+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":276304,"kb_used_data":6704,"kb_used_omap":271,"kb_used_meta":269168,"kb_avail":1048299696,"statfs":{"total":1073741824000,"available":1073458888704,"internally_reserved":0,"allocated":6864896,"data_stored":3342124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":278066,"internal_metadata":275628494},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.877044"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":81,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-20T18:59:36.260981+0000","last_change":"2026-02-20T18:59:24.059743+0000","last_active":"2026-02-20T18:59:36.260981+0000","last_peered":"2026-02-20T18:59:36.260981+0000","last_clean":"2026-02-20T18:59:36.260981+0000","last_became_active":"2026-02-20T18:59:24.059643+0000","last_became_peered":"2026-02-20T18:59:24.059643+0000","last_unstale":"2026-02-20T18:59:36.260981+0000","last_undegraded":"2026-02-20T18:59:36.260981+0000","last_fullsized":"2026-02-20T18:59:36.260981+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T05:02:55.325323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000220731,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":105,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-20T18:59:36.260639+0000","last_change":"2026-02-20T18:59:21.853706+0000","last_active":"2026-02-20T18:59:36.260639+0000","last_peered":"2026-02-20T18:59:36.260639+0000","last_clean":"2026-02-20T18:59:36.260639+0000","last_became_active":"2026-02-20T18:59:21.853581+0000","last_became_peered":"2026-02-20T18:59:21.853581+0000","last_unstale":"2026-02-20T18:59:36.260639+0000","last_undegraded":"2026-02-20T18:59:36.260639+0000","last_fullsized":"2026-02-20T18:59:36.260639+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:25:32.002379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021133299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":112,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-20T18:59:35.880835+0000","last_change":"2026-02-20T18:59:35.880783+0000","last_active":"2026-02-20T18:59:35.880835+0000","last_peered":"2026-02-20T18:59:35.880835+0000","last_clean":"2026-02-20T18:59:35.880835+0000","last_became_active":"2026-02-20T18:59:35.880672+0000","last_became_peered":"2026-02-20T18:59:35.880672+0000","last_unstale":"2026-02-20T18:59:35.880835+0000","last_undegraded":"2026-02-20T18:59:35.880835+0000","last_fullsized":"2026-02-20T18:59:35.880835+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:19:02.528907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000249194,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":81,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-20T18:59:36.260691+0000","last_change":"2026-02-20T18:59:34.140851+0000","last_active":"2026-02-20T18:59:36.260691+0000","last_peered":"2026-02-20T18:59:36.260691+0000","last_clean":"2026-02-20T18:59:36.260691+0000","last_became_active":"2026-02-20T18:59:34.140758+0000","last_became_peered":"2026-02-20T18:59:34.140758+0000","last_unstale":"2026-02-20T18:59:36.260691+0000","last_undegraded":"2026-02-20T18:59:36.260691+0000","last_fullsized":"2026-02-20T18:59:36.260691+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:20:42.796194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"17'1","reported_seq":103,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-20T18:59:36.260983+0000","last_change":"2026-02-20T18:59:33.876042+0000","last_active":"2026-02-20T18:59:36.260983+0000","last_peered":"2026-02-20T18:59:36.260983+0000","last_clean":"2026-02-20T18:59:36.260983+0000","last_became_active":"2026-02-20T18:59:33.875925+0000","last_became_peered":"2026-02-20T18:59:33.875925+0000","last_unstale":"2026-02-20T18:59:36.260983+0000","last_undegraded":"2026-02-20T18:59:36.260983+0000","last_fullsized":"2026-02-20T18:59:36.260983+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T05:23:53.225099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"19'2","reported_seq":109,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-20T18:59:35.879780+0000","last_change":"2026-02-20T18:59:33.876206+0000","last_active":"2026-02-20T18:59:35.879780+0000","last_peered":"2026-02-20T18:59:35.879780+0000","last_clean":"2026-02-20T18:59:35.879780+0000","last_became_active":"2026-02-20T18:59:33.876053+0000","last_became_peered":"2026-02-20T18:59:33.876053+0000","last_unstale":"2026-02-20T18:59:35.879780+0000","last_undegraded":"2026-02-20T18:59:35.879780+0000","last_fullsized":"2026-02-20T18:59:35.879780+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T01:19:28.216183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000423428,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":85,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-20T18:59:35.879849+0000","last_change":"2026-02-20T18:59:23.856920+0000","last_active":"2026-02-20T18:59:35.879849+0000","last_peered":"2026-02-20T18:59:35.879849+0000","last_clean":"2026-02-20T18:59:35.879849+0000","last_became_active":"2026-02-20T18:59:23.856817+0000","last_became_peered":"2026-02-20T18:59:23.856817+0000","last_unstale":"2026-02-20T18:59:35.879849+0000","last_undegraded":"2026-02-20T18:59:35.879849+0000","last_fullsized":"2026-02-20T18:59:35.879849+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:31:01.223867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025154799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":86,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-20T18:59:36.260861+0000","last_change":"2026-02-20T18:59:24.017114+0000","last_active":"2026-02-20T18:59:36.260861+0000","last_peered":"2026-02-20T18:59:36.260861+0000","last_clean":"2026-02-20T18:59:36.260861+0000","last_became_active":"2026-02-20T18:59:24.016989+0000","last_became_peered":"2026-02-20T18:59:24.016989+0000","last_unstale":"2026-02-20T18:59:36.260861+0000","last_undegraded":"2026-02-20T18:59:36.260861+0000","last_fullsized":"2026-02-20T18:59:36.260861+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:13:07.590533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":39,"seq":167503724562,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":29,"kb_used_meta":26914,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":328095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29699,"internal_metadata":27560957},"hb_peers":[1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":45,"seq":193273528338,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":328095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27741,"internal_metadata":27562915},"hb_peers":[0,1,2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528338,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27632,"kb_used_data":672,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104829968,"statfs":{"total":107374182400,"available":107345887232,"internally_reserved":0,"allocated":688128,"data_stored":335737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29690,"internal_metadata":27560966},"hb_peers":[2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528337,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27632,"kb_used_data":672,"kb_used_omap":30,"kb_used_meta":26913,"kb_avail":104829968,"statfs":{"total":107374182400,"available":107345887232,"internally_reserved":0,"allocated":688128,"data_stored":335737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31647,"internal_metadata":27559009},"hb_peers":[2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":47,"seq":201863462930,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27632,"kb_used_data":672,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":104829968,"statfs":{"total":107374182400,"available":107345887232,"internally_reserved":0,"allocated":688128,"data_stored":335737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27091,"internal_metadata":27563565},"hb_peers":[2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":45,"seq":193273528337,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27636,"kb_used_data":676,"kb_used_omap":30,"kb_used_meta":26913,"kb_avail":104829964,"statfs":{"total":107374182400,"available":107345883136,"internally_reserved":0,"allocated":692224,"data_stored":335756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30997,"internal_metadata":27559659},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":47,"seq":201863462930,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27632,"kb_used_data":672,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104829968,"statfs":{"total":107374182400,"available":107345887232,"internally_reserved":0,"allocated":688128,"data_stored":335737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29693,"internal_metadata":27560963},"hb_peers":[2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":45,"seq":193273528338,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27632,"kb_used_data":672,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104829968,"statfs":{"total":107374182400,"available":107345887232,"internally_reserved":0,"allocated":688128,"data_stored":335737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29044,"internal_metadata":27561612},"hb_peers":[0,1,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":57,"seq":244813135890,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27636,"kb_used_data":676,"kb_used_omap":18,"kb_used_meta":26925,"kb_avail":104829964,"statfs":{"total":107374182400,"available":107345883136,"internally_reserved":0,"allocated":692224,"data_stored":335756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19279,"internal_metadata":27571377},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":59,"seq":253403070482,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27632,"kb_used_data":672,"kb_used_omap":22,"kb_used_meta":26921,"kb_avail":104829968,"statfs":{"total":107374182400,"available":107345887232,"internally_reserved":0,"allocated":688128,"data_stored":335737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23185,"internal_metadata":27567471},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T18:59:40.411 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-20T18:59:40.411 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T18:59:40.596 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:59:40.597 INFO:teuthology.orchestra.run.trial166.stderr:dumped all 2026-02-20T18:59:40.605 INFO:teuthology.orchestra.run.trial166.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2026-02-20T18:59:38.748829+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":276304,"kb_used_data":6704,"kb_used_omap":271,"kb_used_meta":269168,"kb_avail":1048299696,"statfs":{"total":1073741824000,"available":1073458888704,"internally_reserved":0,"allocated":6864896,"data_stored":3342124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":278066,"internal_metadata":275628494},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.877044"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":81,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-20T18:59:36.260981+0000","last_change":"2026-02-20T18:59:24.059743+0000","last_active":"2026-02-20T18:59:36.260981+0000","last_peered":"2026-02-20T18:59:36.260981+0000","last_clean":"2026-02-20T18:59:36.260981+0000","last_became_active":"2026-02-20T18:59:24.059643+0000","last_became_peered":"2026-02-20T18:59:24.059643+0000","last_unstale":"2026-02-20T18:59:36.260981+0000","last_undegraded":"2026-02-20T18:59:36.260981+0000","last_fullsized":"2026-02-20T18:59:36.260981+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T05:02:55.325323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000220731,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":105,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-20T18:59:36.260639+0000","last_change":"2026-02-20T18:59:21.853706+0000","last_active":"2026-02-20T18:59:36.260639+0000","last_peered":"2026-02-20T18:59:36.260639+0000","last_clean":"2026-02-20T18:59:36.260639+0000","last_became_active":"2026-02-20T18:59:21.853581+0000","last_became_peered":"2026-02-20T18:59:21.853581+0000","last_unstale":"2026-02-20T18:59:36.260639+0000","last_undegraded":"2026-02-20T18:59:36.260639+0000","last_fullsized":"2026-02-20T18:59:36.260639+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:25:32.002379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021133299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":112,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-20T18:59:35.880835+0000","last_change":"2026-02-20T18:59:35.880783+0000","last_active":"2026-02-20T18:59:35.880835+0000","last_peered":"2026-02-20T18:59:35.880835+0000","last_clean":"2026-02-20T18:59:35.880835+0000","last_became_active":"2026-02-20T18:59:35.880672+0000","last_became_peered":"2026-02-20T18:59:35.880672+0000","last_unstale":"2026-02-20T18:59:35.880835+0000","last_undegraded":"2026-02-20T18:59:35.880835+0000","last_fullsized":"2026-02-20T18:59:35.880835+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:19:02.528907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000249194,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":81,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-20T18:59:36.260691+0000","last_change":"2026-02-20T18:59:34.140851+0000","last_active":"2026-02-20T18:59:36.260691+0000","last_peered":"2026-02-20T18:59:36.260691+0000","last_clean":"2026-02-20T18:59:36.260691+0000","last_became_active":"2026-02-20T18:59:34.140758+0000","last_became_peered":"2026-02-20T18:59:34.140758+0000","last_unstale":"2026-02-20T18:59:36.260691+0000","last_undegraded":"2026-02-20T18:59:36.260691+0000","last_fullsized":"2026-02-20T18:59:36.260691+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:20:42.796194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"17'1","reported_seq":103,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-20T18:59:36.260983+0000","last_change":"2026-02-20T18:59:33.876042+0000","last_active":"2026-02-20T18:59:36.260983+0000","last_peered":"2026-02-20T18:59:36.260983+0000","last_clean":"2026-02-20T18:59:36.260983+0000","last_became_active":"2026-02-20T18:59:33.875925+0000","last_became_peered":"2026-02-20T18:59:33.875925+0000","last_unstale":"2026-02-20T18:59:36.260983+0000","last_undegraded":"2026-02-20T18:59:36.260983+0000","last_fullsized":"2026-02-20T18:59:36.260983+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T05:23:53.225099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"19'2","reported_seq":109,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-20T18:59:35.879780+0000","last_change":"2026-02-20T18:59:33.876206+0000","last_active":"2026-02-20T18:59:35.879780+0000","last_peered":"2026-02-20T18:59:35.879780+0000","last_clean":"2026-02-20T18:59:35.879780+0000","last_became_active":"2026-02-20T18:59:33.876053+0000","last_became_peered":"2026-02-20T18:59:33.876053+0000","last_unstale":"2026-02-20T18:59:35.879780+0000","last_undegraded":"2026-02-20T18:59:35.879780+0000","last_fullsized":"2026-02-20T18:59:35.879780+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T01:19:28.216183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000423428,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":85,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-20T18:59:35.879849+0000","last_change":"2026-02-20T18:59:23.856920+0000","last_active":"2026-02-20T18:59:35.879849+0000","last_peered":"2026-02-20T18:59:35.879849+0000","last_clean":"2026-02-20T18:59:35.879849+0000","last_became_active":"2026-02-20T18:59:23.856817+0000","last_became_peered":"2026-02-20T18:59:23.856817+0000","last_unstale":"2026-02-20T18:59:35.879849+0000","last_undegraded":"2026-02-20T18:59:35.879849+0000","last_fullsized":"2026-02-20T18:59:35.879849+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:31:01.223867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025154799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":86,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-20T18:59:36.260861+0000","last_change":"2026-02-20T18:59:24.017114+0000","last_active":"2026-02-20T18:59:36.260861+0000","last_peered":"2026-02-20T18:59:36.260861+0000","last_clean":"2026-02-20T18:59:36.260861+0000","last_became_active":"2026-02-20T18:59:24.016989+0000","last_became_peered":"2026-02-20T18:59:24.016989+0000","last_unstale":"2026-02-20T18:59:36.260861+0000","last_undegraded":"2026-02-20T18:59:36.260861+0000","last_fullsized":"2026-02-20T18:59:36.260861+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:13:07.590533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":39,"seq":167503724562,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":29,"kb_used_meta":26914,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":328095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29699,"internal_metadata":27560957},"hb_peers":[1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":45,"seq":193273528338,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":328095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27741,"internal_metadata":27562915},"hb_peers":[0,1,2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528338,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27632,"kb_used_data":672,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104829968,"statfs":{"total":107374182400,"available":107345887232,"internally_reserved":0,"allocated":688128,"data_stored":335737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29690,"internal_metadata":27560966},"hb_peers":[2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528337,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27632,"kb_used_data":672,"kb_used_omap":30,"kb_used_meta":26913,"kb_avail":104829968,"statfs":{"total":107374182400,"available":107345887232,"internally_reserved":0,"allocated":688128,"data_stored":335737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31647,"internal_metadata":27559009},"hb_peers":[2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":47,"seq":201863462930,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27632,"kb_used_data":672,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":104829968,"statfs":{"total":107374182400,"available":107345887232,"internally_reserved":0,"allocated":688128,"data_stored":335737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27091,"internal_metadata":27563565},"hb_peers":[2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":45,"seq":193273528337,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27636,"kb_used_data":676,"kb_used_omap":30,"kb_used_meta":26913,"kb_avail":104829964,"statfs":{"total":107374182400,"available":107345883136,"internally_reserved":0,"allocated":692224,"data_stored":335756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30997,"internal_metadata":27559659},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":47,"seq":201863462930,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27632,"kb_used_data":672,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104829968,"statfs":{"total":107374182400,"available":107345887232,"internally_reserved":0,"allocated":688128,"data_stored":335737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29693,"internal_metadata":27560963},"hb_peers":[2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":45,"seq":193273528338,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27632,"kb_used_data":672,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104829968,"statfs":{"total":107374182400,"available":107345887232,"internally_reserved":0,"allocated":688128,"data_stored":335737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29044,"internal_metadata":27561612},"hb_peers":[0,1,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":57,"seq":244813135890,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27636,"kb_used_data":676,"kb_used_omap":18,"kb_used_meta":26925,"kb_avail":104829964,"statfs":{"total":107374182400,"available":107345883136,"internally_reserved":0,"allocated":692224,"data_stored":335756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19279,"internal_metadata":27571377},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":59,"seq":253403070482,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27632,"kb_used_data":672,"kb_used_omap":22,"kb_used_meta":26921,"kb_avail":104829968,"statfs":{"total":107374182400,"available":107345887232,"internally_reserved":0,"allocated":688128,"data_stored":335737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23185,"internal_metadata":27567471},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T18:59:40.607 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T18:59:40.787 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:59:40.788 INFO:teuthology.orchestra.run.trial166.stdout:{"epoch":60,"fsid":"cad5469e-fabd-4bbc-8156-013ef5fb2250","created":"2026-02-20T18:58:16.652637+0000","modified":"2026-02-20T18:59:35.877342+0000","last_up_change":"2026-02-20T18:59:34.875412+0000","last_in_change":"2026-02-20T18:58:18.715356+0000","flags":"noout,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5800064,"flags_set":["noout","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":10,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":10,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-20T18:58:27.409785+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":0.80000001192092896,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1.0000001192092896,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"92ce9555-6fcf-4f5e-a007-9167538c59c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":58,"up_from":59,"up_thru":36,"down_at":54,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6867","nonce":3847440710},{"type":"v1","addr":"10.20.193.166:6869","nonce":3847440710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6829","nonce":3850440710},{"type":"v1","addr":"10.20.193.166:6833","nonce":3850440710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6879","nonce":3847440710},{"type":"v1","addr":"10.20.193.166:6881","nonce":3847440710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6875","nonce":3847440710},{"type":"v1","addr":"10.20.193.166:6877","nonce":3847440710}]},"public_addr":"10.20.193.166:6869/3847440710","cluster_addr":"10.20.193.166:6833/3850440710","heartbeat_back_addr":"10.20.193.166:6881/3847440710","heartbeat_front_addr":"10.20.193.166:6877/3847440710","state":["exists","up"]},{"osd":1,"uuid":"c4cb9591-7027-4bca-a8c9-46044a72651a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":56,"up_from":57,"up_thru":57,"down_at":54,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6810","nonce":392026077},{"type":"v1","addr":"10.20.193.166:6811","nonce":392026077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6855","nonce":395026077},{"type":"v1","addr":"10.20.193.166:6858","nonce":395026077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6816","nonce":392026077},{"type":"v1","addr":"10.20.193.166:6817","nonce":392026077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6814","nonce":392026077},{"type":"v1","addr":"10.20.193.166:6815","nonce":392026077}]},"public_addr":"10.20.193.166:6811/392026077","cluster_addr":"10.20.193.166:6858/395026077","heartbeat_back_addr":"10.20.193.166:6817/392026077","heartbeat_front_addr":"10.20.193.166:6815/392026077","state":["exists","up"]},{"osd":2,"uuid":"464f1ff2-d581-48ca-b7fc-47e5e1f73f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":44,"up_from":45,"up_thru":0,"down_at":42,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6820","nonce":3964298921},{"type":"v1","addr":"10.20.193.166:6824","nonce":3964298921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6882","nonce":3965298921},{"type":"v1","addr":"10.20.193.166:6883","nonce":3965298921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6846","nonce":3964298921},{"type":"v1","addr":"10.20.193.166:6849","nonce":3964298921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6837","nonce":3964298921},{"type":"v1","addr":"10.20.193.166:6842","nonce":3964298921}]},"public_addr":"10.20.193.166:6824/3964298921","cluster_addr":"10.20.193.166:6883/3965298921","heartbeat_back_addr":"10.20.193.166:6849/3964298921","heartbeat_front_addr":"10.20.193.166:6842/3964298921","state":["exists","up"]},{"osd":3,"uuid":"2981907b-df6b-4331-bd7e-530329b58dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":46,"up_from":47,"up_thru":57,"down_at":42,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6802","nonce":1425610951},{"type":"v1","addr":"10.20.193.166:6803","nonce":1425610951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6826","nonce":1426610951},{"type":"v1","addr":"10.20.193.166:6830","nonce":1426610951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6808","nonce":1425610951},{"type":"v1","addr":"10.20.193.166:6809","nonce":1425610951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6806","nonce":1425610951},{"type":"v1","addr":"10.20.193.166:6807","nonce":1425610951}]},"public_addr":"10.20.193.166:6803/1425610951","cluster_addr":"10.20.193.166:6830/1426610951","heartbeat_back_addr":"10.20.193.166:6809/1425610951","heartbeat_front_addr":"10.20.193.166:6807/1425610951","state":["exists","up"]},{"osd":4,"uuid":"a116886c-d214-430c-8bd4-133b3f8b9c44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":44,"up_from":45,"up_thru":57,"down_at":42,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6818","nonce":3868831983},{"type":"v1","addr":"10.20.193.166:6822","nonce":3868831983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6871","nonce":3869831983},{"type":"v1","addr":"10.20.193.166:6873","nonce":3869831983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6841","nonce":3868831983},{"type":"v1","addr":"10.20.193.166:6844","nonce":3868831983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6834","nonce":3868831983},{"type":"v1","addr":"10.20.193.166:6838","nonce":3868831983}]},"public_addr":"10.20.193.166:6822/3868831983","cluster_addr":"10.20.193.166:6873/3869831983","heartbeat_back_addr":"10.20.193.166:6844/3868831983","heartbeat_front_addr":"10.20.193.166:6838/3868831983","state":["exists","up"]},{"osd":5,"uuid":"3cf9e90b-a16c-4bc4-a3e8-c4a3561cad76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":46,"up_from":47,"up_thru":47,"down_at":42,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6851","nonce":210540616},{"type":"v1","addr":"10.20.193.166:6853","nonce":210540616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6804","nonce":211540616},{"type":"v1","addr":"10.20.193.166:6805","nonce":211540616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6864","nonce":210540616},{"type":"v1","addr":"10.20.193.166:6865","nonce":210540616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6860","nonce":210540616},{"type":"v1","addr":"10.20.193.166:6862","nonce":210540616}]},"public_addr":"10.20.193.166:6853/210540616","cluster_addr":"10.20.193.166:6805/211540616","heartbeat_back_addr":"10.20.193.166:6865/210540616","heartbeat_front_addr":"10.20.193.166:6862/210540616","state":["exists","up"]},{"osd":6,"uuid":"48b3a52d-4c9d-41cf-bc51-5fc760c673c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":44,"up_from":45,"up_thru":54,"down_at":42,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6821","nonce":4000130133},{"type":"v1","addr":"10.20.193.166:6825","nonce":4000130133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6856","nonce":4001130133},{"type":"v1","addr":"10.20.193.166:6813","nonce":4001130133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6845","nonce":4000130133},{"type":"v1","addr":"10.20.193.166:6848","nonce":4000130133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6836","nonce":4000130133},{"type":"v1","addr":"10.20.193.166:6840","nonce":4000130133}]},"public_addr":"10.20.193.166:6825/4000130133","cluster_addr":"10.20.193.166:6813/4001130133","heartbeat_back_addr":"10.20.193.166:6848/4000130133","heartbeat_front_addr":"10.20.193.166:6840/4000130133","state":["exists","up"]},{"osd":7,"uuid":"d35fdf64-6e54-4df1-9acd-38d4fb0bf6e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":44,"up_from":45,"up_thru":47,"down_at":42,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6819","nonce":2437073090},{"type":"v1","addr":"10.20.193.166:6823","nonce":2437073090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6854","nonce":2438073090},{"type":"v1","addr":"10.20.193.166:6872","nonce":2438073090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6843","nonce":2437073090},{"type":"v1","addr":"10.20.193.166:6847","nonce":2437073090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6835","nonce":2437073090},{"type":"v1","addr":"10.20.193.166:6839","nonce":2437073090}]},"public_addr":"10.20.193.166:6823/2437073090","cluster_addr":"10.20.193.166:6872/2438073090","heartbeat_back_addr":"10.20.193.166:6847/2437073090","heartbeat_front_addr":"10.20.193.166:6839/2437073090","state":["exists","up"]},{"osd":8,"uuid":"a3864bdb-1f20-4948-92f7-b6a378ea6405","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":44,"up_from":45,"up_thru":16,"down_at":42,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6866","nonce":4074914287},{"type":"v1","addr":"10.20.193.166:6868","nonce":4074914287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6828","nonce":4076914287},{"type":"v1","addr":"10.20.193.166:6831","nonce":4076914287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6878","nonce":4074914287},{"type":"v1","addr":"10.20.193.166:6880","nonce":4074914287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6874","nonce":4074914287},{"type":"v1","addr":"10.20.193.166:6876","nonce":4074914287}]},"public_addr":"10.20.193.166:6868/4074914287","cluster_addr":"10.20.193.166:6831/4076914287","heartbeat_back_addr":"10.20.193.166:6880/4074914287","heartbeat_front_addr":"10.20.193.166:6876/4074914287","state":["exists","up"]},{"osd":9,"uuid":"ccd7f123-3afc-48d1-9e53-f5f501c96165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":38,"up_from":39,"up_thru":59,"down_at":36,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6850","nonce":4119295131},{"type":"v1","addr":"10.20.193.166:6852","nonce":4119295131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6812","nonce":4120295131},{"type":"v1","addr":"10.20.193.166:6870","nonce":4120295131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6861","nonce":4119295131},{"type":"v1","addr":"10.20.193.166:6863","nonce":4119295131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.166:6857","nonce":4119295131},{"type":"v1","addr":"10.20.193.166:6859","nonce":4119295131}]},"public_addr":"10.20.193.166:6852/4119295131","cluster_addr":"10.20.193.166:6870/4120295131","heartbeat_back_addr":"10.20.193.166:6863/4119295131","heartbeat_front_addr":"10.20.193.166:6859/4119295131","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"2026-02-20T18:59:29.865317+0000","laggy_probability":0.65700000524520874,"laggy_interval":1,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T18:58:20.409665+0000","dead_epoch":58},{"osd":1,"down_stamp":"2026-02-20T18:59:29.865317+0000","laggy_probability":0.65700000524520874,"laggy_interval":1,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T18:58:20.290561+0000","dead_epoch":54},{"osd":2,"down_stamp":"2026-02-20T18:59:17.844890+0000","laggy_probability":0.30000001192092896,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T18:58:20.328680+0000","dead_epoch":43},{"osd":3,"down_stamp":"2026-02-20T18:59:17.844890+0000","laggy_probability":0.30000001192092896,"laggy_interval":1,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T18:58:20.389212+0000","dead_epoch":44},{"osd":4,"down_stamp":"2026-02-20T18:59:17.844890+0000","laggy_probability":0.30000001192092896,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T18:58:20.373929+0000","dead_epoch":44},{"osd":5,"down_stamp":"2026-02-20T18:59:17.844890+0000","laggy_probability":0.30000001192092896,"laggy_interval":1,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T18:58:20.322523+0000","dead_epoch":44},{"osd":6,"down_stamp":"2026-02-20T18:59:17.844890+0000","laggy_probability":0.30000001192092896,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T18:58:20.357584+0000","dead_epoch":42},{"osd":7,"down_stamp":"2026-02-20T18:59:17.844890+0000","laggy_probability":0.30000001192092896,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T18:58:20.389930+0000","dead_epoch":43},{"osd":8,"down_stamp":"2026-02-20T18:59:17.844890+0000","laggy_probability":0.50999999046325684,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T18:58:20.375293+0000","dead_epoch":42},{"osd":9,"down_stamp":"2026-02-20T18:59:10.832992+0000","laggy_probability":0.30000001192092896,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T18:58:20.320301+0000","dead_epoch":36}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T18:59:41.798 INFO:tasks.ceph:Scrubbing osd.0 2026-02-20T18:59:41.799 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-20T18:59:41.925 INFO:teuthology.orchestra.run.trial166.stdout:{ 2026-02-20T18:59:41.925 INFO:teuthology.orchestra.run.trial166.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-20T18:59:41.926 INFO:teuthology.orchestra.run.trial166.stdout:} 2026-02-20T18:59:41.931 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-20T18:59:42.112 INFO:teuthology.orchestra.run.trial166.stderr:instructed osd(s) 0 to deep-scrub 2026-02-20T18:59:42.121 INFO:tasks.ceph:Scrubbing osd.1 2026-02-20T18:59:42.122 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-20T18:59:42.204 INFO:teuthology.orchestra.run.trial166.stdout:{ 2026-02-20T18:59:42.204 INFO:teuthology.orchestra.run.trial166.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-20T18:59:42.204 INFO:teuthology.orchestra.run.trial166.stdout:} 2026-02-20T18:59:42.209 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-20T18:59:42.389 INFO:teuthology.orchestra.run.trial166.stderr:instructed osd(s) 1 to deep-scrub 2026-02-20T18:59:42.399 INFO:tasks.ceph:Scrubbing osd.2 2026-02-20T18:59:42.400 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-20T18:59:42.481 INFO:teuthology.orchestra.run.trial166.stdout:{ 2026-02-20T18:59:42.481 INFO:teuthology.orchestra.run.trial166.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-20T18:59:42.481 INFO:teuthology.orchestra.run.trial166.stdout:} 2026-02-20T18:59:42.486 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-20T18:59:42.666 INFO:teuthology.orchestra.run.trial166.stderr:instructed osd(s) 2 to deep-scrub 2026-02-20T18:59:42.675 INFO:tasks.ceph:Scrubbing osd.3 2026-02-20T18:59:42.676 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2026-02-20T18:59:42.758 INFO:teuthology.orchestra.run.trial166.stdout:{ 2026-02-20T18:59:42.758 INFO:teuthology.orchestra.run.trial166.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-20T18:59:42.758 INFO:teuthology.orchestra.run.trial166.stdout:} 2026-02-20T18:59:42.764 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2026-02-20T18:59:42.944 INFO:teuthology.orchestra.run.trial166.stderr:instructed osd(s) 3 to deep-scrub 2026-02-20T18:59:42.953 INFO:tasks.ceph:Scrubbing osd.4 2026-02-20T18:59:42.953 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2026-02-20T18:59:43.035 INFO:teuthology.orchestra.run.trial166.stdout:{ 2026-02-20T18:59:43.035 INFO:teuthology.orchestra.run.trial166.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-20T18:59:43.035 INFO:teuthology.orchestra.run.trial166.stdout:} 2026-02-20T18:59:43.040 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2026-02-20T18:59:43.220 INFO:teuthology.orchestra.run.trial166.stderr:instructed osd(s) 4 to deep-scrub 2026-02-20T18:59:43.229 INFO:tasks.ceph:Scrubbing osd.5 2026-02-20T18:59:43.230 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2026-02-20T18:59:43.311 INFO:teuthology.orchestra.run.trial166.stdout:{ 2026-02-20T18:59:43.311 INFO:teuthology.orchestra.run.trial166.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-20T18:59:43.311 INFO:teuthology.orchestra.run.trial166.stdout:} 2026-02-20T18:59:43.317 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2026-02-20T18:59:43.494 INFO:teuthology.orchestra.run.trial166.stderr:instructed osd(s) 5 to deep-scrub 2026-02-20T18:59:43.502 INFO:tasks.ceph:Scrubbing osd.6 2026-02-20T18:59:43.503 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2026-02-20T18:59:43.584 INFO:teuthology.orchestra.run.trial166.stdout:{ 2026-02-20T18:59:43.585 INFO:teuthology.orchestra.run.trial166.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-20T18:59:43.585 INFO:teuthology.orchestra.run.trial166.stdout:} 2026-02-20T18:59:43.590 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2026-02-20T18:59:43.772 INFO:teuthology.orchestra.run.trial166.stderr:instructed osd(s) 6 to deep-scrub 2026-02-20T18:59:43.783 INFO:tasks.ceph:Scrubbing osd.7 2026-02-20T18:59:43.783 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2026-02-20T18:59:43.865 INFO:teuthology.orchestra.run.trial166.stdout:{ 2026-02-20T18:59:43.866 INFO:teuthology.orchestra.run.trial166.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-20T18:59:43.866 INFO:teuthology.orchestra.run.trial166.stdout:} 2026-02-20T18:59:43.872 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2026-02-20T18:59:44.051 INFO:teuthology.orchestra.run.trial166.stderr:instructed osd(s) 7 to deep-scrub 2026-02-20T18:59:44.061 INFO:tasks.ceph:Scrubbing osd.8 2026-02-20T18:59:44.062 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 config set osd_debug_deep_scrub_sleep 0 2026-02-20T18:59:44.143 INFO:teuthology.orchestra.run.trial166.stdout:{ 2026-02-20T18:59:44.143 INFO:teuthology.orchestra.run.trial166.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-20T18:59:44.143 INFO:teuthology.orchestra.run.trial166.stdout:} 2026-02-20T18:59:44.148 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 8 2026-02-20T18:59:44.329 INFO:teuthology.orchestra.run.trial166.stderr:instructed osd(s) 8 to deep-scrub 2026-02-20T18:59:44.337 INFO:tasks.ceph:Scrubbing osd.9 2026-02-20T18:59:44.338 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 config set osd_debug_deep_scrub_sleep 0 2026-02-20T18:59:44.426 INFO:teuthology.orchestra.run.trial166.stdout:{ 2026-02-20T18:59:44.426 INFO:teuthology.orchestra.run.trial166.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-20T18:59:44.426 INFO:teuthology.orchestra.run.trial166.stdout:} 2026-02-20T18:59:44.434 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 9 2026-02-20T18:59:44.614 INFO:teuthology.orchestra.run.trial166.stderr:instructed osd(s) 9 to deep-scrub 2026-02-20T18:59:44.624 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T18:59:44.804 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T18:59:44.804 INFO:teuthology.orchestra.run.trial166.stderr:dumped all 2026-02-20T18:59:44.813 INFO:teuthology.orchestra.run.trial166.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2026-02-20T18:59:44.749524+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":276328,"kb_used_data":6728,"kb_used_omap":272,"kb_used_meta":269167,"kb_avail":1048299672,"statfs":{"total":1073741824000,"available":1073458864128,"internally_reserved":0,"allocated":6889472,"data_stored":3357408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":279368,"internal_metadata":275627192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.872246"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":81,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-20T18:59:36.260981+0000","last_change":"2026-02-20T18:59:24.059743+0000","last_active":"2026-02-20T18:59:36.260981+0000","last_peered":"2026-02-20T18:59:36.260981+0000","last_clean":"2026-02-20T18:59:36.260981+0000","last_became_active":"2026-02-20T18:59:24.059643+0000","last_became_peered":"2026-02-20T18:59:24.059643+0000","last_unstale":"2026-02-20T18:59:36.260981+0000","last_undegraded":"2026-02-20T18:59:36.260981+0000","last_fullsized":"2026-02-20T18:59:36.260981+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T05:02:55.325323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000220731,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":105,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-20T18:59:36.260639+0000","last_change":"2026-02-20T18:59:21.853706+0000","last_active":"2026-02-20T18:59:36.260639+0000","last_peered":"2026-02-20T18:59:36.260639+0000","last_clean":"2026-02-20T18:59:36.260639+0000","last_became_active":"2026-02-20T18:59:21.853581+0000","last_became_peered":"2026-02-20T18:59:21.853581+0000","last_unstale":"2026-02-20T18:59:36.260639+0000","last_undegraded":"2026-02-20T18:59:36.260639+0000","last_fullsized":"2026-02-20T18:59:36.260639+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T20:25:32.002379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021133299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":112,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-20T18:59:35.880835+0000","last_change":"2026-02-20T18:59:35.880783+0000","last_active":"2026-02-20T18:59:35.880835+0000","last_peered":"2026-02-20T18:59:35.880835+0000","last_clean":"2026-02-20T18:59:35.880835+0000","last_became_active":"2026-02-20T18:59:35.880672+0000","last_became_peered":"2026-02-20T18:59:35.880672+0000","last_unstale":"2026-02-20T18:59:35.880835+0000","last_undegraded":"2026-02-20T18:59:35.880835+0000","last_fullsized":"2026-02-20T18:59:35.880835+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T00:19:02.528907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000249194,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":81,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-20T18:59:36.260691+0000","last_change":"2026-02-20T18:59:34.140851+0000","last_active":"2026-02-20T18:59:36.260691+0000","last_peered":"2026-02-20T18:59:36.260691+0000","last_clean":"2026-02-20T18:59:36.260691+0000","last_became_active":"2026-02-20T18:59:34.140758+0000","last_became_peered":"2026-02-20T18:59:34.140758+0000","last_unstale":"2026-02-20T18:59:36.260691+0000","last_undegraded":"2026-02-20T18:59:36.260691+0000","last_fullsized":"2026-02-20T18:59:36.260691+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T19:20:42.796194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"17'1","reported_seq":103,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-20T18:59:36.260983+0000","last_change":"2026-02-20T18:59:33.876042+0000","last_active":"2026-02-20T18:59:36.260983+0000","last_peered":"2026-02-20T18:59:36.260983+0000","last_clean":"2026-02-20T18:59:36.260983+0000","last_became_active":"2026-02-20T18:59:33.875925+0000","last_became_peered":"2026-02-20T18:59:33.875925+0000","last_unstale":"2026-02-20T18:59:36.260983+0000","last_undegraded":"2026-02-20T18:59:36.260983+0000","last_fullsized":"2026-02-20T18:59:36.260983+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T05:23:53.225099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"19'2","reported_seq":109,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-20T18:59:35.879780+0000","last_change":"2026-02-20T18:59:33.876206+0000","last_active":"2026-02-20T18:59:35.879780+0000","last_peered":"2026-02-20T18:59:35.879780+0000","last_clean":"2026-02-20T18:59:35.879780+0000","last_became_active":"2026-02-20T18:59:33.876053+0000","last_became_peered":"2026-02-20T18:59:33.876053+0000","last_unstale":"2026-02-20T18:59:35.879780+0000","last_undegraded":"2026-02-20T18:59:35.879780+0000","last_fullsized":"2026-02-20T18:59:35.879780+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T01:19:28.216183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000423428,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":85,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-20T18:59:35.879849+0000","last_change":"2026-02-20T18:59:23.856920+0000","last_active":"2026-02-20T18:59:35.879849+0000","last_peered":"2026-02-20T18:59:35.879849+0000","last_clean":"2026-02-20T18:59:35.879849+0000","last_became_active":"2026-02-20T18:59:23.856817+0000","last_became_peered":"2026-02-20T18:59:23.856817+0000","last_unstale":"2026-02-20T18:59:35.879849+0000","last_undegraded":"2026-02-20T18:59:35.879849+0000","last_fullsized":"2026-02-20T18:59:35.879849+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:31:01.223867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025154799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":86,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-20T18:59:36.260861+0000","last_change":"2026-02-20T18:59:24.017114+0000","last_active":"2026-02-20T18:59:36.260861+0000","last_peered":"2026-02-20T18:59:36.260861+0000","last_clean":"2026-02-20T18:59:36.260861+0000","last_became_active":"2026-02-20T18:59:24.016989+0000","last_became_peered":"2026-02-20T18:59:24.016989+0000","last_unstale":"2026-02-20T18:59:36.260861+0000","last_undegraded":"2026-02-20T18:59:36.260861+0000","last_fullsized":"2026-02-20T18:59:36.260861+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:58:27.804883+0000","last_clean_scrub_stamp":"2026-02-20T18:58:27.804883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:13:07.590533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":39,"seq":167503724563,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27632,"kb_used_data":672,"kb_used_omap":29,"kb_used_meta":26914,"kb_avail":104829968,"statfs":{"total":107374182400,"available":107345887232,"internally_reserved":0,"allocated":688128,"data_stored":335737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30350,"internal_metadata":27560306},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":45,"seq":193273528339,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27632,"kb_used_data":672,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104829968,"statfs":{"total":107374182400,"available":107345887232,"internally_reserved":0,"allocated":688128,"data_stored":335737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28392,"internal_metadata":27562264},"hb_peers":[0,1,2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528339,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27632,"kb_used_data":672,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104829968,"statfs":{"total":107374182400,"available":107345887232,"internally_reserved":0,"allocated":688128,"data_stored":335737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29690,"internal_metadata":27560966},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528338,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27632,"kb_used_data":672,"kb_used_omap":30,"kb_used_meta":26913,"kb_avail":104829968,"statfs":{"total":107374182400,"available":107345887232,"internally_reserved":0,"allocated":688128,"data_stored":335737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31647,"internal_metadata":27559009},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":47,"seq":201863462931,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27632,"kb_used_data":672,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":104829968,"statfs":{"total":107374182400,"available":107345887232,"internally_reserved":0,"allocated":688128,"data_stored":335737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27091,"internal_metadata":27563565},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":45,"seq":193273528338,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27636,"kb_used_data":676,"kb_used_omap":30,"kb_used_meta":26913,"kb_avail":104829964,"statfs":{"total":107374182400,"available":107345883136,"internally_reserved":0,"allocated":692224,"data_stored":335756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30997,"internal_metadata":27559659},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":47,"seq":201863462931,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27632,"kb_used_data":672,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104829968,"statfs":{"total":107374182400,"available":107345887232,"internally_reserved":0,"allocated":688128,"data_stored":335737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29693,"internal_metadata":27560963},"hb_peers":[0,1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":45,"seq":193273528339,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27632,"kb_used_data":672,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104829968,"statfs":{"total":107374182400,"available":107345887232,"internally_reserved":0,"allocated":688128,"data_stored":335737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29044,"internal_metadata":27561612},"hb_peers":[0,1,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":57,"seq":244813135891,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27636,"kb_used_data":676,"kb_used_omap":18,"kb_used_meta":26925,"kb_avail":104829964,"statfs":{"total":107374182400,"available":107345883136,"internally_reserved":0,"allocated":692224,"data_stored":335756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19279,"internal_metadata":27571377},"hb_peers":[0,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":59,"seq":253403070483,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27632,"kb_used_data":672,"kb_used_omap":22,"kb_used_meta":26921,"kb_avail":104829968,"statfs":{"total":107374182400,"available":107345887232,"internally_reserved":0,"allocated":688128,"data_stored":335737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23185,"internal_metadata":27567471},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T18:59:44.818 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2026-02-20T18:58:27.804883+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=18, tm_min=58, tm_sec=27, tm_wday=4, tm_yday=51, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=18, tm_min=59, tm_sec=40, tm_wday=4, tm_yday=51, tm_isdst=0) 2026-02-20T18:59:44.818 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2026-02-20T18:58:27.804883+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=18, tm_min=58, tm_sec=27, tm_wday=4, tm_yday=51, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=18, tm_min=59, tm_sec=40, tm_wday=4, tm_yday=51, tm_isdst=0) 2026-02-20T18:59:44.818 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2026-02-20T18:58:27.804883+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=18, tm_min=58, tm_sec=27, tm_wday=4, tm_yday=51, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=18, tm_min=59, tm_sec=40, tm_wday=4, tm_yday=51, tm_isdst=0) 2026-02-20T18:59:44.818 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2026-02-20T18:58:27.804883+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=18, tm_min=58, tm_sec=27, tm_wday=4, tm_yday=51, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=18, tm_min=59, tm_sec=40, tm_wday=4, tm_yday=51, tm_isdst=0) 2026-02-20T18:59:44.818 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2026-02-20T18:58:27.804883+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=18, tm_min=58, tm_sec=27, tm_wday=4, tm_yday=51, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=18, tm_min=59, tm_sec=40, tm_wday=4, tm_yday=51, tm_isdst=0) 2026-02-20T18:59:44.819 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2026-02-20T18:58:27.804883+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=18, tm_min=58, tm_sec=27, tm_wday=4, tm_yday=51, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=18, tm_min=59, tm_sec=40, tm_wday=4, tm_yday=51, tm_isdst=0) 2026-02-20T18:59:44.819 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2026-02-20T18:58:27.804883+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=18, tm_min=58, tm_sec=27, tm_wday=4, tm_yday=51, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=18, tm_min=59, tm_sec=40, tm_wday=4, tm_yday=51, tm_isdst=0) 2026-02-20T18:59:44.819 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-20T18:58:27.804883+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=18, tm_min=58, tm_sec=27, tm_wday=4, tm_yday=51, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=18, tm_min=59, tm_sec=40, tm_wday=4, tm_yday=51, tm_isdst=0) 2026-02-20T18:59:44.819 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-20T19:00:04.819 DEBUG:teuthology.orchestra.run.trial166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T19:00:04.999 INFO:teuthology.orchestra.run.trial166.stdout: 2026-02-20T19:00:05.000 INFO:teuthology.orchestra.run.trial166.stderr:dumped all 2026-02-20T19:00:05.008 INFO:teuthology.orchestra.run.trial166.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2026-02-20T19:00:04.751397+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":276328,"kb_used_data":6728,"kb_used_omap":272,"kb_used_meta":269167,"kb_avail":1048299672,"statfs":{"total":1073741824000,"available":1073458864128,"internally_reserved":0,"allocated":6889472,"data_stored":3357408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":279368,"internal_metadata":275627192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.000996"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":89,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-20T18:59:43.587985+0000","last_change":"2026-02-20T18:59:43.587985+0000","last_active":"2026-02-20T18:59:43.587985+0000","last_peered":"2026-02-20T18:59:43.587985+0000","last_clean":"2026-02-20T18:59:43.587985+0000","last_became_active":"2026-02-20T18:59:24.059643+0000","last_became_peered":"2026-02-20T18:59:24.059643+0000","last_unstale":"2026-02-20T18:59:43.587985+0000","last_undegraded":"2026-02-20T18:59:43.587985+0000","last_fullsized":"2026-02-20T18:59:43.587985+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:59:43.587945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:59:43.587945+0000","last_clean_scrub_stamp":"2026-02-20T18:59:43.587945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T21:59:10.424078+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.000220731,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":113,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-20T18:59:44.440598+0000","last_change":"2026-02-20T18:59:44.440598+0000","last_active":"2026-02-20T18:59:44.440598+0000","last_peered":"2026-02-20T18:59:44.440598+0000","last_clean":"2026-02-20T18:59:44.440598+0000","last_became_active":"2026-02-20T18:59:21.853581+0000","last_became_peered":"2026-02-20T18:59:21.853581+0000","last_unstale":"2026-02-20T18:59:44.440598+0000","last_undegraded":"2026-02-20T18:59:44.440598+0000","last_fullsized":"2026-02-20T18:59:44.440598+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:59:44.440559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:59:44.440559+0000","last_clean_scrub_stamp":"2026-02-20T18:59:44.440559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T04:26:25.330222+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00021133299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":120,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-20T18:59:44.779139+0000","last_change":"2026-02-20T18:59:44.779139+0000","last_active":"2026-02-20T18:59:44.779139+0000","last_peered":"2026-02-20T18:59:44.779139+0000","last_clean":"2026-02-20T18:59:44.779139+0000","last_became_active":"2026-02-20T18:59:35.880672+0000","last_became_peered":"2026-02-20T18:59:35.880672+0000","last_unstale":"2026-02-20T18:59:44.779139+0000","last_undegraded":"2026-02-20T18:59:44.779139+0000","last_fullsized":"2026-02-20T18:59:44.779139+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:59:44.779119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:59:44.779119+0000","last_clean_scrub_stamp":"2026-02-20T18:59:44.779119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T04:26:25.668782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000249194,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":89,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-20T18:59:43.190692+0000","last_change":"2026-02-20T18:59:43.190692+0000","last_active":"2026-02-20T18:59:43.190692+0000","last_peered":"2026-02-20T18:59:43.190692+0000","last_clean":"2026-02-20T18:59:43.190692+0000","last_became_active":"2026-02-20T18:59:34.140758+0000","last_became_peered":"2026-02-20T18:59:34.140758+0000","last_unstale":"2026-02-20T18:59:43.190692+0000","last_undegraded":"2026-02-20T18:59:43.190692+0000","last_fullsized":"2026-02-20T18:59:43.190692+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:59:43.190652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:59:43.190652+0000","last_clean_scrub_stamp":"2026-02-20T18:59:43.190652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T06:45:01.235689+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"60'2","reported_seq":112,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-20T18:59:44.595208+0000","last_change":"2026-02-20T18:59:44.595208+0000","last_active":"2026-02-20T18:59:44.595208+0000","last_peered":"2026-02-20T18:59:44.595208+0000","last_clean":"2026-02-20T18:59:44.595208+0000","last_became_active":"2026-02-20T18:59:33.875925+0000","last_became_peered":"2026-02-20T18:59:33.875925+0000","last_unstale":"2026-02-20T18:59:44.595208+0000","last_undegraded":"2026-02-20T18:59:44.595208+0000","last_fullsized":"2026-02-20T18:59:44.595208+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'2","last_scrub_stamp":"2026-02-20T18:59:44.595179+0000","last_deep_scrub":"60'2","last_deep_scrub_stamp":"2026-02-20T18:59:44.595179+0000","last_clean_scrub_stamp":"2026-02-20T18:59:44.595179+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T04:47:11.596993+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"60'3","reported_seq":118,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-20T18:59:44.235766+0000","last_change":"2026-02-20T18:59:44.235766+0000","last_active":"2026-02-20T18:59:44.235766+0000","last_peered":"2026-02-20T18:59:44.235766+0000","last_clean":"2026-02-20T18:59:44.235766+0000","last_became_active":"2026-02-20T18:59:33.876053+0000","last_became_peered":"2026-02-20T18:59:33.876053+0000","last_unstale":"2026-02-20T18:59:44.235766+0000","last_undegraded":"2026-02-20T18:59:44.235766+0000","last_fullsized":"2026-02-20T18:59:44.235766+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'3","last_scrub_stamp":"2026-02-20T18:59:44.235745+0000","last_deep_scrub":"60'3","last_deep_scrub_stamp":"2026-02-20T18:59:44.235745+0000","last_clean_scrub_stamp":"2026-02-20T18:59:44.235745+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T02:45:13.530174+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.000423428,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":93,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-20T18:59:44.740325+0000","last_change":"2026-02-20T18:59:44.740325+0000","last_active":"2026-02-20T18:59:44.740325+0000","last_peered":"2026-02-20T18:59:44.740325+0000","last_clean":"2026-02-20T18:59:44.740325+0000","last_became_active":"2026-02-20T18:59:23.856817+0000","last_became_peered":"2026-02-20T18:59:23.856817+0000","last_unstale":"2026-02-20T18:59:44.740325+0000","last_undegraded":"2026-02-20T18:59:44.740325+0000","last_fullsized":"2026-02-20T18:59:44.740325+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:59:44.740300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:59:44.740300+0000","last_clean_scrub_stamp":"2026-02-20T18:59:44.740300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T06:22:25.810721+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00025154799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":94,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-20T18:59:43.639267+0000","last_change":"2026-02-20T18:59:43.639267+0000","last_active":"2026-02-20T18:59:43.639267+0000","last_peered":"2026-02-20T18:59:43.639267+0000","last_clean":"2026-02-20T18:59:43.639267+0000","last_became_active":"2026-02-20T18:59:24.016989+0000","last_became_peered":"2026-02-20T18:59:24.016989+0000","last_unstale":"2026-02-20T18:59:43.639267+0000","last_undegraded":"2026-02-20T18:59:43.639267+0000","last_fullsized":"2026-02-20T18:59:43.639267+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T18:59:43.639216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T18:59:43.639216+0000","last_clean_scrub_stamp":"2026-02-20T18:59:43.639216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T02:13:43.948940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":39,"seq":167503724567,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27632,"kb_used_data":672,"kb_used_omap":29,"kb_used_meta":26914,"kb_avail":104829968,"statfs":{"total":107374182400,"available":107345887232,"internally_reserved":0,"allocated":688128,"data_stored":335737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30350,"internal_metadata":27560306},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":45,"seq":193273528343,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27632,"kb_used_data":672,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104829968,"statfs":{"total":107374182400,"available":107345887232,"internally_reserved":0,"allocated":688128,"data_stored":335737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28392,"internal_metadata":27562264},"hb_peers":[0,1,2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528343,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27632,"kb_used_data":672,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104829968,"statfs":{"total":107374182400,"available":107345887232,"internally_reserved":0,"allocated":688128,"data_stored":335737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29690,"internal_metadata":27560966},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528342,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27632,"kb_used_data":672,"kb_used_omap":30,"kb_used_meta":26913,"kb_avail":104829968,"statfs":{"total":107374182400,"available":107345887232,"internally_reserved":0,"allocated":688128,"data_stored":335737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31647,"internal_metadata":27559009},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":47,"seq":201863462935,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27632,"kb_used_data":672,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":104829968,"statfs":{"total":107374182400,"available":107345887232,"internally_reserved":0,"allocated":688128,"data_stored":335737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27091,"internal_metadata":27563565},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":45,"seq":193273528342,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27636,"kb_used_data":676,"kb_used_omap":30,"kb_used_meta":26913,"kb_avail":104829964,"statfs":{"total":107374182400,"available":107345883136,"internally_reserved":0,"allocated":692224,"data_stored":335756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30997,"internal_metadata":27559659},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":47,"seq":201863462935,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27632,"kb_used_data":672,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104829968,"statfs":{"total":107374182400,"available":107345887232,"internally_reserved":0,"allocated":688128,"data_stored":335737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29693,"internal_metadata":27560963},"hb_peers":[0,1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":45,"seq":193273528343,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27632,"kb_used_data":672,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104829968,"statfs":{"total":107374182400,"available":107345887232,"internally_reserved":0,"allocated":688128,"data_stored":335737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29044,"internal_metadata":27561612},"hb_peers":[0,1,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":57,"seq":244813135895,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27636,"kb_used_data":676,"kb_used_omap":18,"kb_used_meta":26925,"kb_avail":104829964,"statfs":{"total":107374182400,"available":107345883136,"internally_reserved":0,"allocated":692224,"data_stored":335756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19279,"internal_metadata":27571377},"hb_peers":[0,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":59,"seq":253403070487,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27632,"kb_used_data":672,"kb_used_omap":22,"kb_used_meta":26921,"kb_avail":104829968,"statfs":{"total":107374182400,"available":107345887232,"internally_reserved":0,"allocated":688128,"data_stored":335737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23185,"internal_metadata":27567471},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T19:00:05.010 DEBUG:teuthology.orchestra.run.trial166:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-20T19:00:05.200 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-20T19:00:05.201 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-20T19:00:05.201 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-20T19:00:05.201 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T19:00:05.229 INFO:tasks.ceph.osd.0:Stopped 2026-02-20T19:00:05.229 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-20T19:00:05.230 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T19:00:05.297 INFO:tasks.ceph.osd.1:Stopped 2026-02-20T19:00:05.297 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-20T19:00:05.297 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T19:00:05.373 INFO:tasks.ceph.osd.2:Stopped 2026-02-20T19:00:05.374 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-20T19:00:05.374 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T19:00:05.450 INFO:tasks.ceph.osd.3:Stopped 2026-02-20T19:00:05.450 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2026-02-20T19:00:05.451 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T19:00:05.525 INFO:tasks.ceph.osd.4:Stopped 2026-02-20T19:00:05.526 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2026-02-20T19:00:05.526 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T19:00:05.594 INFO:tasks.ceph.osd.5:Stopped 2026-02-20T19:00:05.595 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2026-02-20T19:00:05.595 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T19:00:05.667 INFO:tasks.ceph.osd.6:Stopped 2026-02-20T19:00:05.668 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2026-02-20T19:00:05.668 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T19:00:05.744 INFO:tasks.ceph.osd.7:Stopped 2026-02-20T19:00:05.744 DEBUG:tasks.ceph.osd.8:waiting for process to exit 2026-02-20T19:00:05.744 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T19:00:05.813 INFO:tasks.ceph.osd.8:Stopped 2026-02-20T19:00:05.813 DEBUG:tasks.ceph.osd.9:waiting for process to exit 2026-02-20T19:00:05.813 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T19:00:05.885 INFO:tasks.ceph.osd.9:Stopped 2026-02-20T19:00:05.885 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-20T19:00:05.885 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-20T19:00:05.885 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T19:00:05.953 INFO:tasks.ceph.mgr.x:Stopped 2026-02-20T19:00:05.954 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-20T19:00:05.954 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-20T19:00:05.954 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T19:00:06.003 INFO:tasks.ceph.mon.a:Stopped 2026-02-20T19:00:06.004 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-20T19:00:06.004 DEBUG:teuthology.orchestra.run.trial166:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2026-02-20T19:00:06.073 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial166.front.sepia.ceph.com 2026-02-20T19:00:06.073 DEBUG:teuthology.orchestra.run.trial166:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-20T19:00:06.142 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial166.front.sepia.ceph.com 2026-02-20T19:00:06.143 DEBUG:teuthology.orchestra.run.trial166:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-20T19:00:06.215 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial166.front.sepia.ceph.com 2026-02-20T19:00:06.216 DEBUG:teuthology.orchestra.run.trial166:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-20T19:00:06.285 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial166.front.sepia.ceph.com 2026-02-20T19:00:06.286 DEBUG:teuthology.orchestra.run.trial166:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-20T19:00:06.359 INFO:tasks.ceph:Archiving mon data... 2026-02-20T19:00:06.363 DEBUG:teuthology.misc:Transferring archived files from trial166:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/yuriw-2026-02-20_16:06:38-rados-wip-pdonnell-testing-20260219.182737-tentacle-distro-default-trial/61096/data/mon.a.tgz 2026-02-20T19:00:06.363 DEBUG:teuthology.orchestra.run.trial166:> mktemp 2026-02-20T19:00:06.418 INFO:teuthology.orchestra.run.trial166.stdout:/tmp/tmp.Delu7rTiLr 2026-02-20T19:00:06.419 DEBUG:teuthology.orchestra.run.trial166:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Delu7rTiLr 2026-02-20T19:00:06.509 DEBUG:teuthology.orchestra.run.trial166:> sudo chmod 0666 /tmp/tmp.Delu7rTiLr 2026-02-20T19:00:06.592 DEBUG:teuthology.orchestra.remote:trial166:/tmp/tmp.Delu7rTiLr is 212KB 2026-02-20T19:00:06.688 DEBUG:teuthology.orchestra.run.trial166:> rm -fr /tmp/tmp.Delu7rTiLr 2026-02-20T19:00:06.702 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-20T19:00:06.702 DEBUG:teuthology.orchestra.run.trial166:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-20T19:00:06.822 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-20T19:00:06.823 INFO:tasks.ceph:Archiving crash dumps... 2026-02-20T19:00:06.826 DEBUG:teuthology.misc:Transferring archived files from trial166:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-20_16:06:38-rados-wip-pdonnell-testing-20260219.182737-tentacle-distro-default-trial/61096/remote/trial166/crash 2026-02-20T19:00:06.827 DEBUG:teuthology.orchestra.run.trial166:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-20T19:00:06.886 INFO:tasks.ceph:Compressing logs... 2026-02-20T19:00:06.887 DEBUG:teuthology.orchestra.run.trial166:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T19:00:06.952 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47507.log 2026-02-20T19:00:06.952 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-20T19:00:06.952 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.47507.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47507.log.gz 2026-02-20T19:00:06.952 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47753.log 2026-02-20T19:00:06.952 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47554.log 2026-02-20T19:00:06.992 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.47753.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47753.log.gz 2026-02-20T19:00:06.993 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-20T19:00:06.993 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.47554.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47554.log.gz 2026-02-20T19:00:06.993 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55585.log 2026-02-20T19:00:06.993 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53831.log 2026-02-20T19:00:06.993 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.55585.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55585.log.gz 2026-02-20T19:00:06.993 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55485.log 2026-02-20T19:00:06.993 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.53831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47601.log 2026-02-20T19:00:06.993 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53831.log.gz 2026-02-20T19:00:06.993 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.55485.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-20T19:00:06.993 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55485.log.gz 2026-02-20T19:00:06.993 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.47601.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47601.log.gz 2026-02-20T19:00:06.993 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57383.log 2026-02-20T19:00:06.993 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53834.log 2026-02-20T19:00:06.994 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.57383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56153.log 2026-02-20T19:00:06.994 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57383.log.gz 2026-02-20T19:00:06.994 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.53834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53418.log 2026-02-20T19:00:06.994 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53834.log.gz 2026-02-20T19:00:06.994 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.56153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53035.log 2026-02-20T19:00:06.994 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56153.log.gz 2026-02-20T19:00:06.994 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.53418.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53418.log.gz 2026-02-20T19:00:06.994 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54189.log 2026-02-20T19:00:06.994 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.53035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55163.log 2026-02-20T19:00:06.994 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53035.log.gz 2026-02-20T19:00:06.994 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.54189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55460.log 2026-02-20T19:00:06.994 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54189.log.gz 2026-02-20T19:00:06.994 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.55163.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-20T19:00:06.994 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55163.log.gz 2026-02-20T19:00:06.994 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52780.log 2026-02-20T19:00:06.994 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.55460.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55460.log.gz 2026-02-20T19:00:06.994 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55659.log 2026-02-20T19:00:06.995 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.52780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54452.log 2026-02-20T19:00:06.995 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52780.log.gz 2026-02-20T19:00:06.995 INFO:teuthology.orchestra.run.trial166.stderr:gzip/var/log/ceph/ceph-client.admin.55659.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.46889.log 2026-02-20T19:00:06.995 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55659.log.gz 2026-02-20T19:00:06.995 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.54452.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.54452.log.gz /var/log/ceph/ceph-client.admin.53817.log 2026-02-20T19:00:06.995 INFO:teuthology.orchestra.run.trial166.stderr: 2026-02-20T19:00:06.995 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.46889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55412.log 2026-02-20T19:00:06.995 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46889.log.gz 2026-02-20T19:00:06.995 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.53817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55311.log 2026-02-20T19:00:06.995 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53817.log.gz 2026-02-20T19:00:06.995 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.55412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55933.log 2026-02-20T19:00:06.995 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55412.log.gz 2026-02-20T19:00:06.995 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.55311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53415.log 2026-02-20T19:00:06.995 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55311.log.gz 2026-02-20T19:00:06.995 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.55933.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55933.log.gz 2026-02-20T19:00:06.995 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48187.log 2026-02-20T19:00:06.995 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.53415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53824.log 2026-02-20T19:00:06.996 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53415.log.gz 2026-02-20T19:00:06.996 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.48187.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48187.log.gz 2026-02-20T19:00:06.996 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52986.log 2026-02-20T19:00:06.996 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.53824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55634.log 2026-02-20T19:00:06.996 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53824.log.gz 2026-02-20T19:00:06.996 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.52986.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52986.log.gz 2026-02-20T19:00:06.996 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55881.log 2026-02-20T19:00:06.996 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.55634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55733.log 2026-02-20T19:00:06.996 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55634.log.gz 2026-02-20T19:00:06.996 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56403.log 2026-02-20T19:00:06.996 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.55881.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55881.log.gz 2026-02-20T19:00:06.996 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.55733.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55733.log.gz 2026-02-20T19:00:06.996 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47800.log 2026-02-20T19:00:06.996 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57530.log 2026-02-20T19:00:06.996 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.56403.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56403.log.gz 2026-02-20T19:00:06.996 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.47800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56697.log 2026-02-20T19:00:06.996 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47800.log.gz 2026-02-20T19:00:06.996 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2026-02-20T19:00:06.996 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.57530.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57530.log.gz 2026-02-20T19:00:06.997 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.56697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54750.log 2026-02-20T19:00:06.997 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56697.log.gz 2026-02-20T19:00:06.997 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52921.log 2026-02-20T19:00:06.997 INFO:teuthology.orchestra.run.trial166.stderr:gzip/var/log/ceph/ceph-client.admin.54750.log: -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2026-02-20T19:00:06.997 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54750.log.gz 2026-02-20T19:00:06.997 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.52921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47366.log 2026-02-20T19:00:06.997 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52921.log.gz 2026-02-20T19:00:06.997 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47001.log 2026-02-20T19:00:06.997 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.47366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57236.log 2026-02-20T19:00:06.997 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47366.log.gz 2026-02-20T19:00:06.997 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.47001.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47001.log.gz 2026-02-20T19:00:06.997 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55115.log 2026-02-20T19:00:06.997 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.57236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55684.log 2026-02-20T19:00:06.997 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57236.log.gz 2026-02-20T19:00:06.997 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.55115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56178.log 2026-02-20T19:00:06.997 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55115.log.gz 2026-02-20T19:00:06.997 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.55684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57285.log 2026-02-20T19:00:06.997 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55684.log.gz 2026-02-20T19:00:06.997 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.56178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54026.log 2026-02-20T19:00:06.998 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56178.log.gz 2026-02-20T19:00:06.998 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.57285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56228.log 2026-02-20T19:00:06.998 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57285.log.gz 2026-02-20T19:00:06.998 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.54026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56254.log 2026-02-20T19:00:06.998 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54026.log.gz 2026-02-20T19:00:06.998 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.56228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53424.log 2026-02-20T19:00:06.998 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56228.log.gz 2026-02-20T19:00:06.998 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.56254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55287.log 2026-02-20T19:00:06.998 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56254.log.gz 2026-02-20T19:00:06.998 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.53424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55388.log 2026-02-20T19:00:06.998 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53424.log.gz 2026-02-20T19:00:06.998 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.55287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55807.log 2026-02-20T19:00:06.998 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55287.log.gz 2026-02-20T19:00:06.998 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.55388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56054.log 2026-02-20T19:00:06.998 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55388.log.gz 2026-02-20T19:00:06.998 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.55807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47069.log 2026-02-20T19:00:06.998 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55807.log.gz 2026-02-20T19:00:06.998 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.56054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56893.log 2026-02-20T19:00:06.999 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56054.log.gz 2026-02-20T19:00:06.999 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.47069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55857.log 2026-02-20T19:00:06.999 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47069.log.gz 2026-02-20T19:00:06.999 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.56893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54188.log 2026-02-20T19:00:06.999 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56893.log.gz 2026-02-20T19:00:06.999 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.55857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57138.log 2026-02-20T19:00:06.999 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55857.log.gz 2026-02-20T19:00:06.999 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.54188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57726.log 2026-02-20T19:00:06.999 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54188.log.gz 2026-02-20T19:00:06.999 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.57138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47706.log 2026-02-20T19:00:06.999 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57138.log.gz 2026-02-20T19:00:06.999 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.57726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56746.log 2026-02-20T19:00:06.999 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57726.log.gz 2026-02-20T19:00:06.999 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.47706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55709.log 2026-02-20T19:00:06.999 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47706.log.gz 2026-02-20T19:00:06.999 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.56746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57432.log 2026-02-20T19:00:06.999 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56746.log.gz 2026-02-20T19:00:06.999 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.55709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55510.log 2026-02-20T19:00:06.999 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55709.log.gz 2026-02-20T19:00:06.999 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.57432.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2026-02-20T19:00:07.000 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57432.log.gz 2026-02-20T19:00:07.000 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.55510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55187.log 2026-02-20T19:00:07.000 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55510.log.gz 2026-02-20T19:00:07.000 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53413.log 2026-02-20T19:00:07.000 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.55187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55610.log 2026-02-20T19:00:07.000 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55187.log.gz 2026-02-20T19:00:07.000 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.53413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57775.log 2026-02-20T19:00:07.000 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53413.log.gz 2026-02-20T19:00:07.000 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.55610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56550.log 2026-02-20T19:00:07.000 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55610.log.gz 2026-02-20T19:00:07.000 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.57775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57187.log 2026-02-20T19:00:07.000 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57775.log.gz 2026-02-20T19:00:07.000 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.56550.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56550.log.gz 2026-02-20T19:00:07.000 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55363.log 2026-02-20T19:00:07.000 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.57187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55535.log 2026-02-20T19:00:07.000 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57187.log.gz 2026-02-20T19:00:07.000 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.55363.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-20T19:00:07.001 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55363.log.gz 2026-02-20T19:00:07.001 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.55535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53825.log 2026-02-20T19:00:07.001 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55535.log.gz 2026-02-20T19:00:07.001 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53084.log 2026-02-20T19:00:07.001 INFO:teuthology.orchestra.run.trial166.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-20T19:00:07.001 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.53825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54652.log 2026-02-20T19:00:07.001 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53825.log.gz 2026-02-20T19:00:07.001 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.53084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56103.log 2026-02-20T19:00:07.001 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53084.log.gz 2026-02-20T19:00:07.001 INFO:teuthology.orchestra.run.trial166.stderr: 89.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-20T19:00:07.001 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.54652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54362.log 2026-02-20T19:00:07.001 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54652.log.gz 2026-02-20T19:00:07.001 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.56103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52896.log 2026-02-20T19:00:07.001 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56103.log.gz 2026-02-20T19:00:07.001 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.54362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57825.log 2026-02-20T19:00:07.001 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54362.log.gz 2026-02-20T19:00:07.001 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.52896.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52896.log.gz 2026-02-20T19:00:07.001 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56991.log 2026-02-20T19:00:07.001 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.57825.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57825.log.gz 2026-02-20T19:00:07.001 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56030.log 2026-02-20T19:00:07.002 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.56991.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56991.log.gz 2026-02-20T19:00:07.002 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2026-02-20T19:00:07.002 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.56030.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56030.log.gz 2026-02-20T19:00:07.002 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53404.log 2026-02-20T19:00:07.002 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-20T19:00:07.002 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.53404.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53404.log.gz 2026-02-20T19:00:07.002 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54025.log 2026-02-20T19:00:07.002 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54454.log 2026-02-20T19:00:07.002 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.54025.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54025.log.gz 2026-02-20T19:00:07.002 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55560.log 2026-02-20T19:00:07.002 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.54454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55212.log 2026-02-20T19:00:07.002 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54454.log.gz 2026-02-20T19:00:07.002 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.55560.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55560.log.gz 2026-02-20T19:00:07.002 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55237.log 2026-02-20T19:00:07.002 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.55212.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55212.log.gz 2026-02-20T19:00:07.002 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54024.log 2026-02-20T19:00:07.002 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.55237.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55237.log.gz 2026-02-20T19:00:07.002 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53425.log 2026-02-20T19:00:07.002 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.54024.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54024.log.gz 2026-02-20T19:00:07.002 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56006.log 2026-02-20T19:00:07.002 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.53425.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53425.log.gz 2026-02-20T19:00:07.002 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53133.log 2026-02-20T19:00:07.003 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.56006.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56006.log.gz 2026-02-20T19:00:07.003 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52826.log 2026-02-20T19:00:07.003 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.53133.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53133.log.gz 2026-02-20T19:00:07.003 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56942.log 2026-02-20T19:00:07.003 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.52826.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52826.log.gz 2026-02-20T19:00:07.003 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56501.log 2026-02-20T19:00:07.003 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.56942.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56942.log.gz 2026-02-20T19:00:07.003 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56078.log 2026-02-20T19:00:07.003 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.56501.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56501.log.gz 2026-02-20T19:00:07.003 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56202.log 2026-02-20T19:00:07.003 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.56078.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56078.log.gz 2026-02-20T19:00:07.003 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47648.log 2026-02-20T19:00:07.003 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.56202.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56202.log.gz 2026-02-20T19:00:07.003 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54701.log 2026-02-20T19:00:07.003 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.47648.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47648.log.gz 2026-02-20T19:00:07.003 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54363.log 2026-02-20T19:00:07.003 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.54701.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54701.log.gz 2026-02-20T19:00:07.003 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57040.log 2026-02-20T19:00:07.003 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.54363.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54363.log.gz 2026-02-20T19:00:07.003 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57579.log 2026-02-20T19:00:07.003 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.57040.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57040.log.gz 2026-02-20T19:00:07.003 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54357.log 2026-02-20T19:00:07.004 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.57579.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57579.log.gz 2026-02-20T19:00:07.004 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57873.log 2026-02-20T19:00:07.004 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.54357.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54357.log.gz 2026-02-20T19:00:07.004 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55039.log 2026-02-20T19:00:07.004 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.57873.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57873.log.gz 2026-02-20T19:00:07.004 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56452.log 2026-02-20T19:00:07.004 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.55039.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55039.log.gz 2026-02-20T19:00:07.004 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57628.log 2026-02-20T19:00:07.004 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.56452.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56452.log.gz 2026-02-20T19:00:07.004 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57334.log 2026-02-20T19:00:07.004 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.57628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53409.log 2026-02-20T19:00:07.004 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57628.log.gz 2026-02-20T19:00:07.004 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.57334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55982.log 2026-02-20T19:00:07.004 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57334.log.gz 2026-02-20T19:00:07.004 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.53409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53826.log 2026-02-20T19:00:07.004 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53409.log.gz 2026-02-20T19:00:07.004 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.55982.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55982.log.gz 2026-02-20T19:00:07.004 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55015.log 2026-02-20T19:00:07.004 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.53826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53416.log 2026-02-20T19:00:07.004 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53826.log.gz 2026-02-20T19:00:07.004 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.55015.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55015.log.gz 2026-02-20T19:00:07.004 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55958.log 2026-02-20T19:00:07.004 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.53416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57481.log 2026-02-20T19:00:07.005 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53416.log.gz 2026-02-20T19:00:07.005 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.55958.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-mgr.x.log 2026-02-20T19:00:07.005 INFO:teuthology.orchestra.run.trial166.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55958.log.gz 2026-02-20T19:00:07.005 INFO:teuthology.orchestra.run.trial166.stderr: 92.0%/var/log/ceph/ceph-client.admin.57481.log: -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-20T19:00:07.005 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55262.log 2026-02-20T19:00:07.005 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57481.log.gz 2026-02-20T19:00:07.005 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55907.log 2026-02-20T19:00:07.005 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.55262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47460.log 2026-02-20T19:00:07.005 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55262.log.gz 2026-02-20T19:00:07.005 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.55907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54453.log 0.0% 2026-02-20T19:00:07.005 INFO:teuthology.orchestra.run.trial166.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55907.log.gz 2026-02-20T19:00:07.005 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.47460.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47460.log.gz 2026-02-20T19:00:07.005 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56844.log 2026-02-20T19:00:07.005 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.54453.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54453.log.gz 2026-02-20T19:00:07.005 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55782.log 2026-02-20T19:00:07.005 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.56844.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56844.log.gz 2026-02-20T19:00:07.005 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55757.log 2026-02-20T19:00:07.005 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.55782.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55782.log.gz 2026-02-20T19:00:07.005 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56795.log 2026-02-20T19:00:07.005 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.55757.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55757.log.gz 2026-02-20T19:00:07.005 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54987.log 2026-02-20T19:00:07.005 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.56795.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56795.log.gz 2026-02-20T19:00:07.005 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53420.log 2026-02-20T19:00:07.005 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.54987.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54987.log.gz 2026-02-20T19:00:07.006 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-20T19:00:07.006 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.53420.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53420.log.gz 2026-02-20T19:00:07.006 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55139.log 2026-02-20T19:00:07.006 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56648.log 2026-02-20T19:00:07.006 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.55139.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55139.log.gz 2026-02-20T19:00:07.006 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.8.log 2026-02-20T19:00:07.006 INFO:teuthology.orchestra.run.trial166.stderr: 85.7% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-20T19:00:07.006 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.56648.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56648.log.gz 2026-02-20T19:00:07.006 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57089.log 2026-02-20T19:00:07.006 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55337.log 2026-02-20T19:00:07.006 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.57089.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57089.log.gz 2026-02-20T19:00:07.006 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.9.log 2026-02-20T19:00:07.006 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.55337.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55337.log.gz 2026-02-20T19:00:07.006 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57677.log 2026-02-20T19:00:07.006 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56128.log 2026-02-20T19:00:07.006 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.57677.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57677.log.gz 2026-02-20T19:00:07.006 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53421.log 2026-02-20T19:00:07.006 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.56128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54361.log 2026-02-20T19:00:07.006 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56128.log.gz 2026-02-20T19:00:07.006 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.53421.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53421.log.gz 2026-02-20T19:00:07.006 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55091.log 2026-02-20T19:00:07.006 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.54361.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.37044.log 2026-02-20T19:00:07.006 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54361.log.gz 2026-02-20T19:00:07.007 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.55091.log: 0.0% 92.1% -- replaced with /var/log/ceph/ceph-client.admin.55091.log.gz 2026-02-20T19:00:07.007 INFO:teuthology.orchestra.run.trial166.stderr: -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2026-02-20T19:00:07.007 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56599.log 2026-02-20T19:00:07.007 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph.tmp-client.admin.37044.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.54359.log 2026-02-20T19:00:07.007 INFO:teuthology.orchestra.run.trial166.stderr: -- replaced with /var/log/ceph/ceph.tmp-client.admin.37044.log.gz 2026-02-20T19:00:07.007 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.56599.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56599.log.gz 2026-02-20T19:00:07.007 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55436.log 2026-02-20T19:00:07.007 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.54359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55832.log 2026-02-20T19:00:07.007 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54359.log.gz 2026-02-20T19:00:07.007 INFO:teuthology.orchestra.run.trial166.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-20T19:00:07.007 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.55436.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55436.log.gz 2026-02-20T19:00:07.007 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53799.log 2026-02-20T19:00:07.007 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.55832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47413.log 2026-02-20T19:00:07.007 INFO:teuthology.orchestra.run.trial166.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55832.log.gz 2026-02-20T19:00:07.007 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.53799.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53799.log.gz 2026-02-20T19:00:07.007 INFO:teuthology.orchestra.run.trial166.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2026-02-20T19:00:07.007 INFO:teuthology.orchestra.run.trial166.stderr:/var/log/ceph/ceph-client.admin.47413.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47413.log.gz 2026-02-20T19:00:07.008 INFO:teuthology.orchestra.run.trial166.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-20T19:00:07.008 INFO:teuthology.orchestra.run.trial166.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2026-02-20T19:00:07.008 INFO:teuthology.orchestra.run.trial166.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2026-02-20T19:00:07.008 INFO:teuthology.orchestra.run.trial166.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-20T19:00:07.008 INFO:teuthology.orchestra.run.trial166.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.8.log.gz 2026-02-20T19:00:07.014 INFO:teuthology.orchestra.run.trial166.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-20T19:00:07.016 INFO:teuthology.orchestra.run.trial166.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.9.log.gz 2026-02-20T19:00:07.016 INFO:teuthology.orchestra.run.trial166.stderr: 2026-02-20T19:00:07.016 INFO:teuthology.orchestra.run.trial166.stderr:real 0m0.074s 2026-02-20T19:00:07.017 INFO:teuthology.orchestra.run.trial166.stderr:user 0m0.364s 2026-02-20T19:00:07.017 INFO:teuthology.orchestra.run.trial166.stderr:sys 0m0.085s 2026-02-20T19:00:07.017 INFO:tasks.ceph:Archiving logs... 2026-02-20T19:00:07.018 DEBUG:teuthology.misc:Transferring archived files from trial166:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-20_16:06:38-rados-wip-pdonnell-testing-20260219.182737-tentacle-distro-default-trial/61096/remote/trial166/log 2026-02-20T19:00:07.019 DEBUG:teuthology.orchestra.run.trial166:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-20T19:00:07.268 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-20T19:00:07.285 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-20T19:00:07.286 DEBUG:teuthology.orchestra.run.trial166:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-20T19:00:07.400 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-20T19:00:07.411 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-20T19:00:07.411 DEBUG:teuthology.orchestra.run.trial166:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T19:00:07.427 INFO:teuthology.orchestra.run.trial166.stderr:bash: line 1: ntpq: command not found 2026-02-20T19:00:07.447 INFO:teuthology.orchestra.run.trial166.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T19:00:07.447 INFO:teuthology.orchestra.run.trial166.stdout:=============================================================================== 2026-02-20T19:00:07.447 INFO:teuthology.orchestra.run.trial166.stdout:^+ ntp.maxhost.io 2 6 77 63 +8210us[+8210us] +/- 57ms 2026-02-20T19:00:07.447 INFO:teuthology.orchestra.run.trial166.stdout:^+ t1.time.bf1.yahoo.com 2 6 77 63 -27ms[ -27ms] +/- 42ms 2026-02-20T19:00:07.447 INFO:teuthology.orchestra.run.trial166.stdout:^+ y.ns.gin.ntt.net 2 6 77 62 +7731us[+7731us] +/- 53ms 2026-02-20T19:00:07.447 INFO:teuthology.orchestra.run.trial166.stdout:^* 108.61.73.244 2 6 77 64 +7691us[+9986us] +/- 23ms 2026-02-20T19:00:07.448 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-20T19:00:07.459 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-20T19:00:07.459 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-20T19:00:07.472 DEBUG:teuthology.orchestra.run.trial166:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-20T19:00:07.543 DEBUG:teuthology.orchestra.run.trial166:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-20T19:00:07.569 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T19:00:07.570 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-20T19:00:07.591 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-20T19:00:07.605 INFO:teuthology.task.internal:Duration was 356.831686 seconds 2026-02-20T19:00:07.606 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-20T19:00:07.617 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-20T19:00:07.617 DEBUG:teuthology.orchestra.run.trial166:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-20T19:00:07.653 INFO:teuthology.orchestra.run.trial166.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T19:00:07.997 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-20T19:00:07.997 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial166.front.sepia.ceph.com 2026-02-20T19:00:07.997 DEBUG:teuthology.orchestra.run.trial166:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-20T19:00:08.055 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-20T19:00:08.055 DEBUG:teuthology.orchestra.run.trial166:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T19:00:08.157 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-20T19:00:08.157 DEBUG:teuthology.orchestra.run.trial166:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T19:00:08.180 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T19:00:08.180 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T19:00:08.180 INFO:teuthology.orchestra.run.trial166.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-20T19:00:08.181 INFO:teuthology.orchestra.run.trial166.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T19:00:08.181 INFO:teuthology.orchestra.run.trial166.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-20T19:00:08.191 INFO:teuthology.orchestra.run.trial166.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 82.1% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-20T19:00:08.192 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-20T19:00:08.210 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-20T19:00:08.210 DEBUG:teuthology.orchestra.run.trial166:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-20T19:00:08.257 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-20T19:00:08.269 DEBUG:teuthology.orchestra.run.trial166:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-20T19:00:08.320 INFO:teuthology.orchestra.run.trial166.stdout:kernel.core_pattern = core 2026-02-20T19:00:08.332 DEBUG:teuthology.orchestra.run.trial166:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-20T19:00:08.388 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T19:00:08.389 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-20T19:00:08.414 INFO:teuthology.task.internal:Transferring archived files... 2026-02-20T19:00:08.415 DEBUG:teuthology.misc:Transferring archived files from trial166:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-20_16:06:38-rados-wip-pdonnell-testing-20260219.182737-tentacle-distro-default-trial/61096/remote/trial166 2026-02-20T19:00:08.415 DEBUG:teuthology.orchestra.run.trial166:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-20T19:00:08.468 INFO:teuthology.task.internal:Removing archive directory... 2026-02-20T19:00:08.469 DEBUG:teuthology.orchestra.run.trial166:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-20T19:00:08.516 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-20T19:00:08.529 INFO:teuthology.task.internal:Not uploading archives. 2026-02-20T19:00:08.529 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-20T19:00:08.542 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-20T19:00:08.543 DEBUG:teuthology.orchestra.run.trial166:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-20T19:00:08.572 INFO:teuthology.orchestra.run.trial166.stdout: 917576 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 20 19:00 /home/ubuntu/cephtest 2026-02-20T19:00:08.573 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-20T19:00:08.614 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-20T19:00:08.642 INFO:teuthology.run:Summary data: description: rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{centos_latest}} duration: 356.8316855430603 flavor: default owner: scheduled_yuriw@soko04.front.sepia.ceph.com success: true 2026-02-20T19:00:08.642 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T19:00:08.750 INFO:teuthology.run:pass