2026-02-17T11:47:14.457 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-17T11:47:14.471 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T11:47:14.548 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51362 branch: wip-bharath20-testing-2026-02-13-0906-squid description: rados/singleton-nomsgr/{all/ceph-snapmapper mon_election/classic rados supported-random-distro$/{centos_latest}} email: skanta@redhat.com first_in_suite: false flavor: default job_id: '51362' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-bharath20-testing-2026-02-13-0906-squid ceph: conf: global: mon election default strategy: 1 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon scrub interval: 300 osd: bluestore zero block detection: true debug ms: 1 debug osd: 20 osd debug verify cached snaps: true osd debug verify missing on start: true osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd op queue: debug_random osd op queue cut off: debug_random flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - but it is still running - overall HEALTH_ - \(POOL_APP_NOT_ENABLED\) pre-mgr-commands: - sudo ceph config set mgr mgr_pool false --force sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 workunit: branch: wip-bharath20-testing-2026-02-13-0906-squid sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 owner: scheduled_skanta@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 4581 sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-bharath20-testing-2026-02-13-0906-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 targets: trial111.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMgBynaJOtQ/rMstCSCpmquSZogZpvyEQ9HGByWDdpTsNiIuy391CMaku9KdaztsI98mXa2xz75kkUqvhuFpulI= tasks: - install: null - ceph: null - exec: client.0: - ceph_test_snap_mapper teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-17_04:10:36 tube: trial user: skanta verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682 2026-02-17T11:47:14.549 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa; will attempt to use it 2026-02-17T11:47:14.549 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa/tasks 2026-02-17T11:47:14.549 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-17T11:47:14.550 INFO:teuthology.task.internal:Checking packages... 2026-02-17T11:47:14.551 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3c96dfb3f50b3d02598a82af7104764bfdcd3919' 2026-02-17T11:47:14.551 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-17T11:47:14.551 INFO:teuthology.packaging:ref: None 2026-02-17T11:47:14.551 INFO:teuthology.packaging:tag: None 2026-02-17T11:47:14.551 INFO:teuthology.packaging:branch: wip-bharath20-testing-2026-02-13-0906-squid 2026-02-17T11:47:14.551 INFO:teuthology.packaging:sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T11:47:14.551 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-bharath20-testing-2026-02-13-0906-squid 2026-02-17T11:47:14.679 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-675.g3c96dfb3 2026-02-17T11:47:14.681 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-17T11:47:14.691 INFO:teuthology.task.internal:no buildpackages task found 2026-02-17T11:47:14.691 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-17T11:47:14.701 INFO:teuthology.task.internal:Saving configuration 2026-02-17T11:47:14.710 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-17T11:47:14.723 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-17T11:47:14.803 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial111.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51362', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 11:43:51.978717', 'locked_by': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMgBynaJOtQ/rMstCSCpmquSZogZpvyEQ9HGByWDdpTsNiIuy391CMaku9KdaztsI98mXa2xz75kkUqvhuFpulI='} 2026-02-17T11:47:14.803 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-17T11:47:14.814 INFO:teuthology.task.internal:roles: ubuntu@trial111.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2026-02-17T11:47:14.814 INFO:teuthology.run_tasks:Running task console_log... 2026-02-17T11:47:14.894 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x72a68dfbdbc0>, signals=[15]) 2026-02-17T11:47:14.894 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-17T11:47:14.908 INFO:teuthology.task.internal:Opening connections... 2026-02-17T11:47:14.908 DEBUG:teuthology.task.internal:connecting to ubuntu@trial111.front.sepia.ceph.com 2026-02-17T11:47:14.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:47:14.973 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-17T11:47:14.983 DEBUG:teuthology.orchestra.run.trial111:> uname -m 2026-02-17T11:47:15.043 INFO:teuthology.orchestra.run.trial111.stdout:x86_64 2026-02-17T11:47:15.043 DEBUG:teuthology.orchestra.run.trial111:> cat /etc/os-release 2026-02-17T11:47:15.099 INFO:teuthology.orchestra.run.trial111.stdout:NAME="CentOS Stream" 2026-02-17T11:47:15.099 INFO:teuthology.orchestra.run.trial111.stdout:VERSION="9" 2026-02-17T11:47:15.099 INFO:teuthology.orchestra.run.trial111.stdout:ID="centos" 2026-02-17T11:47:15.099 INFO:teuthology.orchestra.run.trial111.stdout:ID_LIKE="rhel fedora" 2026-02-17T11:47:15.099 INFO:teuthology.orchestra.run.trial111.stdout:VERSION_ID="9" 2026-02-17T11:47:15.099 INFO:teuthology.orchestra.run.trial111.stdout:PLATFORM_ID="platform:el9" 2026-02-17T11:47:15.099 INFO:teuthology.orchestra.run.trial111.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T11:47:15.099 INFO:teuthology.orchestra.run.trial111.stdout:ANSI_COLOR="0;31" 2026-02-17T11:47:15.100 INFO:teuthology.orchestra.run.trial111.stdout:LOGO="fedora-logo-icon" 2026-02-17T11:47:15.100 INFO:teuthology.orchestra.run.trial111.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T11:47:15.100 INFO:teuthology.orchestra.run.trial111.stdout:HOME_URL="https://centos.org/" 2026-02-17T11:47:15.100 INFO:teuthology.orchestra.run.trial111.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T11:47:15.100 INFO:teuthology.orchestra.run.trial111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T11:47:15.100 INFO:teuthology.orchestra.run.trial111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T11:47:15.101 INFO:teuthology.lock.ops:Updating trial111.front.sepia.ceph.com on lock server 2026-02-17T11:47:15.182 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-17T11:47:15.194 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-17T11:47:15.207 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-17T11:47:15.207 DEBUG:teuthology.orchestra.run.trial111:> test '!' -e /home/ubuntu/cephtest 2026-02-17T11:47:15.222 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-17T11:47:15.236 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-17T11:47:15.236 DEBUG:teuthology.orchestra.run.trial111:> test -z $(ls -A /var/lib/ceph) 2026-02-17T11:47:15.279 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-17T11:47:15.391 INFO:teuthology.run_tasks:Running task kernel... 2026-02-17T11:47:15.429 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-17T11:47:15.429 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-17T11:47:15.430 DEBUG:teuthology.orchestra.run.trial111:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T11:47:15.444 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T11:47:15.445 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-17T11:47:15.500 INFO:teuthology.orchestra.run.trial111.stdout:5.14.0-645.el9.x86_64 2026-02-17T11:47:15.500 INFO:teuthology.task.kernel:Running kernel on trial111: 5.14.0-645.el9.x86_64 2026-02-17T11:47:15.500 DEBUG:teuthology.orchestra.run.trial111:> sudo yum install -y kernel 2026-02-17T11:47:17.070 INFO:teuthology.orchestra.run.trial111.stdout:CentOS Stream 9 - BaseOS 7.4 MB/s | 8.9 MB 00:01 2026-02-17T11:47:18.328 INFO:teuthology.orchestra.run.trial111.stdout:CentOS Stream 9 - AppStream 37 MB/s | 27 MB 00:00 2026-02-17T11:47:21.036 INFO:teuthology.orchestra.run.trial111.stdout:CentOS Stream 9 - CRB 26 MB/s | 7.8 MB 00:00 2026-02-17T11:47:21.973 INFO:teuthology.orchestra.run.trial111.stdout:CentOS Stream 9 - Extras packages 101 kB/s | 20 kB 00:00 2026-02-17T11:47:22.247 INFO:teuthology.orchestra.run.trial111.stdout:Extra Packages for Enterprise Linux 96 MB/s | 20 MB 00:00 2026-02-17T11:47:25.445 INFO:teuthology.orchestra.run.trial111.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-17T11:47:26.456 INFO:teuthology.orchestra.run.trial111.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-17T11:47:26.476 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-17T11:47:26.478 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-17T11:47:26.478 INFO:teuthology.orchestra.run.trial111.stdout: Package Architecture Version Repository Size 2026-02-17T11:47:26.478 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-17T11:47:26.478 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-17T11:47:26.478 INFO:teuthology.orchestra.run.trial111.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-17T11:47:26.479 INFO:teuthology.orchestra.run.trial111.stdout:Installing dependencies: 2026-02-17T11:47:26.479 INFO:teuthology.orchestra.run.trial111.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-17T11:47:26.479 INFO:teuthology.orchestra.run.trial111.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-17T11:47:26.479 INFO:teuthology.orchestra.run.trial111.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-17T11:47:26.479 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:47:26.479 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-17T11:47:26.480 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-17T11:47:26.480 INFO:teuthology.orchestra.run.trial111.stdout:Install 4 Packages 2026-02-17T11:47:26.480 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:47:26.480 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 88 M 2026-02-17T11:47:26.480 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 135 M 2026-02-17T11:47:26.480 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-17T11:47:28.001 INFO:teuthology.orchestra.run.trial111.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 559 kB/s | 803 kB 00:01 2026-02-17T11:47:29.743 INFO:teuthology.orchestra.run.trial111.stdout:(2/4): kernel-modules-core-5.14.0-681.el9.x86_6 18 MB/s | 31 MB 00:01 2026-02-17T11:47:29.766 INFO:teuthology.orchestra.run.trial111.stdout:(3/4): kernel-core-5.14.0-681.el9.x86_64.rpm 5.3 MB/s | 17 MB 00:03 2026-02-17T11:47:30.392 INFO:teuthology.orchestra.run.trial111.stdout:(4/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 10 MB/s | 40 MB 00:03 2026-02-17T11:47:30.394 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:47:30.394 INFO:teuthology.orchestra.run.trial111.stdout:Total 23 MB/s | 88 MB 00:03 2026-02-17T11:47:30.581 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-17T11:47:30.786 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-17T11:47:30.786 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-17T11:47:31.133 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-17T11:47:31.133 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-17T11:47:32.215 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-17T11:47:32.498 INFO:teuthology.orchestra.run.trial111.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-17T11:47:32.518 INFO:teuthology.orchestra.run.trial111.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T11:47:34.313 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T11:47:34.341 INFO:teuthology.orchestra.run.trial111.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T11:47:37.365 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T11:47:37.371 INFO:teuthology.orchestra.run.trial111.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:47:40.407 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:48:11.160 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:48:11.183 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:48:11.248 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:48:11.248 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-17T11:48:11.248 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T11:48:11.249 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T11:48:11.300 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:48:11.300 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:48:11.300 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-17T11:48:11.300 INFO:teuthology.orchestra.run.trial111.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-17T11:48:11.300 INFO:teuthology.orchestra.run.trial111.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-17T11:48:11.300 INFO:teuthology.orchestra.run.trial111.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-17T11:48:11.300 INFO:teuthology.orchestra.run.trial111.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-17T11:48:11.300 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:48:11.300 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-17T11:48:11.358 DEBUG:teuthology.orchestra.run.trial111:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T11:48:11.385 INFO:teuthology.orchestra.run.trial111.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T11:48:11.386 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T11:48:11.386 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-17T11:48:11.386 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T11:48:11.386 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T11:48:11.387 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-17T11:48:11.387 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial111.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T11:48:11.387 DEBUG:teuthology.orchestra.run.trial111:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T11:48:11.448 INFO:teuthology.orchestra.run.trial111.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T11:48:11.450 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T11:48:11.450 DEBUG:teuthology.orchestra.run.trial111:> sudo rpm -qi grub2-tools 2026-02-17T11:48:11.519 INFO:teuthology.orchestra.run.trial111.stdout:Name : grub2-tools 2026-02-17T11:48:11.519 INFO:teuthology.orchestra.run.trial111.stdout:Epoch : 1 2026-02-17T11:48:11.519 INFO:teuthology.orchestra.run.trial111.stdout:Version : 2.06 2026-02-17T11:48:11.519 INFO:teuthology.orchestra.run.trial111.stdout:Release : 118.el9 2026-02-17T11:48:11.520 INFO:teuthology.orchestra.run.trial111.stdout:Architecture: x86_64 2026-02-17T11:48:11.520 INFO:teuthology.orchestra.run.trial111.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-17T11:48:11.520 INFO:teuthology.orchestra.run.trial111.stdout:Group : Unspecified 2026-02-17T11:48:11.520 INFO:teuthology.orchestra.run.trial111.stdout:Size : 8393909 2026-02-17T11:48:11.520 INFO:teuthology.orchestra.run.trial111.stdout:License : GPLv3+ 2026-02-17T11:48:11.520 INFO:teuthology.orchestra.run.trial111.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-17T11:48:11.520 INFO:teuthology.orchestra.run.trial111.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-17T11:48:11.520 INFO:teuthology.orchestra.run.trial111.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-17T11:48:11.520 INFO:teuthology.orchestra.run.trial111.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-17T11:48:11.520 INFO:teuthology.orchestra.run.trial111.stdout:Packager : builder@centos.org 2026-02-17T11:48:11.520 INFO:teuthology.orchestra.run.trial111.stdout:Vendor : CentOS 2026-02-17T11:48:11.520 INFO:teuthology.orchestra.run.trial111.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-17T11:48:11.521 INFO:teuthology.orchestra.run.trial111.stdout:Summary : Support tools for GRUB. 2026-02-17T11:48:11.521 INFO:teuthology.orchestra.run.trial111.stdout:Description : 2026-02-17T11:48:11.521 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:48:11.521 INFO:teuthology.orchestra.run.trial111.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-17T11:48:11.521 INFO:teuthology.orchestra.run.trial111.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-17T11:48:11.521 INFO:teuthology.orchestra.run.trial111.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-17T11:48:11.521 INFO:teuthology.orchestra.run.trial111.stdout:hardware devices. 2026-02-17T11:48:11.521 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:48:11.521 INFO:teuthology.orchestra.run.trial111.stdout:This subpackage provides tools for support of all platforms. 2026-02-17T11:48:11.523 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-17T11:48:11.523 INFO:teuthology.task.kernel:Updating grub on trial111 to boot 5.14.0-681.el9.x86_64 2026-02-17T11:48:11.523 DEBUG:teuthology.orchestra.run.trial111:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-17T11:48:11.587 INFO:teuthology.orchestra.run.trial111.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T11:48:11.589 DEBUG:teuthology.orchestra.run.trial111:> sudo command -v grubby && echo yes || echo no 2026-02-17T11:48:11.654 INFO:teuthology.orchestra.run.trial111.stdout:/sbin/grubby 2026-02-17T11:48:11.656 INFO:teuthology.orchestra.run.trial111.stdout:yes 2026-02-17T11:48:11.657 DEBUG:teuthology.orchestra.run.trial111:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-17T11:48:11.719 INFO:teuthology.orchestra.run.trial111.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T11:48:11.721 DEBUG:teuthology.orchestra.run.trial111:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-17T11:48:11.795 DEBUG:teuthology.orchestra.run.trial111:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-17T11:48:12.007 INFO:teuthology.orchestra.run.trial111.stderr:Generating grub configuration file ... 2026-02-17T11:48:12.071 INFO:teuthology.orchestra.run.trial111.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-17T11:48:12.077 INFO:teuthology.orchestra.run.trial111.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-17T11:48:12.333 INFO:teuthology.orchestra.run.trial111.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-17T11:48:12.340 INFO:teuthology.orchestra.run.trial111.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-17T11:48:12.372 INFO:teuthology.orchestra.run.trial111.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-17T11:48:12.378 INFO:teuthology.orchestra.run.trial111.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-17T11:48:12.402 INFO:teuthology.orchestra.run.trial111.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-17T11:48:12.409 INFO:teuthology.orchestra.run.trial111.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-17T11:48:12.493 INFO:teuthology.orchestra.run.trial111.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T11:48:12.501 INFO:teuthology.orchestra.run.trial111.stderr:done 2026-02-17T11:48:12.503 DEBUG:teuthology.orchestra.run.trial111:> test -d /sys/firmware/efi 2026-02-17T11:48:12.518 DEBUG:teuthology.orchestra.run.trial111:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-17T11:48:12.583 INFO:teuthology.orchestra.run.trial111.stdout:/boot/efi/EFI/BOOT 2026-02-17T11:48:12.584 INFO:teuthology.orchestra.run.trial111.stdout:/boot/efi/EFI/centos 2026-02-17T11:48:12.585 DEBUG:teuthology.orchestra.run.trial111:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-17T11:48:12.651 INFO:teuthology.orchestra.run.trial111.stdout:no 2026-02-17T11:48:12.651 DEBUG:teuthology.orchestra.run.trial111:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-17T11:48:12.715 INFO:teuthology.orchestra.run.trial111.stdout:yes 2026-02-17T11:48:12.716 DEBUG:teuthology.orchestra.run.trial111:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-17T11:48:12.782 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial111 2026-02-17T11:48:12.782 DEBUG:teuthology.orchestra.run.trial111:> sudo bash -c ' 2026-02-17T11:48:12.782 DEBUG:teuthology.orchestra.run.trial111:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-17T11:48:12.782 DEBUG:teuthology.orchestra.run.trial111:> ' 2026-02-17T11:48:42.825 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-17T11:48:42.826 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-17T11:48:42.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:48:57.088 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.111 2026-02-17T11:49:06.095 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-17T11:49:06.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:49:42.016 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-17T11:49:42.172 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-17T11:49:42.172 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-681.el9.x86_64"... 2026-02-17T11:49:42.172 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-17T11:49:42.229 INFO:teuthology.orchestra.run.trial111.stdout:5.14.0-681.el9.x86_64 2026-02-17T11:49:42.230 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-17T11:49:42.230 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T11:49:42.230 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-17T11:49:43.231 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-17T11:49:43.231 DEBUG:teuthology.orchestra.run.trial111:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T11:49:43.261 INFO:teuthology.orchestra.run.trial111.stdout:ttyS1 2026-02-17T11:49:43.286 DEBUG:teuthology.parallel:result is None 2026-02-17T11:49:43.286 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-17T11:49:43.298 INFO:teuthology.task.internal:Creating test directory... 2026-02-17T11:49:43.299 DEBUG:teuthology.orchestra.run.trial111:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T11:49:43.344 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-17T11:49:43.356 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-17T11:49:43.370 INFO:teuthology.task.internal:Creating archive directory... 2026-02-17T11:49:43.371 DEBUG:teuthology.orchestra.run.trial111:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T11:49:43.405 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-17T11:49:43.419 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-17T11:49:43.419 DEBUG:teuthology.orchestra.run.trial111:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T11:49:43.464 INFO:teuthology.orchestra.run.trial111.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:49:43.472 INFO:teuthology.orchestra.run.trial111.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:49:43.474 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-17T11:49:43.486 INFO:teuthology.task.internal:Configuring sudo... 2026-02-17T11:49:43.486 DEBUG:teuthology.orchestra.run.trial111:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T11:49:43.538 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-17T11:49:43.554 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-17T11:49:43.555 DEBUG:teuthology.orchestra.run.trial111:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T11:49:43.596 DEBUG:teuthology.orchestra.run.trial111:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T11:49:43.759 DEBUG:teuthology.orchestra.run.trial111:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T11:49:43.784 DEBUG:teuthology.orchestra.run.trial111:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T11:49:43.936 DEBUG:teuthology.orchestra.run.trial111:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T11:49:43.961 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-17T11:49:43.961 DEBUG:teuthology.orchestra.run.trial111:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T11:49:44.026 DEBUG:teuthology.orchestra.run.trial111:> sudo service rsyslog restart 2026-02-17T11:49:44.095 INFO:teuthology.orchestra.run.trial111.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T11:49:44.428 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-17T11:49:44.441 INFO:teuthology.task.internal:Starting timer... 2026-02-17T11:49:44.441 INFO:teuthology.run_tasks:Running task pcp... 2026-02-17T11:49:44.465 INFO:teuthology.run_tasks:Running task selinux... 2026-02-17T11:49:44.487 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2026-02-17T11:49:44.488 DEBUG:teuthology.orchestra.run.trial111:> sudo service auditd rotate 2026-02-17T11:49:44.517 INFO:teuthology.orchestra.run.trial111.stdout:Rotating logs: 2026-02-17T11:49:44.519 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-17T11:49:44.519 DEBUG:teuthology.orchestra.run.trial111:> /usr/sbin/getenforce 2026-02-17T11:49:44.574 INFO:teuthology.orchestra.run.trial111.stdout:Permissive 2026-02-17T11:49:44.575 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial111.front.sepia.ceph.com': 'permissive'} 2026-02-17T11:49:44.575 DEBUG:teuthology.orchestra.run.trial111:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T11:49:44.638 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T11:49:44.639 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-17T11:49:44.639 DEBUG:teuthology.orchestra.run.trial111:> sudo /usr/sbin/setenforce permissive 2026-02-17T11:49:44.705 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-17T11:49:44.723 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2026-02-17T11:49:44.725 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2026-02-17T11:49:44.845 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-17T11:49:44.851 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-17T11:49:44.852 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial111.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-17T11:52:39.228 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial111.front.sepia.ceph.com')] 2026-02-17T11:52:39.229 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-17T11:52:39.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:52:39.346 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-17T11:52:39.423 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-17T11:52:39.423 INFO:teuthology.run_tasks:Running task clock... 2026-02-17T11:52:39.439 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-17T11:52:39.440 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T11:52:39.440 DEBUG:teuthology.orchestra.run.trial111:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T11:52:39.490 INFO:teuthology.orchestra.run.trial111.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-17T11:52:39.502 INFO:teuthology.orchestra.run.trial111.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-17T11:52:39.524 INFO:teuthology.orchestra.run.trial111.stderr:sudo: ntpd: command not found 2026-02-17T11:52:39.534 INFO:teuthology.orchestra.run.trial111.stdout:506 Cannot talk to daemon 2026-02-17T11:52:39.545 INFO:teuthology.orchestra.run.trial111.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-17T11:52:39.556 INFO:teuthology.orchestra.run.trial111.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-17T11:52:39.599 INFO:teuthology.orchestra.run.trial111.stderr:bash: line 1: ntpq: command not found 2026-02-17T11:52:39.618 INFO:teuthology.orchestra.run.trial111.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T11:52:39.618 INFO:teuthology.orchestra.run.trial111.stdout:=============================================================================== 2026-02-17T11:52:39.618 INFO:teuthology.orchestra.run.trial111.stdout:^? 172-232-15-202.ip.linode> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T11:52:39.618 INFO:teuthology.orchestra.run.trial111.stdout:^? sushi.ruselabs.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T11:52:39.618 INFO:teuthology.orchestra.run.trial111.stdout:^? owners.kjsl.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T11:52:39.618 INFO:teuthology.orchestra.run.trial111.stdout:^? chi2.us.ntp.li 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T11:52:39.619 INFO:teuthology.run_tasks:Running task install... 2026-02-17T11:52:39.630 DEBUG:teuthology.task.install:project ceph 2026-02-17T11:52:39.630 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919'}} 2026-02-17T11:52:39.631 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919'} 2026-02-17T11:52:39.631 INFO:teuthology.task.install:Using flavor: default 2026-02-17T11:52:39.637 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-17T11:52:39.637 INFO:teuthology.task.install:extra packages: [] 2026-02-17T11:52:39.637 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919', 'tag': None, 'wait_for_package': False} 2026-02-17T11:52:39.638 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T11:52:39.767 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/ 2026-02-17T11:52:39.767 INFO:teuthology.task.install.rpm:Package version is 19.2.3-675.g3c96dfb3 2026-02-17T11:52:39.884 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-17T11:52:39.884 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-17T11:52:39.884 DEBUG:teuthology.orchestra.run.trial111:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-17T11:52:39.909 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-17T11:52:39.909 DEBUG:teuthology.orchestra.run.trial111:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3c96dfb3f50b3d02598a82af7104764bfdcd3919/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-17T11:52:39.975 DEBUG:teuthology.orchestra.run.trial111:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-17T11:52:40.049 DEBUG:teuthology.orchestra.run.trial111:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-17T11:52:40.113 INFO:teuthology.orchestra.run.trial111.stdout:check_obsoletes = 1 2026-02-17T11:52:40.114 DEBUG:teuthology.orchestra.run.trial111:> sudo yum clean all 2026-02-17T11:52:40.264 INFO:teuthology.orchestra.run.trial111.stdout:41 files removed 2026-02-17T11:52:40.277 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph-radosgw 2026-02-17T11:52:40.623 INFO:teuthology.orchestra.run.trial111.stdout:ceph packages for x86_64 427 kB/s | 86 kB 00:00 2026-02-17T11:52:40.761 INFO:teuthology.orchestra.run.trial111.stdout:ceph noarch packages 106 kB/s | 12 kB 00:00 2026-02-17T11:52:40.886 INFO:teuthology.orchestra.run.trial111.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-17T11:52:41.549 INFO:teuthology.orchestra.run.trial111.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.9 MB 00:00 2026-02-17T11:52:44.767 INFO:teuthology.orchestra.run.trial111.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-17T11:52:48.251 INFO:teuthology.orchestra.run.trial111.stdout:CentOS Stream 9 - CRB 7.8 MB/s | 7.8 MB 00:00 2026-02-17T11:52:49.899 INFO:teuthology.orchestra.run.trial111.stdout:CentOS Stream 9 - Extras packages 22 kB/s | 20 kB 00:00 2026-02-17T11:52:51.003 INFO:teuthology.orchestra.run.trial111.stdout:Extra Packages for Enterprise Linux 19 MB/s | 20 MB 00:01 2026-02-17T11:52:54.204 INFO:teuthology.orchestra.run.trial111.stdout:lab-extras 1.9 MB/s | 50 kB 00:00 2026-02-17T11:52:55.416 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-17T11:52:55.417 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-17T11:52:55.417 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repository Size 2026-02-17T11:52:55.418 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-17T11:52:55.418 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-17T11:52:55.418 INFO:teuthology.orchestra.run.trial111.stdout: ceph-radosgw x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 11 M 2026-02-17T11:52:55.418 INFO:teuthology.orchestra.run.trial111.stdout:Upgrading: 2026-02-17T11:52:55.418 INFO:teuthology.orchestra.run.trial111.stdout: librados2 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 3.4 M 2026-02-17T11:52:55.418 INFO:teuthology.orchestra.run.trial111.stdout: librbd1 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 3.2 M 2026-02-17T11:52:55.418 INFO:teuthology.orchestra.run.trial111.stdout:Installing dependencies: 2026-02-17T11:52:55.418 INFO:teuthology.orchestra.run.trial111.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-17T11:52:55.418 INFO:teuthology.orchestra.run.trial111.stdout: ceph-base x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 5.5 M 2026-02-17T11:52:55.418 INFO:teuthology.orchestra.run.trial111.stdout: ceph-common x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 22 M 2026-02-17T11:52:55.419 INFO:teuthology.orchestra.run.trial111.stdout: ceph-selinux x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 25 k 2026-02-17T11:52:55.419 INFO:teuthology.orchestra.run.trial111.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-17T11:52:55.419 INFO:teuthology.orchestra.run.trial111.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-17T11:52:55.419 INFO:teuthology.orchestra.run.trial111.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-17T11:52:55.419 INFO:teuthology.orchestra.run.trial111.stdout: libcephfs2 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 999 k 2026-02-17T11:52:55.419 INFO:teuthology.orchestra.run.trial111.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-17T11:52:55.419 INFO:teuthology.orchestra.run.trial111.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-17T11:52:55.419 INFO:teuthology.orchestra.run.trial111.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-17T11:52:55.419 INFO:teuthology.orchestra.run.trial111.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-17T11:52:55.419 INFO:teuthology.orchestra.run.trial111.stdout: libradosstriper1 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 503 k 2026-02-17T11:52:55.419 INFO:teuthology.orchestra.run.trial111.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-17T11:52:55.419 INFO:teuthology.orchestra.run.trial111.stdout: librgw2 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 5.4 M 2026-02-17T11:52:55.419 INFO:teuthology.orchestra.run.trial111.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-17T11:52:55.420 INFO:teuthology.orchestra.run.trial111.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-17T11:52:55.420 INFO:teuthology.orchestra.run.trial111.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-17T11:52:55.420 INFO:teuthology.orchestra.run.trial111.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-17T11:52:55.420 INFO:teuthology.orchestra.run.trial111.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-17T11:52:55.420 INFO:teuthology.orchestra.run.trial111.stdout: python3-ceph-argparse x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 45 k 2026-02-17T11:52:55.420 INFO:teuthology.orchestra.run.trial111.stdout: python3-ceph-common x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 142 k 2026-02-17T11:52:55.420 INFO:teuthology.orchestra.run.trial111.stdout: python3-cephfs x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 165 k 2026-02-17T11:52:55.420 INFO:teuthology.orchestra.run.trial111.stdout: python3-rados x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 322 k 2026-02-17T11:52:55.420 INFO:teuthology.orchestra.run.trial111.stdout: python3-rbd x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 303 k 2026-02-17T11:52:55.420 INFO:teuthology.orchestra.run.trial111.stdout: python3-rgw x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 100 k 2026-02-17T11:52:55.420 INFO:teuthology.orchestra.run.trial111.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-17T11:52:55.420 INFO:teuthology.orchestra.run.trial111.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-17T11:52:55.421 INFO:teuthology.orchestra.run.trial111.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-17T11:52:55.421 INFO:teuthology.orchestra.run.trial111.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-17T11:52:55.421 INFO:teuthology.orchestra.run.trial111.stdout:Installing weak dependencies: 2026-02-17T11:52:55.421 INFO:teuthology.orchestra.run.trial111.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-17T11:52:55.421 INFO:teuthology.orchestra.run.trial111.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-17T11:52:55.421 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:52:55.421 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-17T11:52:55.421 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-17T11:52:55.421 INFO:teuthology.orchestra.run.trial111.stdout:Install 33 Packages 2026-02-17T11:52:55.421 INFO:teuthology.orchestra.run.trial111.stdout:Upgrade 2 Packages 2026-02-17T11:52:55.421 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:52:55.422 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 63 M 2026-02-17T11:52:55.422 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-17T11:52:56.055 INFO:teuthology.orchestra.run.trial111.stdout:(1/35): ceph-base-19.2.3-675.g3c96dfb3.el9.x86_ 14 MB/s | 5.5 MB 00:00 2026-02-17T11:52:56.097 INFO:teuthology.orchestra.run.trial111.stdout:(2/35): ceph-selinux-19.2.3-675.g3c96dfb3.el9.x 600 kB/s | 25 kB 00:00 2026-02-17T11:52:56.161 INFO:teuthology.orchestra.run.trial111.stdout:(3/35): libcephfs2-19.2.3-675.g3c96dfb3.el9.x86 15 MB/s | 999 kB 00:00 2026-02-17T11:52:56.219 INFO:teuthology.orchestra.run.trial111.stdout:(4/35): libradosstriper1-19.2.3-675.g3c96dfb3.e 8.5 MB/s | 503 kB 00:00 2026-02-17T11:52:56.321 INFO:teuthology.orchestra.run.trial111.stdout:(5/35): ceph-radosgw-19.2.3-675.g3c96dfb3.el9.x 17 MB/s | 11 MB 00:00 2026-02-17T11:52:56.376 INFO:teuthology.orchestra.run.trial111.stdout:(6/35): python3-ceph-argparse-19.2.3-675.g3c96d 833 kB/s | 45 kB 00:00 2026-02-17T11:52:56.432 INFO:teuthology.orchestra.run.trial111.stdout:(7/35): python3-ceph-common-19.2.3-675.g3c96dfb 2.5 MB/s | 142 kB 00:00 2026-02-17T11:52:56.491 INFO:teuthology.orchestra.run.trial111.stdout:(8/35): python3-cephfs-19.2.3-675.g3c96dfb3.el9 2.7 MB/s | 165 kB 00:00 2026-02-17T11:52:56.504 INFO:teuthology.orchestra.run.trial111.stdout:(9/35): librgw2-19.2.3-675.g3c96dfb3.el9.x86_64 19 MB/s | 5.4 MB 00:00 2026-02-17T11:52:56.552 INFO:teuthology.orchestra.run.trial111.stdout:(10/35): ceph-common-19.2.3-675.g3c96dfb3.el9.x 25 MB/s | 22 MB 00:00 2026-02-17T11:52:56.553 INFO:teuthology.orchestra.run.trial111.stdout:(11/35): python3-rbd-19.2.3-675.g3c96dfb3.el9.x 6.0 MB/s | 303 kB 00:00 2026-02-17T11:52:56.554 INFO:teuthology.orchestra.run.trial111.stdout:(12/35): python3-rados-19.2.3-675.g3c96dfb3.el9 5.0 MB/s | 322 kB 00:00 2026-02-17T11:52:56.563 INFO:teuthology.orchestra.run.trial111.stdout:(13/35): python3-rgw-19.2.3-675.g3c96dfb3.el9.x 8.5 MB/s | 100 kB 00:00 2026-02-17T11:52:57.056 INFO:teuthology.orchestra.run.trial111.stdout:(14/35): mailcap-2.1.49-5.el9.noarch.rpm 66 kB/s | 33 kB 00:00 2026-02-17T11:52:57.083 INFO:teuthology.orchestra.run.trial111.stdout:(15/35): boost-program-options-1.75.0-13.el9.x8 3.9 MB/s | 104 kB 00:00 2026-02-17T11:52:57.091 INFO:teuthology.orchestra.run.trial111.stdout:(16/35): libnbd-1.20.3-4.el9.x86_64.rpm 18 MB/s | 164 kB 00:00 2026-02-17T11:52:57.098 INFO:teuthology.orchestra.run.trial111.stdout:(17/35): libpmemobj-1.12.1-1.el9.x86_64.rpm 24 MB/s | 160 kB 00:00 2026-02-17T11:52:57.102 INFO:teuthology.orchestra.run.trial111.stdout:(18/35): librabbitmq-0.11.0-7.el9.x86_64.rpm 10 MB/s | 45 kB 00:00 2026-02-17T11:52:57.112 INFO:teuthology.orchestra.run.trial111.stdout:(19/35): librdkafka-1.6.1-102.el9.x86_64.rpm 65 MB/s | 662 kB 00:00 2026-02-17T11:52:57.119 INFO:teuthology.orchestra.run.trial111.stdout:(20/35): lttng-ust-2.12.0-6.el9.x86_64.rpm 43 MB/s | 292 kB 00:00 2026-02-17T11:52:57.125 INFO:teuthology.orchestra.run.trial111.stdout:(21/35): qatlib-25.08.0-2.el9.x86_64.rpm 40 MB/s | 240 kB 00:00 2026-02-17T11:52:57.129 INFO:teuthology.orchestra.run.trial111.stdout:(22/35): qatlib-service-25.08.0-2.el9.x86_64.rp 8.7 MB/s | 37 kB 00:00 2026-02-17T11:52:57.134 INFO:teuthology.orchestra.run.trial111.stdout:(23/35): qatzip-libs-1.3.1-1.el9.x86_64.rpm 15 MB/s | 66 kB 00:00 2026-02-17T11:52:57.228 INFO:teuthology.orchestra.run.trial111.stdout:(24/35): pciutils-3.7.0-7.el9.x86_64.rpm 140 kB/s | 93 kB 00:00 2026-02-17T11:52:57.422 INFO:teuthology.orchestra.run.trial111.stdout:(25/35): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.0 MB/s | 308 kB 00:00 2026-02-17T11:52:57.439 INFO:teuthology.orchestra.run.trial111.stdout:(26/35): libarrow-9.0.0-15.el9.x86_64.rpm 21 MB/s | 4.4 MB 00:00 2026-02-17T11:52:57.454 INFO:teuthology.orchestra.run.trial111.stdout:(27/35): libarrow-doc-9.0.0-15.el9.noarch.rpm 778 kB/s | 25 kB 00:00 2026-02-17T11:52:57.467 INFO:teuthology.orchestra.run.trial111.stdout:(28/35): liboath-2.6.12-1.el9.x86_64.rpm 1.8 MB/s | 49 kB 00:00 2026-02-17T11:52:57.482 INFO:teuthology.orchestra.run.trial111.stdout:(29/35): libunwind-1.6.2-1.el9.x86_64.rpm 2.4 MB/s | 67 kB 00:00 2026-02-17T11:52:57.510 INFO:teuthology.orchestra.run.trial111.stdout:(30/35): parquet-libs-9.0.0-15.el9.x86_64.rpm 19 MB/s | 838 kB 00:00 2026-02-17T11:52:57.514 INFO:teuthology.orchestra.run.trial111.stdout:(31/35): re2-20211101-20.el9.x86_64.rpm 5.9 MB/s | 191 kB 00:00 2026-02-17T11:52:57.567 INFO:teuthology.orchestra.run.trial111.stdout:(32/35): thrift-0.15.0-4.el9.x86_64.rpm 28 MB/s | 1.6 MB 00:00 2026-02-17T11:52:57.593 INFO:teuthology.orchestra.run.trial111.stdout:(33/35): librados2-19.2.3-675.g3c96dfb3.el9.x86 43 MB/s | 3.4 MB 00:00 2026-02-17T11:52:57.649 INFO:teuthology.orchestra.run.trial111.stdout:(34/35): librbd1-19.2.3-675.g3c96dfb3.el9.x86_6 38 MB/s | 3.2 MB 00:00 2026-02-17T11:52:58.368 INFO:teuthology.orchestra.run.trial111.stdout:(35/35): nvme-cli-2.13-1.el9.x86_64.rpm 619 kB/s | 1.1 MB 00:01 2026-02-17T11:52:58.374 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:52:58.374 INFO:teuthology.orchestra.run.trial111.stdout:Total 21 MB/s | 63 MB 00:02 2026-02-17T11:52:58.472 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-17T11:52:58.491 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-17T11:52:58.491 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-17T11:52:58.730 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-17T11:52:58.730 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-17T11:52:59.019 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-17T11:52:59.028 INFO:teuthology.orchestra.run.trial111.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/37 2026-02-17T11:52:59.030 INFO:teuthology.orchestra.run.trial111.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/37 2026-02-17T11:52:59.042 INFO:teuthology.orchestra.run.trial111.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/37 2026-02-17T11:52:59.194 INFO:teuthology.orchestra.run.trial111.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/37 2026-02-17T11:52:59.197 INFO:teuthology.orchestra.run.trial111.stdout: Upgrading : librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/37 2026-02-17T11:52:59.226 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/37 2026-02-17T11:52:59.269 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 6/37 2026-02-17T11:52:59.269 INFO:teuthology.orchestra.run.trial111.stdout: Installing : libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 7/37 2026-02-17T11:52:59.281 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 7/37 2026-02-17T11:52:59.285 INFO:teuthology.orchestra.run.trial111.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/37 2026-02-17T11:52:59.294 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-ceph-argparse-2:19.2.3-675.g3c96dfb3.el9.x 9/37 2026-02-17T11:52:59.316 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 10/37 2026-02-17T11:52:59.317 INFO:teuthology.orchestra.run.trial111.stdout: Installing : libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 11/37 2026-02-17T11:52:59.329 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 11/37 2026-02-17T11:52:59.359 INFO:teuthology.orchestra.run.trial111.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/37 2026-02-17T11:52:59.362 INFO:teuthology.orchestra.run.trial111.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/37 2026-02-17T11:52:59.370 INFO:teuthology.orchestra.run.trial111.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/37 2026-02-17T11:52:59.373 INFO:teuthology.orchestra.run.trial111.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/37 2026-02-17T11:52:59.376 INFO:teuthology.orchestra.run.trial111.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/37 2026-02-17T11:52:59.380 INFO:teuthology.orchestra.run.trial111.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/37 2026-02-17T11:52:59.520 INFO:teuthology.orchestra.run.trial111.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T11:52:59.521 INFO:teuthology.orchestra.run.trial111.stdout: Upgrading : librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 19/37 2026-02-17T11:52:59.547 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 19/37 2026-02-17T11:52:59.550 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 20/37 2026-02-17T11:52:59.556 INFO:teuthology.orchestra.run.trial111.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/37 2026-02-17T11:52:59.780 INFO:teuthology.orchestra.run.trial111.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/37 2026-02-17T11:52:59.781 INFO:teuthology.orchestra.run.trial111.stdout: Installing : librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 23/37 2026-02-17T11:52:59.797 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 23/37 2026-02-17T11:52:59.801 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 24/37 2026-02-17T11:52:59.805 INFO:teuthology.orchestra.run.trial111.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/37 2026-02-17T11:52:59.807 INFO:teuthology.orchestra.run.trial111.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/37 2026-02-17T11:52:59.808 INFO:teuthology.orchestra.run.trial111.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T11:52:59.826 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T11:52:59.937 INFO:teuthology.orchestra.run.trial111.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/37 2026-02-17T11:52:59.939 INFO:teuthology.orchestra.run.trial111.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T11:53:00.222 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T11:53:00.222 INFO:teuthology.orchestra.run.trial111.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T11:53:00.222 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:00.260 INFO:teuthology.orchestra.run.trial111.stdout: Installing : mailcap-2.1.49-5.el9.noarch 30/37 2026-02-17T11:53:00.261 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86 31/37 2026-02-17T11:53:01.247 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 32/37 2026-02-17T11:53:01.249 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 32/37 2026-02-17T11:53:01.531 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 32/37 2026-02-17T11:53:01.534 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 33/37 2026-02-17T11:53:01.571 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 33/37 2026-02-17T11:53:01.571 INFO:teuthology.orchestra.run.trial111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-17T11:53:01.571 INFO:teuthology.orchestra.run.trial111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-17T11:53:01.571 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:01.574 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 34/37 2026-02-17T11:53:06.087 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 34/37 2026-02-17T11:53:06.087 INFO:teuthology.orchestra.run.trial111.stdout:skipping the directory /sys 2026-02-17T11:53:06.087 INFO:teuthology.orchestra.run.trial111.stdout:skipping the directory /proc 2026-02-17T11:53:06.087 INFO:teuthology.orchestra.run.trial111.stdout:skipping the directory /mnt 2026-02-17T11:53:06.087 INFO:teuthology.orchestra.run.trial111.stdout:skipping the directory /var/tmp 2026-02-17T11:53:06.088 INFO:teuthology.orchestra.run.trial111.stdout:skipping the directory /home 2026-02-17T11:53:06.088 INFO:teuthology.orchestra.run.trial111.stdout:skipping the directory /root 2026-02-17T11:53:06.088 INFO:teuthology.orchestra.run.trial111.stdout:skipping the directory /tmp 2026-02-17T11:53:06.088 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:06.539 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 35/37 2026-02-17T11:53:06.562 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 35/37 2026-02-17T11:53:06.563 INFO:teuthology.orchestra.run.trial111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:53:06.563 INFO:teuthology.orchestra.run.trial111.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-17T11:53:06.563 INFO:teuthology.orchestra.run.trial111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T11:53:06.563 INFO:teuthology.orchestra.run.trial111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T11:53:06.563 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:06.564 INFO:teuthology.orchestra.run.trial111.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T11:53:06.577 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T11:53:06.577 INFO:teuthology.orchestra.run.trial111.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T11:53:06.633 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T11:53:06.634 INFO:teuthology.orchestra.run.trial111.stdout:Creating group 'qat' with GID 992. 2026-02-17T11:53:06.634 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:06.902 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/37 2026-02-17T11:53:06.902 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/37 2026-02-17T11:53:06.902 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 3/37 2026-02-17T11:53:06.902 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/37 2026-02-17T11:53:06.902 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/37 2026-02-17T11:53:06.902 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 6/37 2026-02-17T11:53:06.902 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 7/37 2026-02-17T11:53:06.902 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-ceph-argparse-2:19.2.3-675.g3c96dfb3.el9.x 8/37 2026-02-17T11:53:06.902 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86 9/37 2026-02-17T11:53:06.902 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 10/37 2026-02-17T11:53:06.902 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 11/37 2026-02-17T11:53:06.902 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 12/37 2026-02-17T11:53:06.902 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 13/37 2026-02-17T11:53:06.902 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/37 2026-02-17T11:53:06.902 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 15/37 2026-02-17T11:53:06.902 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 16/37 2026-02-17T11:53:06.902 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 17/37 2026-02-17T11:53:06.902 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T11:53:06.902 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 19/37 2026-02-17T11:53:06.902 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 20/37 2026-02-17T11:53:06.903 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 21/37 2026-02-17T11:53:06.903 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 22/37 2026-02-17T11:53:06.903 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 23/37 2026-02-17T11:53:06.903 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 24/37 2026-02-17T11:53:06.903 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 25/37 2026-02-17T11:53:06.903 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 26/37 2026-02-17T11:53:06.903 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 27/37 2026-02-17T11:53:06.903 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 28/37 2026-02-17T11:53:06.903 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 29/37 2026-02-17T11:53:06.903 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 30/37 2026-02-17T11:53:06.903 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 31/37 2026-02-17T11:53:06.903 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : re2-1:20211101-20.el9.x86_64 32/37 2026-02-17T11:53:06.903 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 33/37 2026-02-17T11:53:06.903 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 34/37 2026-02-17T11:53:06.903 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 35/37 2026-02-17T11:53:06.903 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 36/37 2026-02-17T11:53:06.964 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T11:53:06.964 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:06.964 INFO:teuthology.orchestra.run.trial111.stdout:Upgraded: 2026-02-17T11:53:06.964 INFO:teuthology.orchestra.run.trial111.stdout: librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:53:06.964 INFO:teuthology.orchestra.run.trial111.stdout: librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:53:06.964 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-17T11:53:06.964 INFO:teuthology.orchestra.run.trial111.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-17T11:53:06.964 INFO:teuthology.orchestra.run.trial111.stdout: ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:53:06.964 INFO:teuthology.orchestra.run.trial111.stdout: ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:53:06.964 INFO:teuthology.orchestra.run.trial111.stdout: ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:53:06.964 INFO:teuthology.orchestra.run.trial111.stdout: ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:53:06.964 INFO:teuthology.orchestra.run.trial111.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-17T11:53:06.964 INFO:teuthology.orchestra.run.trial111.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-17T11:53:06.964 INFO:teuthology.orchestra.run.trial111.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-17T11:53:06.964 INFO:teuthology.orchestra.run.trial111.stdout: libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:53:06.965 INFO:teuthology.orchestra.run.trial111.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-17T11:53:06.965 INFO:teuthology.orchestra.run.trial111.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-17T11:53:06.965 INFO:teuthology.orchestra.run.trial111.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-17T11:53:06.965 INFO:teuthology.orchestra.run.trial111.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-17T11:53:06.965 INFO:teuthology.orchestra.run.trial111.stdout: libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:53:06.965 INFO:teuthology.orchestra.run.trial111.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-17T11:53:06.965 INFO:teuthology.orchestra.run.trial111.stdout: librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:53:06.965 INFO:teuthology.orchestra.run.trial111.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-17T11:53:06.965 INFO:teuthology.orchestra.run.trial111.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-17T11:53:06.965 INFO:teuthology.orchestra.run.trial111.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-17T11:53:06.965 INFO:teuthology.orchestra.run.trial111.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-17T11:53:06.965 INFO:teuthology.orchestra.run.trial111.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-17T11:53:06.965 INFO:teuthology.orchestra.run.trial111.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-17T11:53:06.965 INFO:teuthology.orchestra.run.trial111.stdout: python3-ceph-argparse-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:53:06.965 INFO:teuthology.orchestra.run.trial111.stdout: python3-ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:53:06.965 INFO:teuthology.orchestra.run.trial111.stdout: python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:53:06.965 INFO:teuthology.orchestra.run.trial111.stdout: python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:53:06.965 INFO:teuthology.orchestra.run.trial111.stdout: python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:53:06.965 INFO:teuthology.orchestra.run.trial111.stdout: python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:53:06.965 INFO:teuthology.orchestra.run.trial111.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-17T11:53:06.965 INFO:teuthology.orchestra.run.trial111.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-17T11:53:06.965 INFO:teuthology.orchestra.run.trial111.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-17T11:53:06.965 INFO:teuthology.orchestra.run.trial111.stdout: re2-1:20211101-20.el9.x86_64 2026-02-17T11:53:06.965 INFO:teuthology.orchestra.run.trial111.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-17T11:53:06.965 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:06.965 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-17T11:53:07.005 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph-test 2026-02-17T11:53:07.319 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:13 ago on Tue 17 Feb 2026 11:52:54 AM UTC. 2026-02-17T11:53:07.401 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-17T11:53:07.402 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-17T11:53:07.402 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repository Size 2026-02-17T11:53:07.403 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-17T11:53:07.403 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-17T11:53:07.403 INFO:teuthology.orchestra.run.trial111.stdout: ceph-test x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 50 M 2026-02-17T11:53:07.403 INFO:teuthology.orchestra.run.trial111.stdout:Installing dependencies: 2026-02-17T11:53:07.403 INFO:teuthology.orchestra.run.trial111.stdout: libcephsqlite x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 163 k 2026-02-17T11:53:07.404 INFO:teuthology.orchestra.run.trial111.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-17T11:53:07.404 INFO:teuthology.orchestra.run.trial111.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-17T11:53:07.404 INFO:teuthology.orchestra.run.trial111.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-17T11:53:07.404 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:07.404 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-17T11:53:07.404 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-17T11:53:07.404 INFO:teuthology.orchestra.run.trial111.stdout:Install 5 Packages 2026-02-17T11:53:07.405 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:07.405 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 50 M 2026-02-17T11:53:07.405 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 212 M 2026-02-17T11:53:07.405 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-17T11:53:07.561 INFO:teuthology.orchestra.run.trial111.stdout:(1/5): libcephsqlite-19.2.3-675.g3c96dfb3.el9.x 1.8 MB/s | 163 kB 00:00 2026-02-17T11:53:08.391 INFO:teuthology.orchestra.run.trial111.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 254 kB/s | 233 kB 00:00 2026-02-17T11:53:08.485 INFO:teuthology.orchestra.run.trial111.stdout:(3/5): ceph-test-19.2.3-675.g3c96dfb3.el9.x86_6 49 MB/s | 50 MB 00:01 2026-02-17T11:53:08.627 INFO:teuthology.orchestra.run.trial111.stdout:(4/5): socat-1.7.4.1-8.el9.x86_64.rpm 284 kB/s | 303 kB 00:01 2026-02-17T11:53:08.650 INFO:teuthology.orchestra.run.trial111.stdout:(5/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 246 kB/s | 64 kB 00:00 2026-02-17T11:53:08.654 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:53:08.654 INFO:teuthology.orchestra.run.trial111.stdout:Total 40 MB/s | 50 MB 00:01 2026-02-17T11:53:08.682 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-17T11:53:08.692 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-17T11:53:08.692 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-17T11:53:08.877 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-17T11:53:08.877 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-17T11:53:09.090 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-17T11:53:09.096 INFO:teuthology.orchestra.run.trial111.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-17T11:53:09.100 INFO:teuthology.orchestra.run.trial111.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-17T11:53:09.110 INFO:teuthology.orchestra.run.trial111.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-17T11:53:09.111 INFO:teuthology.orchestra.run.trial111.stdout: Installing : libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/5 2026-02-17T11:53:11.362 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/5 2026-02-17T11:53:11.380 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/5 2026-02-17T11:53:11.605 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/5 2026-02-17T11:53:11.605 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/5 2026-02-17T11:53:11.605 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/5 2026-02-17T11:53:11.605 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-17T11:53:11.605 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-17T11:53:11.657 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-17T11:53:11.657 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:11.657 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-17T11:53:11.658 INFO:teuthology.orchestra.run.trial111.stdout: ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:53:11.658 INFO:teuthology.orchestra.run.trial111.stdout: libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:53:11.658 INFO:teuthology.orchestra.run.trial111.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-17T11:53:11.658 INFO:teuthology.orchestra.run.trial111.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-17T11:53:11.658 INFO:teuthology.orchestra.run.trial111.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-17T11:53:11.658 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:11.658 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-17T11:53:11.692 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph 2026-02-17T11:53:11.995 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:17 ago on Tue 17 Feb 2026 11:52:54 AM UTC. 2026-02-17T11:53:12.081 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-17T11:53:12.084 INFO:teuthology.orchestra.run.trial111.stdout:====================================================================================== 2026-02-17T11:53:12.084 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repository Size 2026-02-17T11:53:12.084 INFO:teuthology.orchestra.run.trial111.stdout:====================================================================================== 2026-02-17T11:53:12.084 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-17T11:53:12.084 INFO:teuthology.orchestra.run.trial111.stdout: ceph x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 6.5 k 2026-02-17T11:53:12.084 INFO:teuthology.orchestra.run.trial111.stdout:Installing dependencies: 2026-02-17T11:53:12.084 INFO:teuthology.orchestra.run.trial111.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-17T11:53:12.084 INFO:teuthology.orchestra.run.trial111.stdout: ceph-grafana-dashboards noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 31 k 2026-02-17T11:53:12.085 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mds x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 2.4 M 2026-02-17T11:53:12.085 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mgr x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 1.1 M 2026-02-17T11:53:12.085 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mgr-modules-core noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 253 k 2026-02-17T11:53:12.085 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mon x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 4.7 M 2026-02-17T11:53:12.085 INFO:teuthology.orchestra.run.trial111.stdout: ceph-osd x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 17 M 2026-02-17T11:53:12.085 INFO:teuthology.orchestra.run.trial111.stdout: ceph-prometheus-alerts noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 17 k 2026-02-17T11:53:12.085 INFO:teuthology.orchestra.run.trial111.stdout: cephadm noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 769 k 2026-02-17T11:53:12.085 INFO:teuthology.orchestra.run.trial111.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-17T11:53:12.085 INFO:teuthology.orchestra.run.trial111.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-17T11:53:12.085 INFO:teuthology.orchestra.run.trial111.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-17T11:53:12.085 INFO:teuthology.orchestra.run.trial111.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-17T11:53:12.086 INFO:teuthology.orchestra.run.trial111.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-17T11:53:12.086 INFO:teuthology.orchestra.run.trial111.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-17T11:53:12.086 INFO:teuthology.orchestra.run.trial111.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-17T11:53:12.086 INFO:teuthology.orchestra.run.trial111.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-17T11:53:12.086 INFO:teuthology.orchestra.run.trial111.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-17T11:53:12.086 INFO:teuthology.orchestra.run.trial111.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-17T11:53:12.086 INFO:teuthology.orchestra.run.trial111.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-17T11:53:12.086 INFO:teuthology.orchestra.run.trial111.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-17T11:53:12.086 INFO:teuthology.orchestra.run.trial111.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-17T11:53:12.086 INFO:teuthology.orchestra.run.trial111.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-17T11:53:12.086 INFO:teuthology.orchestra.run.trial111.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-17T11:53:12.086 INFO:teuthology.orchestra.run.trial111.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-17T11:53:12.086 INFO:teuthology.orchestra.run.trial111.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-17T11:53:12.087 INFO:teuthology.orchestra.run.trial111.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-17T11:53:12.087 INFO:teuthology.orchestra.run.trial111.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-17T11:53:12.087 INFO:teuthology.orchestra.run.trial111.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-17T11:53:12.087 INFO:teuthology.orchestra.run.trial111.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-17T11:53:12.087 INFO:teuthology.orchestra.run.trial111.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-17T11:53:12.087 INFO:teuthology.orchestra.run.trial111.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-17T11:53:12.087 INFO:teuthology.orchestra.run.trial111.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-17T11:53:12.087 INFO:teuthology.orchestra.run.trial111.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-17T11:53:12.087 INFO:teuthology.orchestra.run.trial111.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-17T11:53:12.087 INFO:teuthology.orchestra.run.trial111.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-17T11:53:12.087 INFO:teuthology.orchestra.run.trial111.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-17T11:53:12.087 INFO:teuthology.orchestra.run.trial111.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-17T11:53:12.087 INFO:teuthology.orchestra.run.trial111.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-17T11:53:12.088 INFO:teuthology.orchestra.run.trial111.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-17T11:53:12.088 INFO:teuthology.orchestra.run.trial111.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-17T11:53:12.088 INFO:teuthology.orchestra.run.trial111.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-17T11:53:12.088 INFO:teuthology.orchestra.run.trial111.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-17T11:53:12.088 INFO:teuthology.orchestra.run.trial111.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-17T11:53:12.088 INFO:teuthology.orchestra.run.trial111.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-17T11:53:12.088 INFO:teuthology.orchestra.run.trial111.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-17T11:53:12.088 INFO:teuthology.orchestra.run.trial111.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-17T11:53:12.088 INFO:teuthology.orchestra.run.trial111.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-17T11:53:12.088 INFO:teuthology.orchestra.run.trial111.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-17T11:53:12.088 INFO:teuthology.orchestra.run.trial111.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-17T11:53:12.088 INFO:teuthology.orchestra.run.trial111.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-17T11:53:12.088 INFO:teuthology.orchestra.run.trial111.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-17T11:53:12.089 INFO:teuthology.orchestra.run.trial111.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-17T11:53:12.089 INFO:teuthology.orchestra.run.trial111.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-17T11:53:12.089 INFO:teuthology.orchestra.run.trial111.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-17T11:53:12.089 INFO:teuthology.orchestra.run.trial111.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-17T11:53:12.089 INFO:teuthology.orchestra.run.trial111.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-17T11:53:12.089 INFO:teuthology.orchestra.run.trial111.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-17T11:53:12.089 INFO:teuthology.orchestra.run.trial111.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-17T11:53:12.089 INFO:teuthology.orchestra.run.trial111.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-17T11:53:12.089 INFO:teuthology.orchestra.run.trial111.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-17T11:53:12.089 INFO:teuthology.orchestra.run.trial111.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-17T11:53:12.089 INFO:teuthology.orchestra.run.trial111.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-17T11:53:12.089 INFO:teuthology.orchestra.run.trial111.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-17T11:53:12.089 INFO:teuthology.orchestra.run.trial111.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-17T11:53:12.090 INFO:teuthology.orchestra.run.trial111.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-17T11:53:12.090 INFO:teuthology.orchestra.run.trial111.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-17T11:53:12.090 INFO:teuthology.orchestra.run.trial111.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-17T11:53:12.090 INFO:teuthology.orchestra.run.trial111.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-17T11:53:12.090 INFO:teuthology.orchestra.run.trial111.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-17T11:53:12.090 INFO:teuthology.orchestra.run.trial111.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-17T11:53:12.090 INFO:teuthology.orchestra.run.trial111.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-17T11:53:12.090 INFO:teuthology.orchestra.run.trial111.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-17T11:53:12.090 INFO:teuthology.orchestra.run.trial111.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-17T11:53:12.090 INFO:teuthology.orchestra.run.trial111.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-17T11:53:12.090 INFO:teuthology.orchestra.run.trial111.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-17T11:53:12.090 INFO:teuthology.orchestra.run.trial111.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-17T11:53:12.090 INFO:teuthology.orchestra.run.trial111.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-17T11:53:12.091 INFO:teuthology.orchestra.run.trial111.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-17T11:53:12.091 INFO:teuthology.orchestra.run.trial111.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-17T11:53:12.091 INFO:teuthology.orchestra.run.trial111.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-17T11:53:12.091 INFO:teuthology.orchestra.run.trial111.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-17T11:53:12.091 INFO:teuthology.orchestra.run.trial111.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-17T11:53:12.091 INFO:teuthology.orchestra.run.trial111.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-17T11:53:12.091 INFO:teuthology.orchestra.run.trial111.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-17T11:53:12.091 INFO:teuthology.orchestra.run.trial111.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-17T11:53:12.091 INFO:teuthology.orchestra.run.trial111.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-17T11:53:12.091 INFO:teuthology.orchestra.run.trial111.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-17T11:53:12.091 INFO:teuthology.orchestra.run.trial111.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-17T11:53:12.091 INFO:teuthology.orchestra.run.trial111.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-17T11:53:12.091 INFO:teuthology.orchestra.run.trial111.stdout:Installing weak dependencies: 2026-02-17T11:53:12.092 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mgr-cephadm noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 150 k 2026-02-17T11:53:12.092 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mgr-dashboard noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 3.8 M 2026-02-17T11:53:12.092 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 7.4 M 2026-02-17T11:53:12.092 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 22 k 2026-02-17T11:53:12.092 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mgr-rook noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 49 k 2026-02-17T11:53:12.092 INFO:teuthology.orchestra.run.trial111.stdout: ceph-volume noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 299 k 2026-02-17T11:53:12.092 INFO:teuthology.orchestra.run.trial111.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-17T11:53:12.092 INFO:teuthology.orchestra.run.trial111.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-17T11:53:12.092 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:12.092 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-17T11:53:12.092 INFO:teuthology.orchestra.run.trial111.stdout:====================================================================================== 2026-02-17T11:53:12.092 INFO:teuthology.orchestra.run.trial111.stdout:Install 99 Packages 2026-02-17T11:53:12.093 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:12.093 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 95 M 2026-02-17T11:53:12.093 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 520 M 2026-02-17T11:53:12.093 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-17T11:53:12.457 INFO:teuthology.orchestra.run.trial111.stdout:(1/99): ceph-19.2.3-675.g3c96dfb3.el9.x86_64.rp 131 kB/s | 6.5 kB 00:00 2026-02-17T11:53:12.540 INFO:teuthology.orchestra.run.trial111.stdout:(2/99): ceph-mgr-19.2.3-675.g3c96dfb3.el9.x86_6 8.1 MB/s | 1.1 MB 00:00 2026-02-17T11:53:12.568 INFO:teuthology.orchestra.run.trial111.stdout:(3/99): ceph-mds-19.2.3-675.g3c96dfb3.el9.x86_6 15 MB/s | 2.4 MB 00:00 2026-02-17T11:53:12.602 INFO:teuthology.orchestra.run.trial111.stdout:(4/99): ceph-grafana-dashboards-19.2.3-675.g3c9 933 kB/s | 31 kB 00:00 2026-02-17T11:53:12.644 INFO:teuthology.orchestra.run.trial111.stdout:(5/99): ceph-mgr-cephadm-19.2.3-675.g3c96dfb3.e 3.5 MB/s | 150 kB 00:00 2026-02-17T11:53:12.748 INFO:teuthology.orchestra.run.trial111.stdout:(6/99): ceph-mon-19.2.3-675.g3c96dfb3.el9.x86_6 16 MB/s | 4.7 MB 00:00 2026-02-17T11:53:12.838 INFO:teuthology.orchestra.run.trial111.stdout:(7/99): ceph-mgr-dashboard-19.2.3-675.g3c96dfb3 20 MB/s | 3.8 MB 00:00 2026-02-17T11:53:12.890 INFO:teuthology.orchestra.run.trial111.stdout:(8/99): ceph-mgr-k8sevents-19.2.3-675.g3c96dfb3 431 kB/s | 22 kB 00:00 2026-02-17T11:53:12.946 INFO:teuthology.orchestra.run.trial111.stdout:(9/99): ceph-mgr-modules-core-19.2.3-675.g3c96d 4.4 MB/s | 253 kB 00:00 2026-02-17T11:53:13.000 INFO:teuthology.orchestra.run.trial111.stdout:(10/99): ceph-mgr-rook-19.2.3-675.g3c96dfb3.el9 907 kB/s | 49 kB 00:00 2026-02-17T11:53:13.057 INFO:teuthology.orchestra.run.trial111.stdout:(11/99): ceph-prometheus-alerts-19.2.3-675.g3c9 297 kB/s | 17 kB 00:00 2026-02-17T11:53:13.136 INFO:teuthology.orchestra.run.trial111.stdout:(12/99): ceph-osd-19.2.3-675.g3c96dfb3.el9.x86_ 29 MB/s | 17 MB 00:00 2026-02-17T11:53:13.137 INFO:teuthology.orchestra.run.trial111.stdout:(13/99): ceph-volume-19.2.3-675.g3c96dfb3.el9.n 3.6 MB/s | 299 kB 00:00 2026-02-17T11:53:13.146 INFO:teuthology.orchestra.run.trial111.stdout:(14/99): ceph-mgr-diskprediction-local-19.2.3-6 19 MB/s | 7.4 MB 00:00 2026-02-17T11:53:13.151 INFO:teuthology.orchestra.run.trial111.stdout:(15/99): cephadm-19.2.3-675.g3c96dfb3.el9.noarc 51 MB/s | 769 kB 00:00 2026-02-17T11:53:13.209 INFO:teuthology.orchestra.run.trial111.stdout:(16/99): ledmon-libs-1.1.0-3.el9.x86_64.rpm 644 kB/s | 40 kB 00:00 2026-02-17T11:53:13.214 INFO:teuthology.orchestra.run.trial111.stdout:(17/99): libconfig-1.7.2-9.el9.x86_64.rpm 1.1 MB/s | 72 kB 00:00 2026-02-17T11:53:13.252 INFO:teuthology.orchestra.run.trial111.stdout:(18/99): cryptsetup-2.8.1-2.el9.x86_64.rpm 3.0 MB/s | 350 kB 00:00 2026-02-17T11:53:13.259 INFO:teuthology.orchestra.run.trial111.stdout:(19/99): libquadmath-11.5.0-14.el9.x86_64.rpm 4.1 MB/s | 184 kB 00:00 2026-02-17T11:53:13.276 INFO:teuthology.orchestra.run.trial111.stdout:(20/99): python3-cffi-1.14.5-5.el9.x86_64.rpm 10 MB/s | 253 kB 00:00 2026-02-17T11:53:13.295 INFO:teuthology.orchestra.run.trial111.stdout:(21/99): libgfortran-11.5.0-14.el9.x86_64.rpm 9.1 MB/s | 794 kB 00:00 2026-02-17T11:53:13.300 INFO:teuthology.orchestra.run.trial111.stdout:(22/99): python3-ply-3.11-14.el9.noarch.rpm 4.4 MB/s | 106 kB 00:00 2026-02-17T11:53:13.319 INFO:teuthology.orchestra.run.trial111.stdout:(23/99): python3-pycparser-2.20-6.el9.noarch.rp 5.6 MB/s | 135 kB 00:00 2026-02-17T11:53:13.324 INFO:teuthology.orchestra.run.trial111.stdout:(24/99): python3-pyparsing-2.4.7-9.el9.noarch.r 6.2 MB/s | 150 kB 00:00 2026-02-17T11:53:13.343 INFO:teuthology.orchestra.run.trial111.stdout:(25/99): python3-cryptography-36.0.1-5.el9.x86_ 15 MB/s | 1.2 MB 00:00 2026-02-17T11:53:13.343 INFO:teuthology.orchestra.run.trial111.stdout:(26/99): python3-requests-2.25.1-10.el9.noarch. 5.0 MB/s | 126 kB 00:00 2026-02-17T11:53:13.349 INFO:teuthology.orchestra.run.trial111.stdout:(27/99): python3-urllib3-1.26.5-7.el9.noarch.rp 8.3 MB/s | 218 kB 00:00 2026-02-17T11:53:13.367 INFO:teuthology.orchestra.run.trial111.stdout:(28/99): unzip-6.0-59.el9.x86_64.rpm 7.5 MB/s | 182 kB 00:00 2026-02-17T11:53:13.369 INFO:teuthology.orchestra.run.trial111.stdout:(29/99): zip-3.0-35.el9.x86_64.rpm 10 MB/s | 266 kB 00:00 2026-02-17T11:53:13.816 INFO:teuthology.orchestra.run.trial111.stdout:(30/99): flexiblas-3.0.4-9.el9.x86_64.rpm 63 kB/s | 30 kB 00:00 2026-02-17T11:53:13.817 INFO:teuthology.orchestra.run.trial111.stdout:(31/99): flexiblas-openblas-openmp-3.0.4-9.el9. 33 kB/s | 15 kB 00:00 2026-02-17T11:53:14.152 INFO:teuthology.orchestra.run.trial111.stdout:(32/99): lua-5.4.4-4.el9.x86_64.rpm 563 kB/s | 188 kB 00:00 2026-02-17T11:53:14.188 INFO:teuthology.orchestra.run.trial111.stdout:(33/99): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 663 kB/s | 246 kB 00:00 2026-02-17T11:53:14.239 INFO:teuthology.orchestra.run.trial111.stdout:(34/99): openblas-0.3.29-1.el9.x86_64.rpm 483 kB/s | 42 kB 00:00 2026-02-17T11:53:15.480 INFO:teuthology.orchestra.run.trial111.stdout:(35/99): protobuf-3.14.0-17.el9.x86_64.rpm 829 kB/s | 1.0 MB 00:01 2026-02-17T11:53:17.366 INFO:teuthology.orchestra.run.trial111.stdout:(36/99): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 765 kB/s | 3.0 MB 00:03 2026-02-17T11:53:17.696 INFO:teuthology.orchestra.run.trial111.stdout:(37/99): python3-devel-3.9.25-2.el9.x86_64.rpm 742 kB/s | 244 kB 00:00 2026-02-17T11:53:18.025 INFO:teuthology.orchestra.run.trial111.stdout:(38/99): python3-jinja2-2.11.3-8.el9.noarch.rpm 756 kB/s | 249 kB 00:00 2026-02-17T11:53:18.132 INFO:teuthology.orchestra.run.trial111.stdout:(39/99): python3-babel-2.9.1-2.el9.noarch.rpm 2.2 MB/s | 6.0 MB 00:02 2026-02-17T11:53:18.274 INFO:teuthology.orchestra.run.trial111.stdout:(40/99): python3-libstoragemgmt-1.10.1-1.el9.x8 711 kB/s | 177 kB 00:00 2026-02-17T11:53:18.305 INFO:teuthology.orchestra.run.trial111.stdout:(41/99): python3-lxml-4.6.5-3.el9.x86_64.rpm 7.1 MB/s | 1.2 MB 00:00 2026-02-17T11:53:18.393 INFO:teuthology.orchestra.run.trial111.stdout:(42/99): python3-markupsafe-1.1.1-12.el9.x86_64 397 kB/s | 35 kB 00:00 2026-02-17T11:53:18.522 INFO:teuthology.orchestra.run.trial111.stdout:(43/99): python3-mako-1.1.4-6.el9.noarch.rpm 694 kB/s | 172 kB 00:00 2026-02-17T11:53:18.906 INFO:teuthology.orchestra.run.trial111.stdout:(44/99): python3-numpy-1.23.5-2.el9.x86_64.rpm 12 MB/s | 6.1 MB 00:00 2026-02-17T11:53:18.994 INFO:teuthology.orchestra.run.trial111.stdout:(45/99): python3-packaging-20.9-5.el9.noarch.rp 875 kB/s | 77 kB 00:00 2026-02-17T11:53:19.084 INFO:teuthology.orchestra.run.trial111.stdout:(46/99): python3-protobuf-3.14.0-17.el9.noarch. 2.9 MB/s | 267 kB 00:00 2026-02-17T11:53:19.094 INFO:teuthology.orchestra.run.trial111.stdout:(47/99): python3-numpy-f2py-1.23.5-2.el9.x86_64 774 kB/s | 442 kB 00:00 2026-02-17T11:53:19.173 INFO:teuthology.orchestra.run.trial111.stdout:(48/99): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 159 kB 00:00 2026-02-17T11:53:19.260 INFO:teuthology.orchestra.run.trial111.stdout:(49/99): python3-requests-oauthlib-1.3.0-12.el9 612 kB/s | 54 kB 00:00 2026-02-17T11:53:19.423 INFO:teuthology.orchestra.run.trial111.stdout:(50/99): python3-pyasn1-modules-0.4.8-6.el9.noa 847 kB/s | 279 kB 00:00 2026-02-17T11:53:19.509 INFO:teuthology.orchestra.run.trial111.stdout:(51/99): python3-toml-0.10.2-6.el9.noarch.rpm 481 kB/s | 42 kB 00:00 2026-02-17T11:53:19.759 INFO:teuthology.orchestra.run.trial111.stdout:(52/99): xmlsec1-1.2.29-13.el9.x86_64.rpm 756 kB/s | 189 kB 00:00 2026-02-17T11:53:19.926 INFO:teuthology.orchestra.run.trial111.stdout:(53/99): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 541 kB/s | 90 kB 00:00 2026-02-17T11:53:20.172 INFO:teuthology.orchestra.run.trial111.stdout:(54/99): lua-devel-5.4.4-4.el9.x86_64.rpm 91 kB/s | 22 kB 00:00 2026-02-17T11:53:20.473 INFO:teuthology.orchestra.run.trial111.stdout:(55/99): openblas-openmp-0.3.29-1.el9.x86_64.rp 861 kB/s | 5.3 MB 00:06 2026-02-17T11:53:20.654 INFO:teuthology.orchestra.run.trial111.stdout:(56/99): abseil-cpp-20211102.0-4.el9.x86_64.rpm 3.0 MB/s | 551 kB 00:00 2026-02-17T11:53:20.674 INFO:teuthology.orchestra.run.trial111.stdout:(57/99): grpc-data-1.46.7-10.el9.noarch.rpm 978 kB/s | 19 kB 00:00 2026-02-17T11:53:20.694 INFO:teuthology.orchestra.run.trial111.stdout:(58/99): luarocks-3.9.2-5.el9.noarch.rpm 7.3 MB/s | 151 kB 00:00 2026-02-17T11:53:20.734 INFO:teuthology.orchestra.run.trial111.stdout:(59/99): python3-asyncssh-2.13.2-5.el9.noarch.r 13 MB/s | 548 kB 00:00 2026-02-17T11:53:20.754 INFO:teuthology.orchestra.run.trial111.stdout:(60/99): python3-autocommand-2.2.2-8.el9.noarch 1.4 MB/s | 29 kB 00:00 2026-02-17T11:53:20.795 INFO:teuthology.orchestra.run.trial111.stdout:(61/99): python3-scipy-1.9.3-2.el9.x86_64.rpm 13 MB/s | 19 MB 00:01 2026-02-17T11:53:20.795 INFO:teuthology.orchestra.run.trial111.stdout:(62/99): python3-backports-tarfile-1.2.0-1.el9. 1.4 MB/s | 60 kB 00:00 2026-02-17T11:53:20.817 INFO:teuthology.orchestra.run.trial111.stdout:(63/99): python3-cachetools-4.2.4-1.el9.noarch. 1.5 MB/s | 32 kB 00:00 2026-02-17T11:53:20.837 INFO:teuthology.orchestra.run.trial111.stdout:(64/99): python3-certifi-2023.05.07-4.el9.noarc 709 kB/s | 14 kB 00:00 2026-02-17T11:53:20.858 INFO:teuthology.orchestra.run.trial111.stdout:(65/99): python3-cheroot-10.0.1-4.el9.noarch.rp 8.1 MB/s | 173 kB 00:00 2026-02-17T11:53:20.879 INFO:teuthology.orchestra.run.trial111.stdout:(66/99): python3-cherrypy-18.6.1-2.el9.noarch.r 17 MB/s | 358 kB 00:00 2026-02-17T11:53:20.901 INFO:teuthology.orchestra.run.trial111.stdout:(67/99): python3-google-auth-2.45.0-1.el9.noarc 12 MB/s | 254 kB 00:00 2026-02-17T11:53:20.915 INFO:teuthology.orchestra.run.trial111.stdout:(68/99): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 361 kB/s | 43 kB 00:00 2026-02-17T11:53:20.945 INFO:teuthology.orchestra.run.trial111.stdout:(69/99): python3-grpcio-1.46.7-10.el9.x86_64.rp 46 MB/s | 2.0 MB 00:00 2026-02-17T11:53:20.954 INFO:teuthology.orchestra.run.trial111.stdout:(70/99): python3-grpcio-tools-1.46.7-10.el9.x86 3.6 MB/s | 144 kB 00:00 2026-02-17T11:53:20.966 INFO:teuthology.orchestra.run.trial111.stdout:(71/99): python3-influxdb-5.3.1-1.el9.noarch.rp 6.6 MB/s | 139 kB 00:00 2026-02-17T11:53:20.974 INFO:teuthology.orchestra.run.trial111.stdout:(72/99): python3-isodate-0.6.1-3.el9.noarch.rpm 2.8 MB/s | 56 kB 00:00 2026-02-17T11:53:20.986 INFO:teuthology.orchestra.run.trial111.stdout:(73/99): python3-jaraco-8.2.1-3.el9.noarch.rpm 539 kB/s | 11 kB 00:00 2026-02-17T11:53:20.994 INFO:teuthology.orchestra.run.trial111.stdout:(74/99): python3-jaraco-classes-3.2.1-5.el9.noa 901 kB/s | 18 kB 00:00 2026-02-17T11:53:21.006 INFO:teuthology.orchestra.run.trial111.stdout:(75/99): python3-jaraco-collections-3.0.0-8.el9 1.1 MB/s | 23 kB 00:00 2026-02-17T11:53:21.013 INFO:teuthology.orchestra.run.trial111.stdout:(76/99): python3-jaraco-context-6.0.1-3.el9.noa 1.0 MB/s | 20 kB 00:00 2026-02-17T11:53:21.026 INFO:teuthology.orchestra.run.trial111.stdout:(77/99): python3-jaraco-functools-3.5.0-2.el9.n 979 kB/s | 19 kB 00:00 2026-02-17T11:53:21.033 INFO:teuthology.orchestra.run.trial111.stdout:(78/99): python3-jaraco-text-4.0.0-2.el9.noarch 1.3 MB/s | 26 kB 00:00 2026-02-17T11:53:21.050 INFO:teuthology.orchestra.run.trial111.stdout:(79/99): python3-kubernetes-26.1.0-3.el9.noarch 42 MB/s | 1.0 MB 00:00 2026-02-17T11:53:21.053 INFO:teuthology.orchestra.run.trial111.stdout:(80/99): python3-logutils-0.3.5-21.el9.noarch.r 2.3 MB/s | 46 kB 00:00 2026-02-17T11:53:21.070 INFO:teuthology.orchestra.run.trial111.stdout:(81/99): python3-more-itertools-8.12.0-2.el9.no 3.8 MB/s | 79 kB 00:00 2026-02-17T11:53:21.073 INFO:teuthology.orchestra.run.trial111.stdout:(82/99): python3-msgpack-1.0.3-2.el9.x86_64.rpm 4.2 MB/s | 86 kB 00:00 2026-02-17T11:53:21.091 INFO:teuthology.orchestra.run.trial111.stdout:(83/99): python3-natsort-7.1.1-5.el9.noarch.rpm 2.8 MB/s | 58 kB 00:00 2026-02-17T11:53:21.111 INFO:teuthology.orchestra.run.trial111.stdout:(84/99): python3-portend-3.1.0-2.el9.noarch.rpm 829 kB/s | 16 kB 00:00 2026-02-17T11:53:21.112 INFO:teuthology.orchestra.run.trial111.stdout:(85/99): python3-pecan-1.4.2-3.el9.noarch.rpm 6.8 MB/s | 272 kB 00:00 2026-02-17T11:53:21.131 INFO:teuthology.orchestra.run.trial111.stdout:(86/99): python3-pyOpenSSL-21.0.0-1.el9.noarch. 4.3 MB/s | 90 kB 00:00 2026-02-17T11:53:21.132 INFO:teuthology.orchestra.run.trial111.stdout:(87/99): python3-repoze-lru-0.7-16.el9.noarch.r 1.5 MB/s | 31 kB 00:00 2026-02-17T11:53:21.152 INFO:teuthology.orchestra.run.trial111.stdout:(88/99): python3-routes-2.5.1-5.el9.noarch.rpm 8.9 MB/s | 188 kB 00:00 2026-02-17T11:53:21.152 INFO:teuthology.orchestra.run.trial111.stdout:(89/99): python3-rsa-4.9-2.el9.noarch.rpm 2.9 MB/s | 59 kB 00:00 2026-02-17T11:53:21.172 INFO:teuthology.orchestra.run.trial111.stdout:(90/99): python3-tempora-5.0.0-2.el9.noarch.rpm 1.8 MB/s | 36 kB 00:00 2026-02-17T11:53:21.173 INFO:teuthology.orchestra.run.trial111.stdout:(91/99): python3-saml-1.16.0-1.el9.noarch.rpm 5.9 MB/s | 125 kB 00:00 2026-02-17T11:53:21.192 INFO:teuthology.orchestra.run.trial111.stdout:(92/99): python3-typing-extensions-4.15.0-1.el9 4.2 MB/s | 86 kB 00:00 2026-02-17T11:53:21.193 INFO:teuthology.orchestra.run.trial111.stdout:(93/99): python3-webob-1.8.8-2.el9.noarch.rpm 11 MB/s | 230 kB 00:00 2026-02-17T11:53:21.212 INFO:teuthology.orchestra.run.trial111.stdout:(94/99): python3-websocket-client-1.2.3-2.el9.n 4.4 MB/s | 90 kB 00:00 2026-02-17T11:53:21.215 INFO:teuthology.orchestra.run.trial111.stdout:(95/99): python3-werkzeug-2.0.3-3.el9.1.noarch. 19 MB/s | 427 kB 00:00 2026-02-17T11:53:21.232 INFO:teuthology.orchestra.run.trial111.stdout:(96/99): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 2.4 MB/s | 48 kB 00:00 2026-02-17T11:53:21.235 INFO:teuthology.orchestra.run.trial111.stdout:(97/99): python3-xmltodict-0.12.0-15.el9.noarch 1.1 MB/s | 22 kB 00:00 2026-02-17T11:53:21.253 INFO:teuthology.orchestra.run.trial111.stdout:(98/99): python3-zc-lockfile-2.0-10.el9.noarch. 987 kB/s | 20 kB 00:00 2026-02-17T11:53:21.308 INFO:teuthology.orchestra.run.trial111.stdout:(99/99): protobuf-compiler-3.14.0-17.el9.x86_64 759 kB/s | 862 kB 00:01 2026-02-17T11:53:21.313 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:53:21.313 INFO:teuthology.orchestra.run.trial111.stdout:Total 10 MB/s | 95 MB 00:09 2026-02-17T11:53:21.747 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-17T11:53:21.786 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-17T11:53:21.786 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-17T11:53:22.202 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-17T11:53:22.203 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-17T11:53:22.647 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-17T11:53:22.649 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/99 2026-02-17T11:53:22.680 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/99 2026-02-17T11:53:22.687 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/99 2026-02-17T11:53:22.708 INFO:teuthology.orchestra.run.trial111.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/99 2026-02-17T11:53:22.714 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/99 2026-02-17T11:53:22.747 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 6/99 2026-02-17T11:53:22.756 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 7/99 2026-02-17T11:53:22.761 INFO:teuthology.orchestra.run.trial111.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 8/99 2026-02-17T11:53:22.764 INFO:teuthology.orchestra.run.trial111.stdout: Installing : lua-5.4.4-4.el9.x86_64 9/99 2026-02-17T11:53:22.768 INFO:teuthology.orchestra.run.trial111.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 10/99 2026-02-17T11:53:22.791 INFO:teuthology.orchestra.run.trial111.stdout: Installing : unzip-6.0-59.el9.x86_64 11/99 2026-02-17T11:53:22.804 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 12/99 2026-02-17T11:53:22.807 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 13/99 2026-02-17T11:53:22.813 INFO:teuthology.orchestra.run.trial111.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 14/99 2026-02-17T11:53:22.815 INFO:teuthology.orchestra.run.trial111.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 15/99 2026-02-17T11:53:22.826 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 16/99 2026-02-17T11:53:22.832 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 17/99 2026-02-17T11:53:22.856 INFO:teuthology.orchestra.run.trial111.stdout: Installing : zip-3.0-35.el9.x86_64 18/99 2026-02-17T11:53:22.859 INFO:teuthology.orchestra.run.trial111.stdout: Installing : luarocks-3.9.2-5.el9.noarch 19/99 2026-02-17T11:53:22.866 INFO:teuthology.orchestra.run.trial111.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 20/99 2026-02-17T11:53:22.891 INFO:teuthology.orchestra.run.trial111.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 21/99 2026-02-17T11:53:22.942 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 22/99 2026-02-17T11:53:22.955 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 23/99 2026-02-17T11:53:22.957 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-rsa-4.9-2.el9.noarch 24/99 2026-02-17T11:53:22.962 INFO:teuthology.orchestra.run.trial111.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 25/99 2026-02-17T11:53:22.967 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 26/99 2026-02-17T11:53:22.972 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 27/99 2026-02-17T11:53:22.975 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 28/99 2026-02-17T11:53:22.990 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 29/99 2026-02-17T11:53:23.011 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 30/99 2026-02-17T11:53:23.015 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 31/99 2026-02-17T11:53:23.020 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 32/99 2026-02-17T11:53:23.032 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 33/99 2026-02-17T11:53:23.041 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 34/99 2026-02-17T11:53:23.049 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 35/99 2026-02-17T11:53:23.069 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 36/99 2026-02-17T11:53:23.077 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 37/99 2026-02-17T11:53:23.132 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 38/99 2026-02-17T11:53:23.144 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 39/99 2026-02-17T11:53:23.160 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 40/99 2026-02-17T11:53:23.164 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 41/99 2026-02-17T11:53:23.172 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 42/99 2026-02-17T11:53:23.212 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 43/99 2026-02-17T11:53:23.537 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 44/99 2026-02-17T11:53:23.547 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 45/99 2026-02-17T11:53:23.551 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 46/99 2026-02-17T11:53:23.557 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 47/99 2026-02-17T11:53:23.559 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 48/99 2026-02-17T11:53:23.587 INFO:teuthology.orchestra.run.trial111.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 49/99 2026-02-17T11:53:23.630 INFO:teuthology.orchestra.run.trial111.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 50/99 2026-02-17T11:53:23.637 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 51/99 2026-02-17T11:53:23.640 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 52/99 2026-02-17T11:53:23.646 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 53/99 2026-02-17T11:53:23.650 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 54/99 2026-02-17T11:53:23.657 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 55/99 2026-02-17T11:53:23.660 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 56/99 2026-02-17T11:53:23.688 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 57/99 2026-02-17T11:53:23.698 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 58/99 2026-02-17T11:53:23.733 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 59/99 2026-02-17T11:53:23.957 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 60/99 2026-02-17T11:53:23.981 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 61/99 2026-02-17T11:53:23.985 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 62/99 2026-02-17T11:53:24.044 INFO:teuthology.orchestra.run.trial111.stdout: Installing : openblas-0.3.29-1.el9.x86_64 63/99 2026-02-17T11:53:24.046 INFO:teuthology.orchestra.run.trial111.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 64/99 2026-02-17T11:53:24.067 INFO:teuthology.orchestra.run.trial111.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 65/99 2026-02-17T11:53:24.394 INFO:teuthology.orchestra.run.trial111.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 66/99 2026-02-17T11:53:24.468 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 67/99 2026-02-17T11:53:25.141 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 68/99 2026-02-17T11:53:25.158 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 69/99 2026-02-17T11:53:25.168 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 70/99 2026-02-17T11:53:25.175 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-packaging-20.9-5.el9.noarch 71/99 2026-02-17T11:53:25.188 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-ply-3.11-14.el9.noarch 72/99 2026-02-17T11:53:25.204 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 73/99 2026-02-17T11:53:25.279 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 74/99 2026-02-17T11:53:25.288 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 75/99 2026-02-17T11:53:25.311 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 76/99 2026-02-17T11:53:25.341 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 77/99 2026-02-17T11:53:25.392 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/99 2026-02-17T11:53:25.398 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 79/99 2026-02-17T11:53:25.402 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 80/99 2026-02-17T11:53:25.403 INFO:teuthology.orchestra.run.trial111.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 81/99 2026-02-17T11:53:25.421 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T11:53:25.421 INFO:teuthology.orchestra.run.trial111.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-17T11:53:25.421 INFO:teuthology.orchestra.run.trial111.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-17T11:53:25.421 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:25.429 INFO:teuthology.orchestra.run.trial111.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T11:53:25.453 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T11:53:25.453 INFO:teuthology.orchestra.run.trial111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-17T11:53:25.453 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:25.487 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 83/99 2026-02-17T11:53:25.551 INFO:teuthology.orchestra.run.trial111.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 84/99 2026-02-17T11:53:25.553 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 85/99 2026-02-17T11:53:25.566 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 85/99 2026-02-17T11:53:25.566 INFO:teuthology.orchestra.run.trial111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:53:25.566 INFO:teuthology.orchestra.run.trial111.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-17T11:53:25.566 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:26.264 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 86/99 2026-02-17T11:53:26.288 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 86/99 2026-02-17T11:53:26.288 INFO:teuthology.orchestra.run.trial111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:53:26.288 INFO:teuthology.orchestra.run.trial111.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-17T11:53:26.288 INFO:teuthology.orchestra.run.trial111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T11:53:26.288 INFO:teuthology.orchestra.run.trial111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T11:53:26.288 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:26.343 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 87/99 2026-02-17T11:53:26.344 INFO:teuthology.orchestra.run.trial111.stdout: Installing : cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 87/99 2026-02-17T11:53:26.349 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-675.g3c96dfb3.el9. 88/99 2026-02-17T11:53:26.369 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-675.g3c96dfb3.el9 89/99 2026-02-17T11:53:26.371 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 90/99 2026-02-17T11:53:26.865 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 90/99 2026-02-17T11:53:26.868 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noar 91/99 2026-02-17T11:53:27.320 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noar 91/99 2026-02-17T11:53:27.321 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96df 92/99 2026-02-17T11:53:27.334 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96df 92/99 2026-02-17T11:53:27.335 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noar 93/99 2026-02-17T11:53:27.390 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noar 93/99 2026-02-17T11:53:27.439 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-675.g3c96dfb3.el9.n 94/99 2026-02-17T11:53:27.440 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 95/99 2026-02-17T11:53:27.462 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 95/99 2026-02-17T11:53:27.462 INFO:teuthology.orchestra.run.trial111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:53:27.462 INFO:teuthology.orchestra.run.trial111.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-17T11:53:27.462 INFO:teuthology.orchestra.run.trial111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T11:53:27.462 INFO:teuthology.orchestra.run.trial111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T11:53:27.462 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:27.474 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 96/99 2026-02-17T11:53:27.689 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 96/99 2026-02-17T11:53:27.690 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 97/99 2026-02-17T11:53:27.711 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 97/99 2026-02-17T11:53:27.711 INFO:teuthology.orchestra.run.trial111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:53:27.711 INFO:teuthology.orchestra.run.trial111.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-17T11:53:27.711 INFO:teuthology.orchestra.run.trial111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T11:53:27.711 INFO:teuthology.orchestra.run.trial111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T11:53:27.712 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:27.811 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 98/99 2026-02-17T11:53:27.833 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 98/99 2026-02-17T11:53:27.834 INFO:teuthology.orchestra.run.trial111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:53:27.834 INFO:teuthology.orchestra.run.trial111.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-17T11:53:27.834 INFO:teuthology.orchestra.run.trial111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T11:53:27.834 INFO:teuthology.orchestra.run.trial111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T11:53:27.834 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:27.852 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 99/99 2026-02-17T11:53:28.531 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 99/99 2026-02-17T11:53:28.531 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/99 2026-02-17T11:53:28.531 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/99 2026-02-17T11:53:28.531 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 3/99 2026-02-17T11:53:28.531 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/99 2026-02-17T11:53:28.531 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/99 2026-02-17T11:53:28.531 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-675.g3c96dfb3.el9 6/99 2026-02-17T11:53:28.531 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 7/99 2026-02-17T11:53:28.531 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noar 8/99 2026-02-17T11:53:28.532 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96df 9/99 2026-02-17T11:53:28.532 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noar 10/99 2026-02-17T11:53:28.532 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-675.g3c96dfb3.el9.n 11/99 2026-02-17T11:53:28.532 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 12/99 2026-02-17T11:53:28.532 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-675.g3c96dfb3.el9. 13/99 2026-02-17T11:53:28.532 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 14/99 2026-02-17T11:53:28.532 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 15/99 2026-02-17T11:53:28.532 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/99 2026-02-17T11:53:28.532 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/99 2026-02-17T11:53:28.532 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/99 2026-02-17T11:53:28.532 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/99 2026-02-17T11:53:28.532 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/99 2026-02-17T11:53:28.533 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/99 2026-02-17T11:53:28.533 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/99 2026-02-17T11:53:28.533 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/99 2026-02-17T11:53:28.533 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/99 2026-02-17T11:53:28.533 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/99 2026-02-17T11:53:28.533 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/99 2026-02-17T11:53:28.533 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/99 2026-02-17T11:53:28.533 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/99 2026-02-17T11:53:28.533 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : zip-3.0-35.el9.x86_64 29/99 2026-02-17T11:53:28.533 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/99 2026-02-17T11:53:28.533 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/99 2026-02-17T11:53:28.533 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/99 2026-02-17T11:53:28.534 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/99 2026-02-17T11:53:28.534 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/99 2026-02-17T11:53:28.534 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/99 2026-02-17T11:53:28.534 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/99 2026-02-17T11:53:28.534 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/99 2026-02-17T11:53:28.534 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/99 2026-02-17T11:53:28.534 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 39/99 2026-02-17T11:53:28.534 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/99 2026-02-17T11:53:28.534 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 41/99 2026-02-17T11:53:28.534 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 42/99 2026-02-17T11:53:28.534 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 43/99 2026-02-17T11:53:28.534 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/99 2026-02-17T11:53:28.535 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/99 2026-02-17T11:53:28.535 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/99 2026-02-17T11:53:28.535 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/99 2026-02-17T11:53:28.535 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/99 2026-02-17T11:53:28.535 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/99 2026-02-17T11:53:28.535 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/99 2026-02-17T11:53:28.535 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/99 2026-02-17T11:53:28.535 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/99 2026-02-17T11:53:28.535 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/99 2026-02-17T11:53:28.535 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/99 2026-02-17T11:53:28.535 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/99 2026-02-17T11:53:28.535 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/99 2026-02-17T11:53:28.535 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/99 2026-02-17T11:53:28.536 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/99 2026-02-17T11:53:28.536 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/99 2026-02-17T11:53:28.536 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/99 2026-02-17T11:53:28.536 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/99 2026-02-17T11:53:28.536 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/99 2026-02-17T11:53:28.536 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/99 2026-02-17T11:53:28.536 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/99 2026-02-17T11:53:28.536 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/99 2026-02-17T11:53:28.536 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/99 2026-02-17T11:53:28.536 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/99 2026-02-17T11:53:28.536 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/99 2026-02-17T11:53:28.536 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/99 2026-02-17T11:53:28.536 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/99 2026-02-17T11:53:28.537 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/99 2026-02-17T11:53:28.537 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/99 2026-02-17T11:53:28.537 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/99 2026-02-17T11:53:28.537 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/99 2026-02-17T11:53:28.537 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/99 2026-02-17T11:53:28.537 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/99 2026-02-17T11:53:28.537 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/99 2026-02-17T11:53:28.537 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/99 2026-02-17T11:53:28.537 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/99 2026-02-17T11:53:28.537 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/99 2026-02-17T11:53:28.537 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 81/99 2026-02-17T11:53:28.537 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/99 2026-02-17T11:53:28.537 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/99 2026-02-17T11:53:28.538 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/99 2026-02-17T11:53:28.538 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 85/99 2026-02-17T11:53:28.538 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 86/99 2026-02-17T11:53:28.538 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/99 2026-02-17T11:53:28.538 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 88/99 2026-02-17T11:53:28.538 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 89/99 2026-02-17T11:53:28.538 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 90/99 2026-02-17T11:53:28.538 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 91/99 2026-02-17T11:53:28.538 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 92/99 2026-02-17T11:53:28.538 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 93/99 2026-02-17T11:53:28.538 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 94/99 2026-02-17T11:53:28.538 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 95/99 2026-02-17T11:53:28.538 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 96/99 2026-02-17T11:53:28.539 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 97/99 2026-02-17T11:53:28.539 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 98/99 2026-02-17T11:53:28.594 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 99/99 2026-02-17T11:53:28.594 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:28.594 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-17T11:53:28.594 INFO:teuthology.orchestra.run.trial111.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-17T11:53:28.594 INFO:teuthology.orchestra.run.trial111.stdout: ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:53:28.594 INFO:teuthology.orchestra.run.trial111.stdout: ceph-grafana-dashboards-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:53:28.594 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:53:28.594 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:53:28.594 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:53:28.594 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:53:28.595 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:53:28.595 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:53:28.595 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mgr-modules-core-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:53:28.595 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:53:28.595 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:53:28.595 INFO:teuthology.orchestra.run.trial111.stdout: ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:53:28.595 INFO:teuthology.orchestra.run.trial111.stdout: ceph-prometheus-alerts-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:53:28.595 INFO:teuthology.orchestra.run.trial111.stdout: ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:53:28.595 INFO:teuthology.orchestra.run.trial111.stdout: cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:53:28.595 INFO:teuthology.orchestra.run.trial111.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-17T11:53:28.595 INFO:teuthology.orchestra.run.trial111.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-17T11:53:28.595 INFO:teuthology.orchestra.run.trial111.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-17T11:53:28.596 INFO:teuthology.orchestra.run.trial111.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-17T11:53:28.596 INFO:teuthology.orchestra.run.trial111.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-17T11:53:28.596 INFO:teuthology.orchestra.run.trial111.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-17T11:53:28.596 INFO:teuthology.orchestra.run.trial111.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-17T11:53:28.596 INFO:teuthology.orchestra.run.trial111.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-17T11:53:28.596 INFO:teuthology.orchestra.run.trial111.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-17T11:53:28.596 INFO:teuthology.orchestra.run.trial111.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T11:53:28.596 INFO:teuthology.orchestra.run.trial111.stdout: lua-5.4.4-4.el9.x86_64 2026-02-17T11:53:28.596 INFO:teuthology.orchestra.run.trial111.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-17T11:53:28.596 INFO:teuthology.orchestra.run.trial111.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-17T11:53:28.596 INFO:teuthology.orchestra.run.trial111.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-17T11:53:28.596 INFO:teuthology.orchestra.run.trial111.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-17T11:53:28.597 INFO:teuthology.orchestra.run.trial111.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-17T11:53:28.597 INFO:teuthology.orchestra.run.trial111.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-17T11:53:28.597 INFO:teuthology.orchestra.run.trial111.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-17T11:53:28.597 INFO:teuthology.orchestra.run.trial111.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-17T11:53:28.597 INFO:teuthology.orchestra.run.trial111.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-17T11:53:28.597 INFO:teuthology.orchestra.run.trial111.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-17T11:53:28.597 INFO:teuthology.orchestra.run.trial111.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-17T11:53:28.597 INFO:teuthology.orchestra.run.trial111.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-17T11:53:28.597 INFO:teuthology.orchestra.run.trial111.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-17T11:53:28.597 INFO:teuthology.orchestra.run.trial111.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-17T11:53:28.597 INFO:teuthology.orchestra.run.trial111.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-17T11:53:28.597 INFO:teuthology.orchestra.run.trial111.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-17T11:53:28.598 INFO:teuthology.orchestra.run.trial111.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-17T11:53:28.598 INFO:teuthology.orchestra.run.trial111.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-17T11:53:28.598 INFO:teuthology.orchestra.run.trial111.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-17T11:53:28.598 INFO:teuthology.orchestra.run.trial111.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-17T11:53:28.598 INFO:teuthology.orchestra.run.trial111.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-17T11:53:28.598 INFO:teuthology.orchestra.run.trial111.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-17T11:53:28.598 INFO:teuthology.orchestra.run.trial111.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-17T11:53:28.598 INFO:teuthology.orchestra.run.trial111.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-17T11:53:28.598 INFO:teuthology.orchestra.run.trial111.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-17T11:53:28.598 INFO:teuthology.orchestra.run.trial111.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-17T11:53:28.598 INFO:teuthology.orchestra.run.trial111.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-17T11:53:28.598 INFO:teuthology.orchestra.run.trial111.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-17T11:53:28.598 INFO:teuthology.orchestra.run.trial111.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-17T11:53:28.599 INFO:teuthology.orchestra.run.trial111.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-17T11:53:28.599 INFO:teuthology.orchestra.run.trial111.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-17T11:53:28.599 INFO:teuthology.orchestra.run.trial111.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T11:53:28.599 INFO:teuthology.orchestra.run.trial111.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-17T11:53:28.599 INFO:teuthology.orchestra.run.trial111.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-17T11:53:28.599 INFO:teuthology.orchestra.run.trial111.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-17T11:53:28.599 INFO:teuthology.orchestra.run.trial111.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-17T11:53:28.599 INFO:teuthology.orchestra.run.trial111.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-17T11:53:28.599 INFO:teuthology.orchestra.run.trial111.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-17T11:53:28.599 INFO:teuthology.orchestra.run.trial111.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-17T11:53:28.599 INFO:teuthology.orchestra.run.trial111.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-17T11:53:28.599 INFO:teuthology.orchestra.run.trial111.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-17T11:53:28.599 INFO:teuthology.orchestra.run.trial111.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-17T11:53:28.600 INFO:teuthology.orchestra.run.trial111.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-17T11:53:28.600 INFO:teuthology.orchestra.run.trial111.stdout: python3-ply-3.11-14.el9.noarch 2026-02-17T11:53:28.600 INFO:teuthology.orchestra.run.trial111.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-17T11:53:28.600 INFO:teuthology.orchestra.run.trial111.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-17T11:53:28.600 INFO:teuthology.orchestra.run.trial111.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-17T11:53:28.600 INFO:teuthology.orchestra.run.trial111.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-17T11:53:28.600 INFO:teuthology.orchestra.run.trial111.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-17T11:53:28.600 INFO:teuthology.orchestra.run.trial111.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-17T11:53:28.600 INFO:teuthology.orchestra.run.trial111.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-17T11:53:28.600 INFO:teuthology.orchestra.run.trial111.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-17T11:53:28.600 INFO:teuthology.orchestra.run.trial111.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-17T11:53:28.600 INFO:teuthology.orchestra.run.trial111.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-17T11:53:28.600 INFO:teuthology.orchestra.run.trial111.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-17T11:53:28.601 INFO:teuthology.orchestra.run.trial111.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-17T11:53:28.601 INFO:teuthology.orchestra.run.trial111.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-17T11:53:28.601 INFO:teuthology.orchestra.run.trial111.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-17T11:53:28.601 INFO:teuthology.orchestra.run.trial111.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-17T11:53:28.601 INFO:teuthology.orchestra.run.trial111.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-17T11:53:28.601 INFO:teuthology.orchestra.run.trial111.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-17T11:53:28.601 INFO:teuthology.orchestra.run.trial111.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-17T11:53:28.601 INFO:teuthology.orchestra.run.trial111.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-17T11:53:28.601 INFO:teuthology.orchestra.run.trial111.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-17T11:53:28.601 INFO:teuthology.orchestra.run.trial111.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-17T11:53:28.601 INFO:teuthology.orchestra.run.trial111.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-17T11:53:28.601 INFO:teuthology.orchestra.run.trial111.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-17T11:53:28.601 INFO:teuthology.orchestra.run.trial111.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-17T11:53:28.602 INFO:teuthology.orchestra.run.trial111.stdout: unzip-6.0-59.el9.x86_64 2026-02-17T11:53:28.602 INFO:teuthology.orchestra.run.trial111.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-17T11:53:28.602 INFO:teuthology.orchestra.run.trial111.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-17T11:53:28.602 INFO:teuthology.orchestra.run.trial111.stdout: zip-3.0-35.el9.x86_64 2026-02-17T11:53:28.602 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:28.602 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-17T11:53:28.650 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph-base 2026-02-17T11:53:28.966 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 11:52:54 AM UTC. 2026-02-17T11:53:29.029 INFO:teuthology.orchestra.run.trial111.stdout:Package ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:53:29.047 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-17T11:53:29.047 INFO:teuthology.orchestra.run.trial111.stdout:Nothing to do. 2026-02-17T11:53:29.047 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-17T11:53:29.068 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install cephadm 2026-02-17T11:53:29.375 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 11:52:54 AM UTC. 2026-02-17T11:53:29.438 INFO:teuthology.orchestra.run.trial111.stdout:Package cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:53:29.455 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-17T11:53:29.456 INFO:teuthology.orchestra.run.trial111.stdout:Nothing to do. 2026-02-17T11:53:29.456 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-17T11:53:29.476 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph-immutable-object-cache 2026-02-17T11:53:29.786 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 11:52:54 AM UTC. 2026-02-17T11:53:29.870 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-17T11:53:29.870 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-17T11:53:29.870 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repo Size 2026-02-17T11:53:29.870 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-17T11:53:29.870 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-17T11:53:29.870 INFO:teuthology.orchestra.run.trial111.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 145 k 2026-02-17T11:53:29.870 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:29.870 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-17T11:53:29.871 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-17T11:53:29.871 INFO:teuthology.orchestra.run.trial111.stdout:Install 1 Package 2026-02-17T11:53:29.871 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:29.871 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 145 k 2026-02-17T11:53:29.871 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 431 k 2026-02-17T11:53:29.871 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-17T11:53:29.961 INFO:teuthology.orchestra.run.trial111.stdout:ceph-immutable-object-cache-19.2.3-675.g3c96dfb 1.6 MB/s | 145 kB 00:00 2026-02-17T11:53:29.961 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:53:29.962 INFO:teuthology.orchestra.run.trial111.stdout:Total 1.5 MB/s | 145 kB 00:00 2026-02-17T11:53:29.962 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-17T11:53:29.965 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-17T11:53:29.965 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-17T11:53:29.996 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-17T11:53:29.996 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-17T11:53:30.052 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-17T11:53:30.053 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.e 1/1 2026-02-17T11:53:30.076 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.e 1/1 2026-02-17T11:53:30.076 INFO:teuthology.orchestra.run.trial111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:53:30.076 INFO:teuthology.orchestra.run.trial111.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-17T11:53:30.076 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:30.393 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.e 1/1 2026-02-17T11:53:30.393 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:30.393 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-17T11:53:30.393 INFO:teuthology.orchestra.run.trial111.stdout: ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:53:30.393 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:30.393 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-17T11:53:30.420 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph-mgr 2026-02-17T11:53:30.726 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 11:52:54 AM UTC. 2026-02-17T11:53:30.790 INFO:teuthology.orchestra.run.trial111.stdout:Package ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:53:30.808 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-17T11:53:30.808 INFO:teuthology.orchestra.run.trial111.stdout:Nothing to do. 2026-02-17T11:53:30.809 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-17T11:53:30.830 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph-mgr-dashboard 2026-02-17T11:53:31.136 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 11:52:54 AM UTC. 2026-02-17T11:53:31.201 INFO:teuthology.orchestra.run.trial111.stdout:Package ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:53:31.218 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-17T11:53:31.218 INFO:teuthology.orchestra.run.trial111.stdout:Nothing to do. 2026-02-17T11:53:31.218 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-17T11:53:31.240 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-17T11:53:31.550 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 11:52:54 AM UTC. 2026-02-17T11:53:31.615 INFO:teuthology.orchestra.run.trial111.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:53:31.632 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-17T11:53:31.633 INFO:teuthology.orchestra.run.trial111.stdout:Nothing to do. 2026-02-17T11:53:31.633 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-17T11:53:31.654 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph-mgr-rook 2026-02-17T11:53:31.963 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 11:52:54 AM UTC. 2026-02-17T11:53:32.026 INFO:teuthology.orchestra.run.trial111.stdout:Package ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:53:32.043 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-17T11:53:32.044 INFO:teuthology.orchestra.run.trial111.stdout:Nothing to do. 2026-02-17T11:53:32.044 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-17T11:53:32.065 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph-mgr-cephadm 2026-02-17T11:53:32.375 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 11:52:54 AM UTC. 2026-02-17T11:53:32.440 INFO:teuthology.orchestra.run.trial111.stdout:Package ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:53:32.458 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-17T11:53:32.458 INFO:teuthology.orchestra.run.trial111.stdout:Nothing to do. 2026-02-17T11:53:32.459 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-17T11:53:32.481 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph-fuse 2026-02-17T11:53:32.792 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 11:52:54 AM UTC. 2026-02-17T11:53:32.875 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-17T11:53:32.875 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-17T11:53:32.875 INFO:teuthology.orchestra.run.trial111.stdout: Package Architecture Version Repository Size 2026-02-17T11:53:32.876 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-17T11:53:32.876 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-17T11:53:32.876 INFO:teuthology.orchestra.run.trial111.stdout: ceph-fuse x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 1.2 M 2026-02-17T11:53:32.876 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:32.876 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-17T11:53:32.876 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-17T11:53:32.876 INFO:teuthology.orchestra.run.trial111.stdout:Install 1 Package 2026-02-17T11:53:32.876 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:32.876 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 1.2 M 2026-02-17T11:53:32.876 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 3.6 M 2026-02-17T11:53:32.877 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-17T11:53:32.993 INFO:teuthology.orchestra.run.trial111.stdout:ceph-fuse-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 9.8 MB/s | 1.2 MB 00:00 2026-02-17T11:53:32.994 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:53:32.994 INFO:teuthology.orchestra.run.trial111.stdout:Total 9.7 MB/s | 1.2 MB 00:00 2026-02-17T11:53:32.994 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-17T11:53:32.997 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-17T11:53:32.998 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-17T11:53:33.031 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-17T11:53:33.031 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-17T11:53:33.133 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-17T11:53:33.150 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:53:33.394 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:53:33.452 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:53:33.452 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:33.452 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-17T11:53:33.452 INFO:teuthology.orchestra.run.trial111.stdout: ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:53:33.452 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:33.452 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-17T11:53:33.481 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph-volume 2026-02-17T11:53:33.795 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 11:52:54 AM UTC. 2026-02-17T11:53:33.859 INFO:teuthology.orchestra.run.trial111.stdout:Package ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:53:33.877 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-17T11:53:33.878 INFO:teuthology.orchestra.run.trial111.stdout:Nothing to do. 2026-02-17T11:53:33.878 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-17T11:53:33.898 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install librados-devel 2026-02-17T11:53:34.213 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Feb 2026 11:52:54 AM UTC. 2026-02-17T11:53:34.295 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-17T11:53:34.295 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-17T11:53:34.296 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repo Size 2026-02-17T11:53:34.296 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-17T11:53:34.296 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-17T11:53:34.296 INFO:teuthology.orchestra.run.trial111.stdout: librados-devel x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 127 k 2026-02-17T11:53:34.296 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:34.296 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-17T11:53:34.296 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-17T11:53:34.296 INFO:teuthology.orchestra.run.trial111.stdout:Install 1 Package 2026-02-17T11:53:34.296 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:34.296 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 127 k 2026-02-17T11:53:34.297 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 456 k 2026-02-17T11:53:34.297 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-17T11:53:34.381 INFO:teuthology.orchestra.run.trial111.stdout:librados-devel-19.2.3-675.g3c96dfb3.el9.x86_64. 1.5 MB/s | 127 kB 00:00 2026-02-17T11:53:34.381 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:53:34.382 INFO:teuthology.orchestra.run.trial111.stdout:Total 1.4 MB/s | 127 kB 00:00 2026-02-17T11:53:34.382 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-17T11:53:34.384 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-17T11:53:34.384 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-17T11:53:34.415 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-17T11:53:34.415 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-17T11:53:34.469 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-17T11:53:34.486 INFO:teuthology.orchestra.run.trial111.stdout: Installing : librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:53:34.567 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:53:34.625 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:53:34.626 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:34.626 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-17T11:53:34.626 INFO:teuthology.orchestra.run.trial111.stdout: librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:53:34.626 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:34.626 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-17T11:53:34.654 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install libcephfs2 2026-02-17T11:53:34.972 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Feb 2026 11:52:54 AM UTC. 2026-02-17T11:53:35.037 INFO:teuthology.orchestra.run.trial111.stdout:Package libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:53:35.055 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-17T11:53:35.056 INFO:teuthology.orchestra.run.trial111.stdout:Nothing to do. 2026-02-17T11:53:35.056 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-17T11:53:35.078 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install libcephfs-devel 2026-02-17T11:53:35.388 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Feb 2026 11:52:54 AM UTC. 2026-02-17T11:53:35.470 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-17T11:53:35.470 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-17T11:53:35.470 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repo Size 2026-02-17T11:53:35.470 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-17T11:53:35.470 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-17T11:53:35.470 INFO:teuthology.orchestra.run.trial111.stdout: libcephfs-devel x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 34 k 2026-02-17T11:53:35.471 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:35.471 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-17T11:53:35.471 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-17T11:53:35.471 INFO:teuthology.orchestra.run.trial111.stdout:Install 1 Package 2026-02-17T11:53:35.471 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:35.471 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 34 k 2026-02-17T11:53:35.471 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 153 k 2026-02-17T11:53:35.471 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-17T11:53:35.532 INFO:teuthology.orchestra.run.trial111.stdout:libcephfs-devel-19.2.3-675.g3c96dfb3.el9.x86_64 543 kB/s | 34 kB 00:00 2026-02-17T11:53:35.533 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:53:35.533 INFO:teuthology.orchestra.run.trial111.stdout:Total 536 kB/s | 34 kB 00:00 2026-02-17T11:53:35.533 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-17T11:53:35.534 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-17T11:53:35.534 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-17T11:53:35.536 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-17T11:53:35.536 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-17T11:53:35.557 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-17T11:53:35.572 INFO:teuthology.orchestra.run.trial111.stdout: Installing : libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:53:35.630 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:53:35.687 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:53:35.687 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:35.687 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-17T11:53:35.687 INFO:teuthology.orchestra.run.trial111.stdout: libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:53:35.687 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:35.687 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-17T11:53:35.714 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install librados2 2026-02-17T11:53:36.023 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:42 ago on Tue 17 Feb 2026 11:52:54 AM UTC. 2026-02-17T11:53:36.087 INFO:teuthology.orchestra.run.trial111.stdout:Package librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:53:36.104 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-17T11:53:36.104 INFO:teuthology.orchestra.run.trial111.stdout:Nothing to do. 2026-02-17T11:53:36.105 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-17T11:53:36.127 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install librbd1 2026-02-17T11:53:36.439 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:42 ago on Tue 17 Feb 2026 11:52:54 AM UTC. 2026-02-17T11:53:36.503 INFO:teuthology.orchestra.run.trial111.stdout:Package librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:53:36.520 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-17T11:53:36.521 INFO:teuthology.orchestra.run.trial111.stdout:Nothing to do. 2026-02-17T11:53:36.521 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-17T11:53:36.542 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install python3-rados 2026-02-17T11:53:36.857 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:42 ago on Tue 17 Feb 2026 11:52:54 AM UTC. 2026-02-17T11:53:36.921 INFO:teuthology.orchestra.run.trial111.stdout:Package python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:53:36.938 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-17T11:53:36.939 INFO:teuthology.orchestra.run.trial111.stdout:Nothing to do. 2026-02-17T11:53:36.939 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-17T11:53:36.960 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install python3-rgw 2026-02-17T11:53:37.274 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:43 ago on Tue 17 Feb 2026 11:52:54 AM UTC. 2026-02-17T11:53:37.339 INFO:teuthology.orchestra.run.trial111.stdout:Package python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:53:37.356 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-17T11:53:37.356 INFO:teuthology.orchestra.run.trial111.stdout:Nothing to do. 2026-02-17T11:53:37.356 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-17T11:53:37.379 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install python3-cephfs 2026-02-17T11:53:37.688 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:43 ago on Tue 17 Feb 2026 11:52:54 AM UTC. 2026-02-17T11:53:37.752 INFO:teuthology.orchestra.run.trial111.stdout:Package python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:53:37.770 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-17T11:53:37.770 INFO:teuthology.orchestra.run.trial111.stdout:Nothing to do. 2026-02-17T11:53:37.770 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-17T11:53:37.792 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install python3-rbd 2026-02-17T11:53:38.106 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:44 ago on Tue 17 Feb 2026 11:52:54 AM UTC. 2026-02-17T11:53:38.169 INFO:teuthology.orchestra.run.trial111.stdout:Package python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:53:38.186 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-17T11:53:38.187 INFO:teuthology.orchestra.run.trial111.stdout:Nothing to do. 2026-02-17T11:53:38.187 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-17T11:53:38.208 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install rbd-fuse 2026-02-17T11:53:38.520 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:44 ago on Tue 17 Feb 2026 11:52:54 AM UTC. 2026-02-17T11:53:38.605 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-17T11:53:38.605 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-17T11:53:38.606 INFO:teuthology.orchestra.run.trial111.stdout: Package Architecture Version Repository Size 2026-02-17T11:53:38.606 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-17T11:53:38.606 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-17T11:53:38.606 INFO:teuthology.orchestra.run.trial111.stdout: rbd-fuse x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 85 k 2026-02-17T11:53:38.606 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:38.606 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-17T11:53:38.606 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-17T11:53:38.606 INFO:teuthology.orchestra.run.trial111.stdout:Install 1 Package 2026-02-17T11:53:38.606 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:38.606 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 85 k 2026-02-17T11:53:38.606 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 227 k 2026-02-17T11:53:38.607 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-17T11:53:38.680 INFO:teuthology.orchestra.run.trial111.stdout:rbd-fuse-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 1.1 MB/s | 85 kB 00:00 2026-02-17T11:53:38.681 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:53:38.681 INFO:teuthology.orchestra.run.trial111.stdout:Total 1.1 MB/s | 85 kB 00:00 2026-02-17T11:53:38.681 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-17T11:53:38.683 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-17T11:53:38.684 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-17T11:53:38.715 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-17T11:53:38.715 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-17T11:53:38.766 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-17T11:53:38.783 INFO:teuthology.orchestra.run.trial111.stdout: Installing : rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:53:38.861 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:53:38.919 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:53:38.919 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:38.919 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-17T11:53:38.919 INFO:teuthology.orchestra.run.trial111.stdout: rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:53:38.919 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:38.920 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-17T11:53:38.947 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install rbd-mirror 2026-02-17T11:53:39.264 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:45 ago on Tue 17 Feb 2026 11:52:54 AM UTC. 2026-02-17T11:53:39.346 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-17T11:53:39.346 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-17T11:53:39.346 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repo Size 2026-02-17T11:53:39.346 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-17T11:53:39.347 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-17T11:53:39.347 INFO:teuthology.orchestra.run.trial111.stdout: rbd-mirror x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 3.1 M 2026-02-17T11:53:39.347 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:39.347 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-17T11:53:39.347 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-17T11:53:39.347 INFO:teuthology.orchestra.run.trial111.stdout:Install 1 Package 2026-02-17T11:53:39.347 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:39.347 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 3.1 M 2026-02-17T11:53:39.347 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 13 M 2026-02-17T11:53:39.347 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-17T11:53:39.502 INFO:teuthology.orchestra.run.trial111.stdout:rbd-mirror-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 20 MB/s | 3.1 MB 00:00 2026-02-17T11:53:39.502 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:53:39.502 INFO:teuthology.orchestra.run.trial111.stdout:Total 20 MB/s | 3.1 MB 00:00 2026-02-17T11:53:39.502 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-17T11:53:39.506 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-17T11:53:39.506 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-17T11:53:39.545 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-17T11:53:39.546 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-17T11:53:39.740 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-17T11:53:39.741 INFO:teuthology.orchestra.run.trial111.stdout: Installing : rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:53:39.764 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:53:39.765 INFO:teuthology.orchestra.run.trial111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:53:39.765 INFO:teuthology.orchestra.run.trial111.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-17T11:53:39.765 INFO:teuthology.orchestra.run.trial111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T11:53:39.765 INFO:teuthology.orchestra.run.trial111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T11:53:39.765 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:40.062 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:53:40.062 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:40.062 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-17T11:53:40.062 INFO:teuthology.orchestra.run.trial111.stdout: rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:53:40.062 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:40.062 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-17T11:53:40.090 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install rbd-nbd 2026-02-17T11:53:40.407 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:46 ago on Tue 17 Feb 2026 11:52:54 AM UTC. 2026-02-17T11:53:40.488 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-17T11:53:40.489 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-17T11:53:40.489 INFO:teuthology.orchestra.run.trial111.stdout: Package Architecture Version Repository Size 2026-02-17T11:53:40.489 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-17T11:53:40.489 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-17T11:53:40.489 INFO:teuthology.orchestra.run.trial111.stdout: rbd-nbd x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 171 k 2026-02-17T11:53:40.489 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:40.489 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-17T11:53:40.489 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-17T11:53:40.489 INFO:teuthology.orchestra.run.trial111.stdout:Install 1 Package 2026-02-17T11:53:40.489 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:40.489 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 171 k 2026-02-17T11:53:40.489 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 490 k 2026-02-17T11:53:40.489 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-17T11:53:40.575 INFO:teuthology.orchestra.run.trial111.stdout:rbd-nbd-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 2.0 MB/s | 171 kB 00:00 2026-02-17T11:53:40.576 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:53:40.576 INFO:teuthology.orchestra.run.trial111.stdout:Total 1.9 MB/s | 171 kB 00:00 2026-02-17T11:53:40.576 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-17T11:53:40.580 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-17T11:53:40.580 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-17T11:53:40.611 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-17T11:53:40.611 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-17T11:53:40.666 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-17T11:53:40.683 INFO:teuthology.orchestra.run.trial111.stdout: Installing : rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:53:40.765 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:53:40.823 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:53:40.823 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:40.823 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-17T11:53:40.823 INFO:teuthology.orchestra.run.trial111.stdout: rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:53:40.823 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:40.823 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-17T11:53:40.852 DEBUG:teuthology.parallel:result is None 2026-02-17T11:53:40.852 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T11:53:40.972 DEBUG:teuthology.orchestra.run.trial111:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-17T11:53:40.993 INFO:teuthology.orchestra.run.trial111.stdout:19.2.3-675.g3c96dfb3.el9 2026-02-17T11:53:40.994 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-675.g3c96dfb3.el9 2026-02-17T11:53:40.994 INFO:teuthology.task.install:The correct ceph version 19.2.3-675.g3c96dfb3 is installed. 2026-02-17T11:53:40.996 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-17T11:53:40.996 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-17T11:53:40.996 DEBUG:teuthology.orchestra.run.trial111:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T11:53:41.057 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-17T11:53:41.058 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-17T11:53:41.058 DEBUG:teuthology.orchestra.run.trial111:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T11:53:41.129 DEBUG:teuthology.orchestra.run.trial111:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T11:53:41.192 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-17T11:53:41.192 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-17T11:53:41.193 DEBUG:teuthology.orchestra.run.trial111:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T11:53:41.255 DEBUG:teuthology.orchestra.run.trial111:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T11:53:41.319 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-17T11:53:41.319 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-17T11:53:41.319 DEBUG:teuthology.orchestra.run.trial111:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T11:53:41.382 DEBUG:teuthology.orchestra.run.trial111:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T11:53:41.446 INFO:teuthology.run_tasks:Running task ceph... 2026-02-17T11:53:41.559 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-17T11:53:41.559 DEBUG:teuthology.orchestra.run.trial111:> sudo chmod 777 /var/log/ceph 2026-02-17T11:53:41.584 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-17T11:53:41.584 DEBUG:teuthology.orchestra.run.trial111:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-17T11:53:41.649 INFO:tasks.ceph:Creating extra log directories... 2026-02-17T11:53:41.649 DEBUG:teuthology.orchestra.run.trial111:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-17T11:53:41.723 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-17T11:53:41.724 INFO:tasks.ceph:config {'conf': {'global': {'mon election default strategy': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'but it is still running', 'overall HEALTH_', '\\(POOL_APP_NOT_ENABLED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-17T11:53:41.724 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51362', 'branch': 'wip-bharath20-testing-2026-02-13-0906-squid', 'description': 'rados/singleton-nomsgr/{all/ceph-snapmapper mon_election/classic rados supported-random-distro$/{centos_latest}}', 'email': 'skanta@redhat.com', 'first_in_suite': False, 'flavor': 'default', 'job_id': '51362', 'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-bharath20-testing-2026-02-13-0906-squid'}, 'ceph': {'conf': {'global': {'mon election default strategy': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'but it is still running', 'overall HEALTH_', '\\(POOL_APP_NOT_ENABLED\\)'], 'pre-mgr-commands': ['sudo ceph config set mgr mgr_pool false --force'], 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'workunit': {'branch': 'wip-bharath20-testing-2026-02-13-0906-squid', 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919'}}, 'owner': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'priority': 69, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0']], 'seed': 4581, 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-bharath20-testing-2026-02-13-0906-squid', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919', 'targets': {'trial111.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMgBynaJOtQ/rMstCSCpmquSZogZpvyEQ9HGByWDdpTsNiIuy391CMaku9KdaztsI98mXa2xz75kkUqvhuFpulI='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'exec': {'client.0': ['ceph_test_snap_mapper']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-17_04:10:36', 'tube': 'trial', 'user': 'skanta', 'verbose': True, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682'} 2026-02-17T11:53:41.724 DEBUG:teuthology.orchestra.run.trial111:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-17T11:53:41.768 DEBUG:teuthology.orchestra.run.trial111:> sudo install -d -m0777 -- /var/run/ceph 2026-02-17T11:53:41.834 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-17T11:53:41.834 DEBUG:teuthology.orchestra.run.trial111:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T11:53:41.890 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T11:53:41.890 DEBUG:teuthology.orchestra.run.trial111:> stat /dev/vg_nvme/lv_1 2026-02-17T11:53:41.947 INFO:teuthology.orchestra.run.trial111.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T11:53:41.947 INFO:teuthology.orchestra.run.trial111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:53:41.947 INFO:teuthology.orchestra.run.trial111.stdout:Device: 6h/6d Inode: 1304 Links: 1 2026-02-17T11:53:41.947 INFO:teuthology.orchestra.run.trial111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:53:41.947 INFO:teuthology.orchestra.run.trial111.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:53:41.947 INFO:teuthology.orchestra.run.trial111.stdout:Access: 2026-02-17 11:53:39.912387299 +0000 2026-02-17T11:53:41.947 INFO:teuthology.orchestra.run.trial111.stdout:Modify: 2026-02-17 11:53:00.248069080 +0000 2026-02-17T11:53:41.947 INFO:teuthology.orchestra.run.trial111.stdout:Change: 2026-02-17 11:53:00.248069080 +0000 2026-02-17T11:53:41.947 INFO:teuthology.orchestra.run.trial111.stdout: Birth: 2026-02-17 11:53:00.248069080 +0000 2026-02-17T11:53:41.947 DEBUG:teuthology.orchestra.run.trial111:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T11:53:42.010 INFO:teuthology.orchestra.run.trial111.stderr:1+0 records in 2026-02-17T11:53:42.010 INFO:teuthology.orchestra.run.trial111.stderr:1+0 records out 2026-02-17T11:53:42.010 INFO:teuthology.orchestra.run.trial111.stderr:512 bytes copied, 0.000151251 s, 3.4 MB/s 2026-02-17T11:53:42.011 DEBUG:teuthology.orchestra.run.trial111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T11:53:42.069 DEBUG:teuthology.orchestra.run.trial111:> stat /dev/vg_nvme/lv_2 2026-02-17T11:53:42.125 INFO:teuthology.orchestra.run.trial111.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T11:53:42.126 INFO:teuthology.orchestra.run.trial111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:53:42.126 INFO:teuthology.orchestra.run.trial111.stdout:Device: 6h/6d Inode: 1316 Links: 1 2026-02-17T11:53:42.126 INFO:teuthology.orchestra.run.trial111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:53:42.126 INFO:teuthology.orchestra.run.trial111.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:53:42.126 INFO:teuthology.orchestra.run.trial111.stdout:Access: 2026-02-17 11:53:39.912387299 +0000 2026-02-17T11:53:42.126 INFO:teuthology.orchestra.run.trial111.stdout:Modify: 2026-02-17 11:53:00.248069080 +0000 2026-02-17T11:53:42.126 INFO:teuthology.orchestra.run.trial111.stdout:Change: 2026-02-17 11:53:00.248069080 +0000 2026-02-17T11:53:42.126 INFO:teuthology.orchestra.run.trial111.stdout: Birth: 2026-02-17 11:53:00.248069080 +0000 2026-02-17T11:53:42.127 DEBUG:teuthology.orchestra.run.trial111:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T11:53:42.188 INFO:teuthology.orchestra.run.trial111.stderr:1+0 records in 2026-02-17T11:53:42.188 INFO:teuthology.orchestra.run.trial111.stderr:1+0 records out 2026-02-17T11:53:42.188 INFO:teuthology.orchestra.run.trial111.stderr:512 bytes copied, 0.000142835 s, 3.6 MB/s 2026-02-17T11:53:42.190 DEBUG:teuthology.orchestra.run.trial111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T11:53:42.248 DEBUG:teuthology.orchestra.run.trial111:> stat /dev/vg_nvme/lv_3 2026-02-17T11:53:42.305 INFO:teuthology.orchestra.run.trial111.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T11:53:42.305 INFO:teuthology.orchestra.run.trial111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:53:42.305 INFO:teuthology.orchestra.run.trial111.stdout:Device: 6h/6d Inode: 1310 Links: 1 2026-02-17T11:53:42.306 INFO:teuthology.orchestra.run.trial111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:53:42.306 INFO:teuthology.orchestra.run.trial111.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:53:42.306 INFO:teuthology.orchestra.run.trial111.stdout:Access: 2026-02-17 11:53:39.912387299 +0000 2026-02-17T11:53:42.306 INFO:teuthology.orchestra.run.trial111.stdout:Modify: 2026-02-17 11:53:00.248069080 +0000 2026-02-17T11:53:42.306 INFO:teuthology.orchestra.run.trial111.stdout:Change: 2026-02-17 11:53:00.248069080 +0000 2026-02-17T11:53:42.306 INFO:teuthology.orchestra.run.trial111.stdout: Birth: 2026-02-17 11:53:00.248069080 +0000 2026-02-17T11:53:42.306 DEBUG:teuthology.orchestra.run.trial111:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T11:53:42.369 INFO:teuthology.orchestra.run.trial111.stderr:1+0 records in 2026-02-17T11:53:42.369 INFO:teuthology.orchestra.run.trial111.stderr:1+0 records out 2026-02-17T11:53:42.369 INFO:teuthology.orchestra.run.trial111.stderr:512 bytes copied, 0.000165237 s, 3.1 MB/s 2026-02-17T11:53:42.370 DEBUG:teuthology.orchestra.run.trial111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T11:53:42.426 DEBUG:teuthology.orchestra.run.trial111:> stat /dev/vg_nvme/lv_4 2026-02-17T11:53:42.483 INFO:teuthology.orchestra.run.trial111.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T11:53:42.483 INFO:teuthology.orchestra.run.trial111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:53:42.483 INFO:teuthology.orchestra.run.trial111.stdout:Device: 6h/6d Inode: 1299 Links: 1 2026-02-17T11:53:42.483 INFO:teuthology.orchestra.run.trial111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:53:42.483 INFO:teuthology.orchestra.run.trial111.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:53:42.483 INFO:teuthology.orchestra.run.trial111.stdout:Access: 2026-02-17 11:53:39.913387281 +0000 2026-02-17T11:53:42.483 INFO:teuthology.orchestra.run.trial111.stdout:Modify: 2026-02-17 11:53:00.248069080 +0000 2026-02-17T11:53:42.483 INFO:teuthology.orchestra.run.trial111.stdout:Change: 2026-02-17 11:53:00.248069080 +0000 2026-02-17T11:53:42.483 INFO:teuthology.orchestra.run.trial111.stdout: Birth: 2026-02-17 11:53:00.248069080 +0000 2026-02-17T11:53:42.483 DEBUG:teuthology.orchestra.run.trial111:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T11:53:42.547 INFO:teuthology.orchestra.run.trial111.stderr:1+0 records in 2026-02-17T11:53:42.547 INFO:teuthology.orchestra.run.trial111.stderr:1+0 records out 2026-02-17T11:53:42.547 INFO:teuthology.orchestra.run.trial111.stderr:512 bytes copied, 0.000132676 s, 3.9 MB/s 2026-02-17T11:53:42.548 DEBUG:teuthology.orchestra.run.trial111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T11:53:42.606 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T11:53:42.606 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial111.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2026-02-17T11:53:42.606 INFO:tasks.ceph:Generating config... 2026-02-17T11:53:42.608 INFO:tasks.ceph:[global] mon election default strategy = 1 2026-02-17T11:53:42.609 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-17T11:53:42.609 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-17T11:53:42.609 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-17T11:53:42.609 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-17T11:53:42.609 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-17T11:53:42.609 INFO:tasks.ceph:[mon] mon scrub interval = 300 2026-02-17T11:53:42.609 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2026-02-17T11:53:42.609 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-17T11:53:42.609 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-17T11:53:42.609 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2026-02-17T11:53:42.609 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2026-02-17T11:53:42.610 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2026-02-17T11:53:42.610 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2026-02-17T11:53:42.610 INFO:tasks.ceph:[osd] osd op queue = debug_random 2026-02-17T11:53:42.610 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2026-02-17T11:53:42.610 INFO:tasks.ceph:Setting up mon.a... 2026-02-17T11:53:42.610 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-17T11:53:42.682 INFO:teuthology.orchestra.run.trial111.stdout:creating /etc/ceph/ceph.keyring 2026-02-17T11:53:42.684 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-17T11:53:42.763 DEBUG:teuthology.orchestra.run.trial111:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T11:53:42.826 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.111')] 2026-02-17T11:53:42.827 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.111', 'mon election default strategy': 1}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd mclock override recovery settings': True, 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon scrub interval': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}} 2026-02-17T11:53:42.829 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-17T11:53:42.829 DEBUG:teuthology.orchestra.run.trial111:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-17T11:53:42.884 DEBUG:teuthology.orchestra.run.trial111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.111 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:53:42.953 INFO:teuthology.orchestra.run.trial111.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:53:42.953 INFO:teuthology.orchestra.run.trial111.stdout:monmaptool: generated fsid e0aed382-97c1-4a49-9fc0-e493e1bf10c5 2026-02-17T11:53:42.953 INFO:teuthology.orchestra.run.trial111.stdout:setting min_mon_release = quincy 2026-02-17T11:53:42.953 INFO:teuthology.orchestra.run.trial111.stdout:epoch 0 2026-02-17T11:53:42.953 INFO:teuthology.orchestra.run.trial111.stdout:fsid e0aed382-97c1-4a49-9fc0-e493e1bf10c5 2026-02-17T11:53:42.953 INFO:teuthology.orchestra.run.trial111.stdout:last_changed 2026-02-17T11:53:42.953302+0000 2026-02-17T11:53:42.954 INFO:teuthology.orchestra.run.trial111.stdout:created 2026-02-17T11:53:42.953302+0000 2026-02-17T11:53:42.954 INFO:teuthology.orchestra.run.trial111.stdout:min_mon_release 17 (quincy) 2026-02-17T11:53:42.954 INFO:teuthology.orchestra.run.trial111.stdout:election_strategy: 1 2026-02-17T11:53:42.954 INFO:teuthology.orchestra.run.trial111.stdout:0: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.a 2026-02-17T11:53:42.954 INFO:teuthology.orchestra.run.trial111.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2026-02-17T11:53:42.955 DEBUG:teuthology.orchestra.run.trial111:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-17T11:53:43.012 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e0aed382-97c1-4a49-9fc0-e493e1bf10c5... 2026-02-17T11:53:43.014 DEBUG:teuthology.orchestra.run.trial111:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-17T11:53:43.093 INFO:teuthology.orchestra.run.trial111.stdout:[global] 2026-02-17T11:53:43.093 INFO:teuthology.orchestra.run.trial111.stdout: chdir = "" 2026-02-17T11:53:43.093 INFO:teuthology.orchestra.run.trial111.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-17T11:53:43.093 INFO:teuthology.orchestra.run.trial111.stdout: auth supported = cephx 2026-02-17T11:53:43.093 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:43.094 INFO:teuthology.orchestra.run.trial111.stdout: filestore xattr use omap = true 2026-02-17T11:53:43.094 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:43.094 INFO:teuthology.orchestra.run.trial111.stdout: mon clock drift allowed = 1.000 2026-02-17T11:53:43.094 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:43.094 INFO:teuthology.orchestra.run.trial111.stdout: osd crush chooseleaf type = 0 2026-02-17T11:53:43.094 INFO:teuthology.orchestra.run.trial111.stdout: auth debug = true 2026-02-17T11:53:43.094 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:43.094 INFO:teuthology.orchestra.run.trial111.stdout: ms die on old message = true 2026-02-17T11:53:43.094 INFO:teuthology.orchestra.run.trial111.stdout: ms die on bug = true 2026-02-17T11:53:43.094 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:43.094 INFO:teuthology.orchestra.run.trial111.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-17T11:53:43.095 INFO:teuthology.orchestra.run.trial111.stdout: mon pg warn max object skew = 0 2026-02-17T11:53:43.095 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:43.095 INFO:teuthology.orchestra.run.trial111.stdout: # disable pg_autoscaler by default for new pools 2026-02-17T11:53:43.095 INFO:teuthology.orchestra.run.trial111.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-17T11:53:43.095 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:43.095 INFO:teuthology.orchestra.run.trial111.stdout: osd pool default size = 2 2026-02-17T11:53:43.095 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:43.095 INFO:teuthology.orchestra.run.trial111.stdout: mon osd allow primary affinity = true 2026-02-17T11:53:43.095 INFO:teuthology.orchestra.run.trial111.stdout: mon osd allow pg remap = true 2026-02-17T11:53:43.095 INFO:teuthology.orchestra.run.trial111.stdout: mon warn on legacy crush tunables = false 2026-02-17T11:53:43.095 INFO:teuthology.orchestra.run.trial111.stdout: mon warn on crush straw calc version zero = false 2026-02-17T11:53:43.095 INFO:teuthology.orchestra.run.trial111.stdout: mon warn on no sortbitwise = false 2026-02-17T11:53:43.096 INFO:teuthology.orchestra.run.trial111.stdout: mon warn on osd down out interval zero = false 2026-02-17T11:53:43.096 INFO:teuthology.orchestra.run.trial111.stdout: mon warn on too few osds = false 2026-02-17T11:53:43.096 INFO:teuthology.orchestra.run.trial111.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-17T11:53:43.096 INFO:teuthology.orchestra.run.trial111.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-17T11:53:43.096 INFO:teuthology.orchestra.run.trial111.stdout: mon_allow_pool_size_one = true 2026-02-17T11:53:43.096 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:43.096 INFO:teuthology.orchestra.run.trial111.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-17T11:53:43.096 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:43.096 INFO:teuthology.orchestra.run.trial111.stdout: osd default data pool replay window = 5 2026-02-17T11:53:43.096 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:43.096 INFO:teuthology.orchestra.run.trial111.stdout: mon allow pool delete = true 2026-02-17T11:53:43.096 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:43.097 INFO:teuthology.orchestra.run.trial111.stdout: mon cluster log file level = debug 2026-02-17T11:53:43.097 INFO:teuthology.orchestra.run.trial111.stdout: debug asserts on shutdown = true 2026-02-17T11:53:43.097 INFO:teuthology.orchestra.run.trial111.stdout: mon health detail to clog = false 2026-02-17T11:53:43.097 INFO:teuthology.orchestra.run.trial111.stdout: mon host = 10.20.193.111 2026-02-17T11:53:43.097 INFO:teuthology.orchestra.run.trial111.stdout: mon election default strategy = 1 2026-02-17T11:53:43.097 INFO:teuthology.orchestra.run.trial111.stdout: fsid = e0aed382-97c1-4a49-9fc0-e493e1bf10c5 2026-02-17T11:53:43.097 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:43.097 INFO:teuthology.orchestra.run.trial111.stdout:[osd] 2026-02-17T11:53:43.097 INFO:teuthology.orchestra.run.trial111.stdout: osd journal size = 100 2026-02-17T11:53:43.097 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:43.098 INFO:teuthology.orchestra.run.trial111.stdout: osd scrub load threshold = 5.0 2026-02-17T11:53:43.098 INFO:teuthology.orchestra.run.trial111.stdout: osd scrub max interval = 600 2026-02-17T11:53:43.098 INFO:teuthology.orchestra.run.trial111.stdout: osd mclock profile = high_recovery_ops 2026-02-17T11:53:43.098 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:43.098 INFO:teuthology.orchestra.run.trial111.stdout: osd recover clone overlap = true 2026-02-17T11:53:43.098 INFO:teuthology.orchestra.run.trial111.stdout: osd recovery max chunk = 1048576 2026-02-17T11:53:43.098 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:43.098 INFO:teuthology.orchestra.run.trial111.stdout: osd debug shutdown = true 2026-02-17T11:53:43.098 INFO:teuthology.orchestra.run.trial111.stdout: osd debug op order = true 2026-02-17T11:53:43.098 INFO:teuthology.orchestra.run.trial111.stdout: osd debug verify stray on activate = true 2026-02-17T11:53:43.098 INFO:teuthology.orchestra.run.trial111.stdout: osd debug trim objects = true 2026-02-17T11:53:43.098 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:43.099 INFO:teuthology.orchestra.run.trial111.stdout: osd open classes on start = true 2026-02-17T11:53:43.099 INFO:teuthology.orchestra.run.trial111.stdout: osd debug pg log writeout = true 2026-02-17T11:53:43.099 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:43.099 INFO:teuthology.orchestra.run.trial111.stdout: osd deep scrub update digest min age = 30 2026-02-17T11:53:43.099 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:43.099 INFO:teuthology.orchestra.run.trial111.stdout: osd map max advance = 10 2026-02-17T11:53:43.099 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:43.099 INFO:teuthology.orchestra.run.trial111.stdout: journal zero on create = true 2026-02-17T11:53:43.099 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:43.099 INFO:teuthology.orchestra.run.trial111.stdout: filestore ondisk finisher threads = 3 2026-02-17T11:53:43.099 INFO:teuthology.orchestra.run.trial111.stdout: filestore apply finisher threads = 3 2026-02-17T11:53:43.099 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:43.099 INFO:teuthology.orchestra.run.trial111.stdout: bdev debug aio = true 2026-02-17T11:53:43.100 INFO:teuthology.orchestra.run.trial111.stdout: osd debug misdirected ops = true 2026-02-17T11:53:43.100 INFO:teuthology.orchestra.run.trial111.stdout: bluestore zero block detection = True 2026-02-17T11:53:43.100 INFO:teuthology.orchestra.run.trial111.stdout: debug ms = 1 2026-02-17T11:53:43.100 INFO:teuthology.orchestra.run.trial111.stdout: debug osd = 20 2026-02-17T11:53:43.100 INFO:teuthology.orchestra.run.trial111.stdout: osd debug verify cached snaps = True 2026-02-17T11:53:43.100 INFO:teuthology.orchestra.run.trial111.stdout: osd debug verify missing on start = True 2026-02-17T11:53:43.100 INFO:teuthology.orchestra.run.trial111.stdout: osd mclock override recovery settings = True 2026-02-17T11:53:43.100 INFO:teuthology.orchestra.run.trial111.stdout: osd op queue = debug_random 2026-02-17T11:53:43.100 INFO:teuthology.orchestra.run.trial111.stdout: osd op queue cut off = debug_random 2026-02-17T11:53:43.100 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:43.100 INFO:teuthology.orchestra.run.trial111.stdout:[mgr] 2026-02-17T11:53:43.100 INFO:teuthology.orchestra.run.trial111.stdout: debug ms = 1 2026-02-17T11:53:43.100 INFO:teuthology.orchestra.run.trial111.stdout: debug mgr = 20 2026-02-17T11:53:43.101 INFO:teuthology.orchestra.run.trial111.stdout: debug mon = 20 2026-02-17T11:53:43.101 INFO:teuthology.orchestra.run.trial111.stdout: debug auth = 20 2026-02-17T11:53:43.101 INFO:teuthology.orchestra.run.trial111.stdout: mon reweight min pgs per osd = 4 2026-02-17T11:53:43.101 INFO:teuthology.orchestra.run.trial111.stdout: mon reweight min bytes per osd = 10 2026-02-17T11:53:43.101 INFO:teuthology.orchestra.run.trial111.stdout: mgr/telemetry/nag = false 2026-02-17T11:53:43.101 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:43.101 INFO:teuthology.orchestra.run.trial111.stdout:[mon] 2026-02-17T11:53:43.101 INFO:teuthology.orchestra.run.trial111.stdout: debug ms = 1 2026-02-17T11:53:43.101 INFO:teuthology.orchestra.run.trial111.stdout: debug mon = 20 2026-02-17T11:53:43.101 INFO:teuthology.orchestra.run.trial111.stdout: debug paxos = 20 2026-02-17T11:53:43.101 INFO:teuthology.orchestra.run.trial111.stdout: debug auth = 20 2026-02-17T11:53:43.101 INFO:teuthology.orchestra.run.trial111.stdout: mon data avail warn = 5 2026-02-17T11:53:43.102 INFO:teuthology.orchestra.run.trial111.stdout: mon mgr mkfs grace = 240 2026-02-17T11:53:43.102 INFO:teuthology.orchestra.run.trial111.stdout: mon reweight min pgs per osd = 4 2026-02-17T11:53:43.102 INFO:teuthology.orchestra.run.trial111.stdout: mon osd reporter subtree level = osd 2026-02-17T11:53:43.102 INFO:teuthology.orchestra.run.trial111.stdout: mon osd prime pg temp = true 2026-02-17T11:53:43.102 INFO:teuthology.orchestra.run.trial111.stdout: mon reweight min bytes per osd = 10 2026-02-17T11:53:43.102 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:43.102 INFO:teuthology.orchestra.run.trial111.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-17T11:53:43.102 INFO:teuthology.orchestra.run.trial111.stdout: auth mon ticket ttl = 660 # 11m 2026-02-17T11:53:43.102 INFO:teuthology.orchestra.run.trial111.stdout: auth service ticket ttl = 240 # 4m 2026-02-17T11:53:43.102 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:43.102 INFO:teuthology.orchestra.run.trial111.stdout: # don't complain about insecure global_id in the test suite 2026-02-17T11:53:43.102 INFO:teuthology.orchestra.run.trial111.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-17T11:53:43.102 INFO:teuthology.orchestra.run.trial111.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-17T11:53:43.103 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:43.103 INFO:teuthology.orchestra.run.trial111.stdout: # 1m isn't quite enough 2026-02-17T11:53:43.103 INFO:teuthology.orchestra.run.trial111.stdout: mon_down_mkfs_grace = 2m 2026-02-17T11:53:43.103 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:43.103 INFO:teuthology.orchestra.run.trial111.stdout: mon_warn_on_filestore_osds = false 2026-02-17T11:53:43.103 INFO:teuthology.orchestra.run.trial111.stdout: mon scrub interval = 300 2026-02-17T11:53:43.103 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:43.103 INFO:teuthology.orchestra.run.trial111.stdout:[client] 2026-02-17T11:53:43.103 INFO:teuthology.orchestra.run.trial111.stdout: rgw cache enabled = true 2026-02-17T11:53:43.103 INFO:teuthology.orchestra.run.trial111.stdout: rgw enable ops log = true 2026-02-17T11:53:43.103 INFO:teuthology.orchestra.run.trial111.stdout: rgw enable usage log = true 2026-02-17T11:53:43.103 INFO:teuthology.orchestra.run.trial111.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-17T11:53:43.103 INFO:teuthology.orchestra.run.trial111.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-17T11:53:43.104 INFO:teuthology.orchestra.run.trial111.stdout:[mon.a] 2026-02-17T11:53:43.105 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-17T11:53:43.105 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-17T11:53:43.186 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-17T11:53:43.186 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-17T11:53:43.186 DEBUG:teuthology.orchestra.run.trial111:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-17T11:53:43.241 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-17T11:53:43.241 DEBUG:teuthology.orchestra.run.trial111:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-17T11:53:43.296 INFO:tasks.ceph:Sending monmap to node ubuntu@trial111.front.sepia.ceph.com 2026-02-17T11:53:43.296 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-17T11:53:43.297 DEBUG:teuthology.orchestra.run.trial111:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-17T11:53:43.297 DEBUG:teuthology.orchestra.run.trial111:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T11:53:43.369 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-17T11:53:43.370 DEBUG:teuthology.orchestra.run.trial111:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:53:43.425 INFO:tasks.ceph:Setting up mon nodes... 2026-02-17T11:53:43.426 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-17T11:53:43.426 DEBUG:teuthology.orchestra.run.trial111:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-17T11:53:43.510 INFO:teuthology.orchestra.run.trial111.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-17T11:53:43.512 INFO:tasks.ceph:Setting up mds nodes... 2026-02-17T11:53:43.513 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-17T11:53:43.513 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-17T11:53:43.547 INFO:teuthology.orchestra.run.trial111.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-17T11:53:43.558 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-17T11:53:43.558 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial111.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2026-02-17T11:53:43.558 DEBUG:teuthology.orchestra.run.trial111:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-17T11:53:43.622 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T11:53:43.622 INFO:tasks.ceph:role: osd.0 2026-02-17T11:53:43.622 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial111.front.sepia.ceph.com 2026-02-17T11:53:43.622 DEBUG:teuthology.orchestra.run.trial111:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-17T11:53:43.689 INFO:teuthology.orchestra.run.trial111.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:53:43.689 INFO:teuthology.orchestra.run.trial111.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:53:43.689 INFO:teuthology.orchestra.run.trial111.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:53:43.689 INFO:teuthology.orchestra.run.trial111.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:53:43.689 INFO:teuthology.orchestra.run.trial111.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:53:43.689 INFO:teuthology.orchestra.run.trial111.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:53:43.690 INFO:teuthology.orchestra.run.trial111.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:53:43.690 INFO:teuthology.orchestra.run.trial111.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:53:43.690 INFO:teuthology.orchestra.run.trial111.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:53:43.690 INFO:teuthology.orchestra.run.trial111.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:53:44.260 INFO:teuthology.orchestra.run.trial111.stdout:Discarding blocks...Done. 2026-02-17T11:53:44.262 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial111.front.sepia.ceph.com -o noatime 2026-02-17T11:53:44.262 DEBUG:teuthology.orchestra.run.trial111:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-17T11:53:44.329 DEBUG:teuthology.orchestra.run.trial111:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-17T11:53:44.396 DEBUG:teuthology.orchestra.run.trial111:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-17T11:53:44.460 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T11:53:44.460 INFO:tasks.ceph:role: osd.1 2026-02-17T11:53:44.460 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial111.front.sepia.ceph.com 2026-02-17T11:53:44.460 DEBUG:teuthology.orchestra.run.trial111:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-17T11:53:44.527 INFO:teuthology.orchestra.run.trial111.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:53:44.527 INFO:teuthology.orchestra.run.trial111.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:53:44.527 INFO:teuthology.orchestra.run.trial111.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:53:44.527 INFO:teuthology.orchestra.run.trial111.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:53:44.527 INFO:teuthology.orchestra.run.trial111.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:53:44.527 INFO:teuthology.orchestra.run.trial111.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:53:44.527 INFO:teuthology.orchestra.run.trial111.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:53:44.527 INFO:teuthology.orchestra.run.trial111.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:53:44.527 INFO:teuthology.orchestra.run.trial111.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:53:44.528 INFO:teuthology.orchestra.run.trial111.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:53:45.086 INFO:teuthology.orchestra.run.trial111.stdout:Discarding blocks...Done. 2026-02-17T11:53:45.088 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial111.front.sepia.ceph.com -o noatime 2026-02-17T11:53:45.088 DEBUG:teuthology.orchestra.run.trial111:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-17T11:53:45.157 DEBUG:teuthology.orchestra.run.trial111:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-17T11:53:45.225 DEBUG:teuthology.orchestra.run.trial111:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-17T11:53:45.290 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T11:53:45.291 INFO:tasks.ceph:role: osd.2 2026-02-17T11:53:45.291 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial111.front.sepia.ceph.com 2026-02-17T11:53:45.291 DEBUG:teuthology.orchestra.run.trial111:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-17T11:53:45.354 INFO:teuthology.orchestra.run.trial111.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:53:45.354 INFO:teuthology.orchestra.run.trial111.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:53:45.354 INFO:teuthology.orchestra.run.trial111.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:53:45.354 INFO:teuthology.orchestra.run.trial111.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:53:45.354 INFO:teuthology.orchestra.run.trial111.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:53:45.354 INFO:teuthology.orchestra.run.trial111.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:53:45.355 INFO:teuthology.orchestra.run.trial111.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:53:45.355 INFO:teuthology.orchestra.run.trial111.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:53:45.355 INFO:teuthology.orchestra.run.trial111.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:53:45.355 INFO:teuthology.orchestra.run.trial111.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:53:45.913 INFO:teuthology.orchestra.run.trial111.stdout:Discarding blocks...Done. 2026-02-17T11:53:45.915 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial111.front.sepia.ceph.com -o noatime 2026-02-17T11:53:45.915 DEBUG:teuthology.orchestra.run.trial111:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2026-02-17T11:53:45.982 DEBUG:teuthology.orchestra.run.trial111:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-17T11:53:46.049 DEBUG:teuthology.orchestra.run.trial111:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:53:46.130 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-17T11:53:46.129+0000 7f2bea20e780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-17T11:53:46.130 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-17T11:53:46.129+0000 7f2bea20e780 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-17T11:53:46.130 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-17T11:53:46.129+0000 7f2bea20e780 -1 bdev(0x5578ea701800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-17T11:53:46.130 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-17T11:53:46.129+0000 7f2bea20e780 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-17T11:53:48.490 DEBUG:teuthology.orchestra.run.trial111:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-17T11:53:48.554 DEBUG:teuthology.orchestra.run.trial111:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:53:48.631 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-17T11:53:48.630+0000 7f8823d37780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-17T11:53:48.632 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-17T11:53:48.631+0000 7f8823d37780 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-17T11:53:48.632 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-17T11:53:48.631+0000 7f8823d37780 -1 bdev(0x560116513800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-17T11:53:48.632 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-17T11:53:48.631+0000 7f8823d37780 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-17T11:53:50.754 DEBUG:teuthology.orchestra.run.trial111:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-17T11:53:50.819 DEBUG:teuthology.orchestra.run.trial111:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:53:50.899 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-17T11:53:50.898+0000 7f39ec4a4780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-17T11:53:50.900 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-17T11:53:50.898+0000 7f39ec4a4780 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-17T11:53:50.900 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-17T11:53:50.899+0000 7f39ec4a4780 -1 bdev(0x562092ecf800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-02-17T11:53:50.900 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-17T11:53:50.899+0000 7f39ec4a4780 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-17T11:53:53.041 DEBUG:teuthology.orchestra.run.trial111:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-17T11:53:53.107 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-17T11:53:53.107 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-17T11:53:53.107 DEBUG:teuthology.orchestra.run.trial111:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-17T11:53:53.172 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-17T11:53:53.172 DEBUG:teuthology.orchestra.run.trial111:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-17T11:53:53.236 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-17T11:53:53.236 DEBUG:teuthology.orchestra.run.trial111:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-17T11:53:53.299 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-17T11:53:53.299 DEBUG:teuthology.orchestra.run.trial111:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-17T11:53:53.362 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-17T11:53:53.362 DEBUG:teuthology.orchestra.run.trial111:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-17T11:53:53.418 INFO:tasks.ceph:Adding keys to all mons... 2026-02-17T11:53:53.418 DEBUG:teuthology.orchestra.run.trial111:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-17T11:53:53.481 INFO:teuthology.orchestra.run.trial111.stdout:[mgr.x] 2026-02-17T11:53:53.481 INFO:teuthology.orchestra.run.trial111.stdout: key = AQDHVpRp66NrHhAAL3RenKXAKyo3Q1H646Fc4Q== 2026-02-17T11:53:53.481 INFO:teuthology.orchestra.run.trial111.stdout:[osd.0] 2026-02-17T11:53:53.481 INFO:teuthology.orchestra.run.trial111.stdout: key = AQDKVpRpi1e+BxAAPjne8wn3TGokUEEykqKJRw== 2026-02-17T11:53:53.481 INFO:teuthology.orchestra.run.trial111.stdout:[osd.1] 2026-02-17T11:53:53.481 INFO:teuthology.orchestra.run.trial111.stdout: key = AQDMVpRpozejJRAAfm6TCY4sdPq/5aId3oN5wA== 2026-02-17T11:53:53.482 INFO:teuthology.orchestra.run.trial111.stdout:[osd.2] 2026-02-17T11:53:53.482 INFO:teuthology.orchestra.run.trial111.stdout: key = AQDOVpRp4MabNRAA3KtbLKZAO1fCCj29KgvNAg== 2026-02-17T11:53:53.482 INFO:teuthology.orchestra.run.trial111.stdout:[client.0] 2026-02-17T11:53:53.482 INFO:teuthology.orchestra.run.trial111.stdout: key = AQDHVpRpnGCfIBAAxp5MZNIYvy4jfSQyNj0WGg== 2026-02-17T11:53:53.483 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-17T11:53:53.564 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:53.642 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:53.721 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:53:53.801 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-17T11:53:53.881 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-17T11:53:53.881 DEBUG:teuthology.orchestra.run.trial111:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-17T11:53:53.945 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-17T11:53:54.029 DEBUG:teuthology.orchestra.run.trial111:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-17T11:53:54.093 DEBUG:teuthology.orchestra.run.trial111:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:53:54.150 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-17T11:53:54.150 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-17T11:53:54.151 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-17T11:53:54.193 INFO:tasks.ceph.mon.a:Started 2026-02-17T11:53:54.193 DEBUG:teuthology.orchestra.run.trial111:> sudo ceph config set mgr mgr_pool false --force 2026-02-17T11:53:54.301 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-17T11:53:54.301 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-17T11:53:54.301 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-17T11:53:54.304 INFO:tasks.ceph.mgr.x:Started 2026-02-17T11:53:54.304 INFO:tasks.ceph:Setting crush tunables to default 2026-02-17T11:53:54.305 DEBUG:teuthology.orchestra.run.trial111:> sudo ceph --cluster ceph osd crush tunables default 2026-02-17T11:53:54.407 INFO:teuthology.orchestra.run.trial111.stderr:adjusted tunables profile to default 2026-02-17T11:53:54.415 INFO:tasks.ceph:check_enable_crimson: False 2026-02-17T11:53:54.415 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-17T11:53:54.415 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-17T11:53:54.415 DEBUG:teuthology.orchestra.run.trial111:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-17T11:53:54.440 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-17T11:53:54.440 DEBUG:teuthology.orchestra.run.trial111:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-17T11:53:54.505 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-17T11:53:54.505 DEBUG:teuthology.orchestra.run.trial111:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-17T11:53:54.570 DEBUG:teuthology.orchestra.run.trial111:> sudo ceph --cluster ceph osd new 2100a40a-c685-4262-8d9d-adb86669012c 0 2026-02-17T11:53:54.712 INFO:teuthology.orchestra.run.trial111.stdout:0 2026-02-17T11:53:54.717 INFO:tasks.ceph.mgr.x.trial111.stderr:2026-02-17T11:53:54.715+0000 7efe721ca140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-17T11:53:54.721 DEBUG:teuthology.orchestra.run.trial111:> sudo ceph --cluster ceph osd new 96a73a27-c806-46a7-91a6-4c2d2a357981 1 2026-02-17T11:53:54.824 INFO:teuthology.orchestra.run.trial111.stdout:1 2026-02-17T11:53:54.833 DEBUG:teuthology.orchestra.run.trial111:> sudo ceph --cluster ceph osd new 1ab737cb-5eb6-42c2-b7bb-21f6794d7912 2 2026-02-17T11:53:54.840 INFO:tasks.ceph.mgr.x.trial111.stderr:2026-02-17T11:53:54.838+0000 7efe721ca140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-17T11:53:54.867 INFO:tasks.ceph.mgr.x.trial111.stderr:2026-02-17T11:53:54.866+0000 7efe721ca140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-17T11:53:54.901 INFO:tasks.ceph.mgr.x.trial111.stderr:2026-02-17T11:53:54.900+0000 7efe721ca140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-17T11:53:54.924 INFO:tasks.ceph.mgr.x.trial111.stderr:2026-02-17T11:53:54.923+0000 7efe721ca140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-17T11:53:54.935 INFO:teuthology.orchestra.run.trial111.stdout:2 2026-02-17T11:53:54.944 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-17T11:53:54.944 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-17T11:53:54.951 INFO:tasks.ceph.mgr.x.trial111.stderr:2026-02-17T11:53:54.950+0000 7efe721ca140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-17T11:53:54.952 INFO:tasks.ceph.osd.0:Started 2026-02-17T11:53:54.952 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-17T11:53:54.952 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-02-17T11:53:54.954 INFO:tasks.ceph.osd.1:Started 2026-02-17T11:53:54.954 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-17T11:53:54.954 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2026-02-17T11:53:54.955 INFO:tasks.ceph.osd.2:Started 2026-02-17T11:53:54.955 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:53:55.010 INFO:tasks.ceph.mgr.x.trial111.stderr:2026-02-17T11:53:55.008+0000 7efe721ca140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-17T11:53:55.055 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:53:55.055 INFO:teuthology.orchestra.run.trial111.stdout:{"epoch":5,"fsid":"e0aed382-97c1-4a49-9fc0-e493e1bf10c5","created":"2026-02-17T11:53:54.254177+0000","modified":"2026-02-17T11:53:54.934619+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T11:53:54.934619+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2100a40a-c685-4262-8d9d-adb86669012c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"96a73a27-c806-46a7-91a6-4c2d2a357981","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1ab737cb-5eb6-42c2-b7bb-21f6794d7912","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:53:55.063 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-17T11:53:55.063 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-17T11:53:55.072 INFO:tasks.ceph.mgr.x.trial111.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-17T11:53:55.072 INFO:tasks.ceph.mgr.x.trial111.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-17T11:53:55.072 INFO:tasks.ceph.mgr.x.trial111.stderr: from numpy import show_config as show_numpy_config 2026-02-17T11:53:55.076 INFO:tasks.ceph.mgr.x.trial111.stderr:2026-02-17T11:53:55.074+0000 7efe721ca140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-17T11:53:55.102 INFO:tasks.ceph.mgr.x.trial111.stderr:2026-02-17T11:53:55.100+0000 7efe721ca140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-17T11:53:55.157 INFO:tasks.ceph.mgr.x.trial111.stderr:2026-02-17T11:53:55.156+0000 7efe721ca140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-17T11:53:55.200 INFO:tasks.ceph.mgr.x.trial111.stderr:2026-02-17T11:53:55.199+0000 7efe721ca140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-17T11:53:55.226 INFO:tasks.ceph.mgr.x.trial111.stderr:2026-02-17T11:53:55.225+0000 7efe721ca140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-17T11:53:55.251 INFO:tasks.ceph.mgr.x.trial111.stderr:2026-02-17T11:53:55.249+0000 7efe721ca140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-17T11:53:55.276 INFO:tasks.ceph.mgr.x.trial111.stderr:2026-02-17T11:53:55.275+0000 7efe721ca140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-17T11:53:55.298 INFO:tasks.ceph.mgr.x.trial111.stderr:2026-02-17T11:53:55.297+0000 7efe721ca140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-17T11:53:55.366 DEBUG:teuthology.orchestra.run.trial111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T11:53:55.458 INFO:teuthology.misc.health.trial111.stdout: 2026-02-17T11:53:55.458 INFO:teuthology.misc.health.trial111.stdout:{"epoch":5,"fsid":"e0aed382-97c1-4a49-9fc0-e493e1bf10c5","created":"2026-02-17T11:53:54.254177+0000","modified":"2026-02-17T11:53:54.934619+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T11:53:54.934619+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2100a40a-c685-4262-8d9d-adb86669012c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"96a73a27-c806-46a7-91a6-4c2d2a357981","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1ab737cb-5eb6-42c2-b7bb-21f6794d7912","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:53:55.465 DEBUG:teuthology.misc:0 of 3 OSDs are up 2026-02-17T11:53:55.495 INFO:tasks.ceph.mgr.x.trial111.stderr:2026-02-17T11:53:55.494+0000 7efe721ca140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-17T11:53:55.550 INFO:tasks.ceph.mgr.x.trial111.stderr:2026-02-17T11:53:55.549+0000 7efe721ca140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-17T11:53:55.573 INFO:tasks.ceph.mgr.x.trial111.stderr:2026-02-17T11:53:55.572+0000 7efe721ca140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-17T11:53:55.596 INFO:tasks.ceph.mgr.x.trial111.stderr:2026-02-17T11:53:55.595+0000 7efe721ca140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-17T11:53:55.650 INFO:tasks.ceph.mgr.x.trial111.stderr:2026-02-17T11:53:55.649+0000 7efe721ca140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-17T11:53:55.671 INFO:tasks.ceph.mgr.x.trial111.stderr:2026-02-17T11:53:55.670+0000 7efe721ca140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-17T11:53:55.724 INFO:tasks.ceph.mgr.x.trial111.stderr:2026-02-17T11:53:55.722+0000 7efe721ca140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-17T11:53:56.118 INFO:tasks.ceph.mgr.x.trial111.stderr:2026-02-17T11:53:56.116+0000 7efe721ca140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-17T11:53:56.140 INFO:tasks.ceph.mgr.x.trial111.stderr:2026-02-17T11:53:56.138+0000 7efe721ca140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-17T11:53:56.396 INFO:tasks.ceph.osd.2.trial111.stderr:2026-02-17T11:53:56.394+0000 7fd33329d780 -1 Falling back to public interface 2026-02-17T11:53:56.485 INFO:tasks.ceph.mgr.x.trial111.stderr:2026-02-17T11:53:56.484+0000 7efe721ca140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-17T11:53:56.875 INFO:tasks.ceph.osd.1.trial111.stderr:2026-02-17T11:53:56.873+0000 7f7c19a14780 -1 Falling back to public interface 2026-02-17T11:53:56.896 INFO:tasks.ceph.osd.0.trial111.stderr:2026-02-17T11:53:56.895+0000 7f24add95780 -1 Falling back to public interface 2026-02-17T11:53:57.491 INFO:tasks.ceph.mgr.x.trial111.stderr:2026-02-17T11:53:57.490+0000 7efd8ee5f640 -1 mgr.server handle_report got status from non-daemon mon.a 2026-02-17T11:53:59.616 INFO:tasks.ceph.osd.2.trial111.stderr:2026-02-17T11:53:59.615+0000 7fd33329d780 -1 osd.2 0 log_to_monitors true 2026-02-17T11:53:59.823 INFO:tasks.ceph.osd.1.trial111.stderr:2026-02-17T11:53:59.821+0000 7f7c19a14780 -1 osd.1 0 log_to_monitors true 2026-02-17T11:54:00.123 INFO:tasks.ceph.osd.0.trial111.stderr:2026-02-17T11:54:00.122+0000 7f24add95780 -1 osd.0 0 log_to_monitors true 2026-02-17T11:54:01.510 INFO:tasks.ceph.osd.1.trial111.stderr:2026-02-17T11:54:01.509+0000 7f7c1536e640 -1 osd.1 0 waiting for initial osdmap 2026-02-17T11:54:01.520 INFO:tasks.ceph.osd.2.trial111.stderr:2026-02-17T11:54:01.519+0000 7fd32f22c640 -1 osd.2 0 waiting for initial osdmap 2026-02-17T11:54:01.521 INFO:tasks.ceph.osd.2.trial111.stderr:2026-02-17T11:54:01.520+0000 7fd32b056640 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:54:01.526 INFO:tasks.ceph.osd.1.trial111.stderr:2026-02-17T11:54:01.524+0000 7f7c11198640 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:54:01.690 INFO:tasks.ceph.osd.0.trial111.stderr:2026-02-17T11:54:01.688+0000 7f24a9d24640 -1 osd.0 0 waiting for initial osdmap 2026-02-17T11:54:01.699 INFO:tasks.ceph.osd.0.trial111.stderr:2026-02-17T11:54:01.698+0000 7f24a1b46640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:54:01.768 DEBUG:teuthology.orchestra.run.trial111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T11:54:01.918 INFO:teuthology.misc.health.trial111.stdout: 2026-02-17T11:54:01.918 INFO:teuthology.misc.health.trial111.stdout:{"epoch":7,"fsid":"e0aed382-97c1-4a49-9fc0-e493e1bf10c5","created":"2026-02-17T11:53:54.254177+0000","modified":"2026-02-17T11:54:01.493323+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T11:53:54.934619+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2100a40a-c685-4262-8d9d-adb86669012c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"96a73a27-c806-46a7-91a6-4c2d2a357981","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1ab737cb-5eb6-42c2-b7bb-21f6794d7912","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:54:01.926 DEBUG:teuthology.misc:0 of 3 OSDs are up 2026-02-17T11:54:08.228 DEBUG:teuthology.orchestra.run.trial111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T11:54:08.380 INFO:teuthology.misc.health.trial111.stdout: 2026-02-17T11:54:08.380 INFO:teuthology.misc.health.trial111.stdout:{"epoch":8,"fsid":"e0aed382-97c1-4a49-9fc0-e493e1bf10c5","created":"2026-02-17T11:53:54.254177+0000","modified":"2026-02-17T11:54:02.495464+0000","last_up_change":"2026-02-17T11:54:02.495464+0000","last_in_change":"2026-02-17T11:53:54.934619+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2100a40a-c685-4262-8d9d-adb86669012c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6818","nonce":32633150},{"type":"v1","addr":"10.20.193.111:6819","nonce":32633150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6820","nonce":32633150},{"type":"v1","addr":"10.20.193.111:6821","nonce":32633150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6824","nonce":32633150},{"type":"v1","addr":"10.20.193.111:6825","nonce":32633150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6822","nonce":32633150},{"type":"v1","addr":"10.20.193.111:6823","nonce":32633150}]},"public_addr":"10.20.193.111:6819/32633150","cluster_addr":"10.20.193.111:6821/32633150","heartbeat_back_addr":"10.20.193.111:6825/32633150","heartbeat_front_addr":"10.20.193.111:6823/32633150","state":["exists","up"]},{"osd":1,"uuid":"96a73a27-c806-46a7-91a6-4c2d2a357981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6810","nonce":1136208209},{"type":"v1","addr":"10.20.193.111:6811","nonce":1136208209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6812","nonce":1136208209},{"type":"v1","addr":"10.20.193.111:6813","nonce":1136208209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6816","nonce":1136208209},{"type":"v1","addr":"10.20.193.111:6817","nonce":1136208209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6814","nonce":1136208209},{"type":"v1","addr":"10.20.193.111:6815","nonce":1136208209}]},"public_addr":"10.20.193.111:6811/1136208209","cluster_addr":"10.20.193.111:6813/1136208209","heartbeat_back_addr":"10.20.193.111:6817/1136208209","heartbeat_front_addr":"10.20.193.111:6815/1136208209","state":["exists","up"]},{"osd":2,"uuid":"1ab737cb-5eb6-42c2-b7bb-21f6794d7912","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6800","nonce":2365909075},{"type":"v1","addr":"10.20.193.111:6801","nonce":2365909075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6802","nonce":2365909075},{"type":"v1","addr":"10.20.193.111:6803","nonce":2365909075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6806","nonce":2365909075},{"type":"v1","addr":"10.20.193.111:6807","nonce":2365909075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6804","nonce":2365909075},{"type":"v1","addr":"10.20.193.111:6805","nonce":2365909075}]},"public_addr":"10.20.193.111:6801/2365909075","cluster_addr":"10.20.193.111:6803/2365909075","heartbeat_back_addr":"10.20.193.111:6807/2365909075","heartbeat_front_addr":"10.20.193.111:6805/2365909075","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:54:08.387 DEBUG:teuthology.misc:3 of 3 OSDs are up 2026-02-17T11:54:08.387 INFO:tasks.ceph:Creating RBD pool 2026-02-17T11:54:08.388 DEBUG:teuthology.orchestra.run.trial111:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-17T11:54:09.507 INFO:teuthology.orchestra.run.trial111.stderr:pool 'rbd' created 2026-02-17T11:54:09.519 DEBUG:teuthology.orchestra.run.trial111:> rbd --cluster ceph pool init rbd 2026-02-17T11:54:12.519 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-17T11:54:12.519 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-17T11:54:12.520 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-17T11:54:12.520 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-17T11:54:12.521 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-17T11:54:12.698 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:54:12.707 INFO:teuthology.orchestra.run.trial111.stdout:{"epoch":4,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6808","nonce":1585417485},{"type":"v1","addr":"10.20.193.111:6809","nonce":1585417485}]},"active_addr":"10.20.193.111:6809/1585417485","active_change":"2026-02-17T11:53:56.485745+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.111:0","nonce":664603669}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.111:0","nonce":4094105102}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.111:0","nonce":3150470813}]}]} 2026-02-17T11:54:12.708 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-17T11:54:12.708 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-17T11:54:12.708 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:54:12.869 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:54:12.869 INFO:teuthology.orchestra.run.trial111.stdout:{"epoch":12,"fsid":"e0aed382-97c1-4a49-9fc0-e493e1bf10c5","created":"2026-02-17T11:53:54.254177+0000","modified":"2026-02-17T11:54:12.510379+0000","last_up_change":"2026-02-17T11:54:02.495464+0000","last_in_change":"2026-02-17T11:53:54.934619+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-17T11:54:08.544352+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":12,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2100a40a-c685-4262-8d9d-adb86669012c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6818","nonce":32633150},{"type":"v1","addr":"10.20.193.111:6819","nonce":32633150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6820","nonce":32633150},{"type":"v1","addr":"10.20.193.111:6821","nonce":32633150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6824","nonce":32633150},{"type":"v1","addr":"10.20.193.111:6825","nonce":32633150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6822","nonce":32633150},{"type":"v1","addr":"10.20.193.111:6823","nonce":32633150}]},"public_addr":"10.20.193.111:6819/32633150","cluster_addr":"10.20.193.111:6821/32633150","heartbeat_back_addr":"10.20.193.111:6825/32633150","heartbeat_front_addr":"10.20.193.111:6823/32633150","state":["exists","up"]},{"osd":1,"uuid":"96a73a27-c806-46a7-91a6-4c2d2a357981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6810","nonce":1136208209},{"type":"v1","addr":"10.20.193.111:6811","nonce":1136208209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6812","nonce":1136208209},{"type":"v1","addr":"10.20.193.111:6813","nonce":1136208209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6816","nonce":1136208209},{"type":"v1","addr":"10.20.193.111:6817","nonce":1136208209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6814","nonce":1136208209},{"type":"v1","addr":"10.20.193.111:6815","nonce":1136208209}]},"public_addr":"10.20.193.111:6811/1136208209","cluster_addr":"10.20.193.111:6813/1136208209","heartbeat_back_addr":"10.20.193.111:6817/1136208209","heartbeat_front_addr":"10.20.193.111:6815/1136208209","state":["exists","up"]},{"osd":2,"uuid":"1ab737cb-5eb6-42c2-b7bb-21f6794d7912","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6800","nonce":2365909075},{"type":"v1","addr":"10.20.193.111:6801","nonce":2365909075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6802","nonce":2365909075},{"type":"v1","addr":"10.20.193.111:6803","nonce":2365909075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6806","nonce":2365909075},{"type":"v1","addr":"10.20.193.111:6807","nonce":2365909075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6804","nonce":2365909075},{"type":"v1","addr":"10.20.193.111:6805","nonce":2365909075}]},"public_addr":"10.20.193.111:6801/2365909075","cluster_addr":"10.20.193.111:6803/2365909075","heartbeat_back_addr":"10.20.193.111:6807/2365909075","heartbeat_front_addr":"10.20.193.111:6805/2365909075","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:54:12.879 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-17T11:54:12.880 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:54:13.043 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:54:13.043 INFO:teuthology.orchestra.run.trial111.stdout:{"epoch":12,"fsid":"e0aed382-97c1-4a49-9fc0-e493e1bf10c5","created":"2026-02-17T11:53:54.254177+0000","modified":"2026-02-17T11:54:12.510379+0000","last_up_change":"2026-02-17T11:54:02.495464+0000","last_in_change":"2026-02-17T11:53:54.934619+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-17T11:54:08.544352+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":12,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2100a40a-c685-4262-8d9d-adb86669012c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6818","nonce":32633150},{"type":"v1","addr":"10.20.193.111:6819","nonce":32633150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6820","nonce":32633150},{"type":"v1","addr":"10.20.193.111:6821","nonce":32633150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6824","nonce":32633150},{"type":"v1","addr":"10.20.193.111:6825","nonce":32633150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6822","nonce":32633150},{"type":"v1","addr":"10.20.193.111:6823","nonce":32633150}]},"public_addr":"10.20.193.111:6819/32633150","cluster_addr":"10.20.193.111:6821/32633150","heartbeat_back_addr":"10.20.193.111:6825/32633150","heartbeat_front_addr":"10.20.193.111:6823/32633150","state":["exists","up"]},{"osd":1,"uuid":"96a73a27-c806-46a7-91a6-4c2d2a357981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6810","nonce":1136208209},{"type":"v1","addr":"10.20.193.111:6811","nonce":1136208209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6812","nonce":1136208209},{"type":"v1","addr":"10.20.193.111:6813","nonce":1136208209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6816","nonce":1136208209},{"type":"v1","addr":"10.20.193.111:6817","nonce":1136208209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6814","nonce":1136208209},{"type":"v1","addr":"10.20.193.111:6815","nonce":1136208209}]},"public_addr":"10.20.193.111:6811/1136208209","cluster_addr":"10.20.193.111:6813/1136208209","heartbeat_back_addr":"10.20.193.111:6817/1136208209","heartbeat_front_addr":"10.20.193.111:6815/1136208209","state":["exists","up"]},{"osd":2,"uuid":"1ab737cb-5eb6-42c2-b7bb-21f6794d7912","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6800","nonce":2365909075},{"type":"v1","addr":"10.20.193.111:6801","nonce":2365909075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6802","nonce":2365909075},{"type":"v1","addr":"10.20.193.111:6803","nonce":2365909075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6806","nonce":2365909075},{"type":"v1","addr":"10.20.193.111:6807","nonce":2365909075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6804","nonce":2365909075},{"type":"v1","addr":"10.20.193.111:6805","nonce":2365909075}]},"public_addr":"10.20.193.111:6801/2365909075","cluster_addr":"10.20.193.111:6803/2365909075","heartbeat_back_addr":"10.20.193.111:6807/2365909075","heartbeat_front_addr":"10.20.193.111:6805/2365909075","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:54:13.052 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:54:13.053 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:54:13.053 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:54:13.142 INFO:teuthology.orchestra.run.trial111.stdout:34359738372 2026-02-17T11:54:13.142 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:54:13.143 INFO:teuthology.orchestra.run.trial111.stdout:34359738373 2026-02-17T11:54:13.144 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:54:13.145 INFO:teuthology.orchestra.run.trial111.stdout:34359738372 2026-02-17T11:54:13.145 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:54:13.338 INFO:teuthology.orchestra.run.trial111.stdout:34359738371 2026-02-17T11:54:13.342 INFO:teuthology.orchestra.run.trial111.stdout:34359738372 2026-02-17T11:54:13.344 INFO:teuthology.orchestra.run.trial111.stdout:34359738371 2026-02-17T11:54:13.348 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738371 for osd.2 2026-02-17T11:54:13.352 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738372 for osd.0 2026-02-17T11:54:13.354 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738371 for osd.1 2026-02-17T11:54:14.349 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:54:14.353 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:54:14.355 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:54:14.509 INFO:teuthology.orchestra.run.trial111.stdout:34359738371 2026-02-17T11:54:14.520 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738371 for osd.2 2026-02-17T11:54:14.553 INFO:teuthology.orchestra.run.trial111.stdout:34359738373 2026-02-17T11:54:14.557 INFO:teuthology.orchestra.run.trial111.stdout:34359738374 2026-02-17T11:54:14.562 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738373 for osd.1 2026-02-17T11:54:14.562 DEBUG:teuthology.parallel:result is None 2026-02-17T11:54:14.567 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738374 for osd.0 2026-02-17T11:54:14.567 DEBUG:teuthology.parallel:result is None 2026-02-17T11:54:15.520 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:54:15.675 INFO:teuthology.orchestra.run.trial111.stdout:34359738373 2026-02-17T11:54:15.684 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738373 for osd.2 2026-02-17T11:54:15.684 DEBUG:teuthology.parallel:result is None 2026-02-17T11:54:15.684 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-17T11:54:15.685 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:54:15.840 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:54:15.841 INFO:teuthology.orchestra.run.trial111.stderr:dumped all 2026-02-17T11:54:15.849 INFO:teuthology.orchestra.run.trial111.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2026-02-17T11:54:14.489838+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":81220,"kb_used_data":320,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":314491580,"statfs":{"total":322122547200,"available":322039377920,"internally_reserved":0,"allocated":327680,"data_stored":81620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82767186},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T11:54:12.515246+0000","last_change":"2026-02-17T11:54:12.515246+0000","last_active":"2026-02-17T11:54:12.515246+0000","last_peered":"2026-02-17T11:54:12.515246+0000","last_clean":"2026-02-17T11:54:12.515246+0000","last_became_active":"2026-02-17T11:54:10.512332+0000","last_became_peered":"2026-02-17T11:54:10.512332+0000","last_unstale":"2026-02-17T11:54:12.515246+0000","last_undegraded":"2026-02-17T11:54:12.515246+0000","last_fullsized":"2026-02-17T11:54:12.515246+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:08:48.093975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043342499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T11:54:12.514976+0000","last_change":"2026-02-17T11:54:12.514976+0000","last_active":"2026-02-17T11:54:12.514976+0000","last_peered":"2026-02-17T11:54:12.514976+0000","last_clean":"2026-02-17T11:54:12.514976+0000","last_became_active":"2026-02-17T11:54:10.512549+0000","last_became_peered":"2026-02-17T11:54:10.512549+0000","last_unstale":"2026-02-17T11:54:12.514976+0000","last_undegraded":"2026-02-17T11:54:12.514976+0000","last_fullsized":"2026-02-17T11:54:12.514976+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T17:17:11.200247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000176157,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T11:54:12.512566+0000","last_change":"2026-02-17T11:54:12.512566+0000","last_active":"2026-02-17T11:54:12.512566+0000","last_peered":"2026-02-17T11:54:12.512566+0000","last_clean":"2026-02-17T11:54:12.512566+0000","last_became_active":"2026-02-17T11:54:10.512020+0000","last_became_peered":"2026-02-17T11:54:10.512020+0000","last_unstale":"2026-02-17T11:54:12.512566+0000","last_undegraded":"2026-02-17T11:54:12.512566+0000","last_fullsized":"2026-02-17T11:54:12.512566+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:10:33.476467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000232532,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T11:54:12.515052+0000","last_change":"2026-02-17T11:54:12.515052+0000","last_active":"2026-02-17T11:54:12.515052+0000","last_peered":"2026-02-17T11:54:12.515052+0000","last_clean":"2026-02-17T11:54:12.515052+0000","last_became_active":"2026-02-17T11:54:10.512514+0000","last_became_peered":"2026-02-17T11:54:10.512514+0000","last_unstale":"2026-02-17T11:54:12.515052+0000","last_undegraded":"2026-02-17T11:54:12.515052+0000","last_fullsized":"2026-02-17T11:54:12.515052+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:19:39.263096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025007499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.3","version":"10'1","reported_seq":20,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T11:54:12.515074+0000","last_change":"2026-02-17T11:54:12.515074+0000","last_active":"2026-02-17T11:54:12.515074+0000","last_peered":"2026-02-17T11:54:12.515074+0000","last_clean":"2026-02-17T11:54:12.515074+0000","last_became_active":"2026-02-17T11:54:10.512167+0000","last_became_peered":"2026-02-17T11:54:10.512167+0000","last_unstale":"2026-02-17T11:54:12.515074+0000","last_undegraded":"2026-02-17T11:54:12.515074+0000","last_fullsized":"2026-02-17T11:54:12.515074+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:39:07.853573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026985099999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.2","version":"12'2","reported_seq":21,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T11:54:12.514568+0000","last_change":"2026-02-17T11:54:12.514277+0000","last_active":"2026-02-17T11:54:12.514568+0000","last_peered":"2026-02-17T11:54:12.514568+0000","last_clean":"2026-02-17T11:54:12.514568+0000","last_became_active":"2026-02-17T11:54:10.512290+0000","last_became_peered":"2026-02-17T11:54:10.512290+0000","last_unstale":"2026-02-17T11:54:12.514568+0000","last_undegraded":"2026-02-17T11:54:12.514568+0000","last_fullsized":"2026-02-17T11:54:12.514568+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:47:01.655250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074857000000000005,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T11:54:12.512568+0000","last_change":"2026-02-17T11:54:12.512568+0000","last_active":"2026-02-17T11:54:12.512568+0000","last_peered":"2026-02-17T11:54:12.512568+0000","last_clean":"2026-02-17T11:54:12.512568+0000","last_became_active":"2026-02-17T11:54:10.512150+0000","last_became_peered":"2026-02-17T11:54:10.512150+0000","last_unstale":"2026-02-17T11:54:12.512568+0000","last_undegraded":"2026-02-17T11:54:12.512568+0000","last_fullsized":"2026-02-17T11:54:12.512568+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:07:24.737813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00020471000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T11:54:12.514938+0000","last_change":"2026-02-17T11:54:12.514938+0000","last_active":"2026-02-17T11:54:12.514938+0000","last_peered":"2026-02-17T11:54:12.514938+0000","last_clean":"2026-02-17T11:54:12.514938+0000","last_became_active":"2026-02-17T11:54:10.512283+0000","last_became_peered":"2026-02-17T11:54:10.512283+0000","last_unstale":"2026-02-17T11:54:12.514938+0000","last_undegraded":"2026-02-17T11:54:12.514938+0000","last_fullsized":"2026-02-17T11:54:12.514938+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:38:53.546987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017416299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27072,"kb_used_data":104,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830528,"statfs":{"total":107374182400,"available":107346460672,"internally_reserved":0,"allocated":106496,"data_stored":27194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27072,"kb_used_data":108,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830528,"statfs":{"total":107374182400,"available":107346460672,"internally_reserved":0,"allocated":110592,"data_stored":27213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27076,"kb_used_data":108,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830524,"statfs":{"total":107374182400,"available":107346456576,"internally_reserved":0,"allocated":110592,"data_stored":27213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:54:15.850 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:54:16.004 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:54:16.005 INFO:teuthology.orchestra.run.trial111.stderr:dumped all 2026-02-17T11:54:16.012 INFO:teuthology.orchestra.run.trial111.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2026-02-17T11:54:14.489838+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":81220,"kb_used_data":320,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":314491580,"statfs":{"total":322122547200,"available":322039377920,"internally_reserved":0,"allocated":327680,"data_stored":81620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82767186},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T11:54:12.515246+0000","last_change":"2026-02-17T11:54:12.515246+0000","last_active":"2026-02-17T11:54:12.515246+0000","last_peered":"2026-02-17T11:54:12.515246+0000","last_clean":"2026-02-17T11:54:12.515246+0000","last_became_active":"2026-02-17T11:54:10.512332+0000","last_became_peered":"2026-02-17T11:54:10.512332+0000","last_unstale":"2026-02-17T11:54:12.515246+0000","last_undegraded":"2026-02-17T11:54:12.515246+0000","last_fullsized":"2026-02-17T11:54:12.515246+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:08:48.093975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043342499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T11:54:12.514976+0000","last_change":"2026-02-17T11:54:12.514976+0000","last_active":"2026-02-17T11:54:12.514976+0000","last_peered":"2026-02-17T11:54:12.514976+0000","last_clean":"2026-02-17T11:54:12.514976+0000","last_became_active":"2026-02-17T11:54:10.512549+0000","last_became_peered":"2026-02-17T11:54:10.512549+0000","last_unstale":"2026-02-17T11:54:12.514976+0000","last_undegraded":"2026-02-17T11:54:12.514976+0000","last_fullsized":"2026-02-17T11:54:12.514976+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T17:17:11.200247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000176157,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T11:54:12.512566+0000","last_change":"2026-02-17T11:54:12.512566+0000","last_active":"2026-02-17T11:54:12.512566+0000","last_peered":"2026-02-17T11:54:12.512566+0000","last_clean":"2026-02-17T11:54:12.512566+0000","last_became_active":"2026-02-17T11:54:10.512020+0000","last_became_peered":"2026-02-17T11:54:10.512020+0000","last_unstale":"2026-02-17T11:54:12.512566+0000","last_undegraded":"2026-02-17T11:54:12.512566+0000","last_fullsized":"2026-02-17T11:54:12.512566+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:10:33.476467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000232532,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T11:54:12.515052+0000","last_change":"2026-02-17T11:54:12.515052+0000","last_active":"2026-02-17T11:54:12.515052+0000","last_peered":"2026-02-17T11:54:12.515052+0000","last_clean":"2026-02-17T11:54:12.515052+0000","last_became_active":"2026-02-17T11:54:10.512514+0000","last_became_peered":"2026-02-17T11:54:10.512514+0000","last_unstale":"2026-02-17T11:54:12.515052+0000","last_undegraded":"2026-02-17T11:54:12.515052+0000","last_fullsized":"2026-02-17T11:54:12.515052+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:19:39.263096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025007499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.3","version":"10'1","reported_seq":20,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T11:54:12.515074+0000","last_change":"2026-02-17T11:54:12.515074+0000","last_active":"2026-02-17T11:54:12.515074+0000","last_peered":"2026-02-17T11:54:12.515074+0000","last_clean":"2026-02-17T11:54:12.515074+0000","last_became_active":"2026-02-17T11:54:10.512167+0000","last_became_peered":"2026-02-17T11:54:10.512167+0000","last_unstale":"2026-02-17T11:54:12.515074+0000","last_undegraded":"2026-02-17T11:54:12.515074+0000","last_fullsized":"2026-02-17T11:54:12.515074+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:39:07.853573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026985099999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.2","version":"12'2","reported_seq":21,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T11:54:12.514568+0000","last_change":"2026-02-17T11:54:12.514277+0000","last_active":"2026-02-17T11:54:12.514568+0000","last_peered":"2026-02-17T11:54:12.514568+0000","last_clean":"2026-02-17T11:54:12.514568+0000","last_became_active":"2026-02-17T11:54:10.512290+0000","last_became_peered":"2026-02-17T11:54:10.512290+0000","last_unstale":"2026-02-17T11:54:12.514568+0000","last_undegraded":"2026-02-17T11:54:12.514568+0000","last_fullsized":"2026-02-17T11:54:12.514568+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:47:01.655250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074857000000000005,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T11:54:12.512568+0000","last_change":"2026-02-17T11:54:12.512568+0000","last_active":"2026-02-17T11:54:12.512568+0000","last_peered":"2026-02-17T11:54:12.512568+0000","last_clean":"2026-02-17T11:54:12.512568+0000","last_became_active":"2026-02-17T11:54:10.512150+0000","last_became_peered":"2026-02-17T11:54:10.512150+0000","last_unstale":"2026-02-17T11:54:12.512568+0000","last_undegraded":"2026-02-17T11:54:12.512568+0000","last_fullsized":"2026-02-17T11:54:12.512568+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:07:24.737813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00020471000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T11:54:12.514938+0000","last_change":"2026-02-17T11:54:12.514938+0000","last_active":"2026-02-17T11:54:12.514938+0000","last_peered":"2026-02-17T11:54:12.514938+0000","last_clean":"2026-02-17T11:54:12.514938+0000","last_became_active":"2026-02-17T11:54:10.512283+0000","last_became_peered":"2026-02-17T11:54:10.512283+0000","last_unstale":"2026-02-17T11:54:12.514938+0000","last_undegraded":"2026-02-17T11:54:12.514938+0000","last_fullsized":"2026-02-17T11:54:12.514938+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:38:53.546987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017416299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27072,"kb_used_data":104,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830528,"statfs":{"total":107374182400,"available":107346460672,"internally_reserved":0,"allocated":106496,"data_stored":27194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27072,"kb_used_data":108,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830528,"statfs":{"total":107374182400,"available":107346460672,"internally_reserved":0,"allocated":110592,"data_stored":27213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27076,"kb_used_data":108,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830524,"statfs":{"total":107374182400,"available":107346456576,"internally_reserved":0,"allocated":110592,"data_stored":27213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:54:16.013 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-17T11:54:16.014 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-17T11:54:16.014 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-17T11:54:16.014 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:54:16.186 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:54:16.186 INFO:teuthology.orchestra.run.trial111.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-17T11:54:16.195 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-17T11:54:16.195 INFO:teuthology.run_tasks:Running task exec... 2026-02-17T11:54:16.203 INFO:teuthology.task.exec:Executing custom commands... 2026-02-17T11:54:16.203 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@trial111.front.sepia.ceph.com 2026-02-17T11:54:16.203 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_snap_mapper 2026-02-17T11:54:16.239 INFO:teuthology.orchestra.run.trial111.stdout:[==========] Running 12 tests from 3 test suites. 2026-02-17T11:54:16.239 INFO:teuthology.orchestra.run.trial111.stdout:[----------] Global test environment set-up. 2026-02-17T11:54:16.239 INFO:teuthology.orchestra.run.trial111.stdout:[----------] 2 tests from MapCacherTest 2026-02-17T11:54:16.239 INFO:teuthology.orchestra.run.trial111.stdout:[ RUN ] MapCacherTest.Simple 2026-02-17T11:54:17.239 INFO:teuthology.orchestra.run.trial111.stdout:[ OK ] MapCacherTest.Simple (1000 ms) 2026-02-17T11:54:17.240 INFO:teuthology.orchestra.run.trial111.stdout:[ RUN ] MapCacherTest.Random 2026-02-17T11:54:17.240 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 0 2026-02-17T11:54:17.240 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 50 2026-02-17T11:54:17.241 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 100 2026-02-17T11:54:17.243 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 150 2026-02-17T11:54:17.316 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 200 2026-02-17T11:54:17.317 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 250 2026-02-17T11:54:17.410 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 300 2026-02-17T11:54:17.411 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 350 2026-02-17T11:54:17.413 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 400 2026-02-17T11:54:17.487 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 450 2026-02-17T11:54:17.568 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 500 2026-02-17T11:54:17.569 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 550 2026-02-17T11:54:17.652 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 600 2026-02-17T11:54:17.653 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 650 2026-02-17T11:54:17.654 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 700 2026-02-17T11:54:17.730 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 750 2026-02-17T11:54:17.803 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 800 2026-02-17T11:54:17.805 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 850 2026-02-17T11:54:17.879 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 900 2026-02-17T11:54:17.880 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 950 2026-02-17T11:54:17.976 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 1000 2026-02-17T11:54:17.977 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 1050 2026-02-17T11:54:18.061 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 1100 2026-02-17T11:54:18.063 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 1150 2026-02-17T11:54:18.064 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 1200 2026-02-17T11:54:18.145 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 1250 2026-02-17T11:54:18.146 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 1300 2026-02-17T11:54:18.215 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 1350 2026-02-17T11:54:18.293 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 1400 2026-02-17T11:54:18.294 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 1450 2026-02-17T11:54:18.369 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 1500 2026-02-17T11:54:18.379 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 1550 2026-02-17T11:54:18.475 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 1600 2026-02-17T11:54:18.476 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 1650 2026-02-17T11:54:18.567 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 1700 2026-02-17T11:54:18.568 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 1750 2026-02-17T11:54:18.651 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 1800 2026-02-17T11:54:18.652 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 1850 2026-02-17T11:54:18.708 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 1900 2026-02-17T11:54:18.710 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 1950 2026-02-17T11:54:18.789 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 2000 2026-02-17T11:54:18.790 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 2050 2026-02-17T11:54:18.872 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 2100 2026-02-17T11:54:18.873 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 2150 2026-02-17T11:54:18.957 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 2200 2026-02-17T11:54:18.958 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 2250 2026-02-17T11:54:19.025 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 2300 2026-02-17T11:54:19.026 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 2350 2026-02-17T11:54:19.086 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 2400 2026-02-17T11:54:19.086 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 2450 2026-02-17T11:54:19.165 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 2500 2026-02-17T11:54:19.166 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 2550 2026-02-17T11:54:19.246 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 2600 2026-02-17T11:54:19.247 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 2650 2026-02-17T11:54:19.313 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 2700 2026-02-17T11:54:19.314 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 2750 2026-02-17T11:54:19.388 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 2800 2026-02-17T11:54:19.390 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 2850 2026-02-17T11:54:19.464 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 2900 2026-02-17T11:54:19.465 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 2950 2026-02-17T11:54:19.542 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 3000 2026-02-17T11:54:19.543 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 3050 2026-02-17T11:54:19.544 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 3100 2026-02-17T11:54:19.632 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 3150 2026-02-17T11:54:19.712 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 3200 2026-02-17T11:54:19.713 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 3250 2026-02-17T11:54:19.794 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 3300 2026-02-17T11:54:19.795 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 3350 2026-02-17T11:54:19.934 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 3400 2026-02-17T11:54:19.935 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 3450 2026-02-17T11:54:20.006 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 3500 2026-02-17T11:54:20.008 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 3550 2026-02-17T11:54:20.088 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 3600 2026-02-17T11:54:20.089 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 3650 2026-02-17T11:54:20.090 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 3700 2026-02-17T11:54:20.175 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 3750 2026-02-17T11:54:20.176 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 3800 2026-02-17T11:54:20.264 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 3850 2026-02-17T11:54:20.265 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 3900 2026-02-17T11:54:20.348 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 3950 2026-02-17T11:54:20.348 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 4000 2026-02-17T11:54:20.431 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 4050 2026-02-17T11:54:20.432 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 4100 2026-02-17T11:54:20.519 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 4150 2026-02-17T11:54:20.521 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 4200 2026-02-17T11:54:20.593 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 4250 2026-02-17T11:54:20.595 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 4300 2026-02-17T11:54:20.687 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 4350 2026-02-17T11:54:20.688 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 4400 2026-02-17T11:54:20.777 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 4450 2026-02-17T11:54:20.777 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 4500 2026-02-17T11:54:20.831 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 4550 2026-02-17T11:54:20.833 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 4600 2026-02-17T11:54:20.956 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 4650 2026-02-17T11:54:20.957 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 4700 2026-02-17T11:54:21.038 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 4750 2026-02-17T11:54:21.039 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 4800 2026-02-17T11:54:21.155 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 4850 2026-02-17T11:54:21.156 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 4900 2026-02-17T11:54:21.266 INFO:teuthology.orchestra.run.trial111.stdout:On iteration 4950 2026-02-17T11:54:21.428 INFO:teuthology.orchestra.run.trial111.stdout:[ OK ] MapCacherTest.Random (4189 ms) 2026-02-17T11:54:21.428 INFO:teuthology.orchestra.run.trial111.stdout:[----------] 2 tests from MapCacherTest (5189 ms total) 2026-02-17T11:54:21.428 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:54:21.428 INFO:teuthology.orchestra.run.trial111.stdout:[----------] 8 tests from SnapMapperTest 2026-02-17T11:54:21.428 INFO:teuthology.orchestra.run.trial111.stdout:[ RUN ] SnapMapperTest.prefix_itr 2026-02-17T11:54:21.428 INFO:teuthology.orchestra.run.trial111.stdout:osd_debug_trim_objects = 0 2026-02-17T11:54:21.428 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-17T11:54:21.426+0000 7fe3e7bca300 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 0 after trimming was started 2026-02-17T11:54:23.155 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-17T11:54:23.153+0000 7fe3e7bca300 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 0 after trimming was started 2026-02-17T11:54:23.890 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-17T11:54:23.888+0000 7fe3e7bca300 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 0 after trimming was started 2026-02-17T11:54:24.034 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-17T11:54:24.032+0000 7fe3e7bca300 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 0 after trimming was started 2026-02-17T11:54:24.180 INFO:teuthology.orchestra.run.trial111.stdout:[ OK ] SnapMapperTest.prefix_itr (2753 ms) 2026-02-17T11:54:24.180 INFO:teuthology.orchestra.run.trial111.stdout:[ RUN ] SnapMapperTest.Simple 2026-02-17T11:54:24.181 INFO:teuthology.orchestra.run.trial111.stdout:[ OK ] SnapMapperTest.Simple (1 ms) 2026-02-17T11:54:24.181 INFO:teuthology.orchestra.run.trial111.stdout:[ RUN ] SnapMapperTest.More 2026-02-17T11:54:24.181 INFO:teuthology.orchestra.run.trial111.stdout:0 2026-02-17T11:54:24.181 INFO:teuthology.orchestra.run.trial111.stdout:50 2026-02-17T11:54:24.186 INFO:teuthology.orchestra.run.trial111.stdout:100 2026-02-17T11:54:24.381 INFO:teuthology.orchestra.run.trial111.stdout:150 2026-02-17T11:54:24.475 INFO:teuthology.orchestra.run.trial111.stdout:200 2026-02-17T11:54:24.543 INFO:teuthology.orchestra.run.trial111.stdout:250 2026-02-17T11:54:24.655 INFO:teuthology.orchestra.run.trial111.stdout:300 2026-02-17T11:54:24.731 INFO:teuthology.orchestra.run.trial111.stdout:350 2026-02-17T11:54:24.882 INFO:teuthology.orchestra.run.trial111.stdout:400 2026-02-17T11:54:24.942 INFO:teuthology.orchestra.run.trial111.stdout:450 2026-02-17T11:54:25.019 INFO:teuthology.orchestra.run.trial111.stdout:500 2026-02-17T11:54:25.182 INFO:teuthology.orchestra.run.trial111.stdout:550 2026-02-17T11:54:25.263 INFO:teuthology.orchestra.run.trial111.stdout:600 2026-02-17T11:54:25.263 INFO:teuthology.orchestra.run.trial111.stdout:650 2026-02-17T11:54:25.375 INFO:teuthology.orchestra.run.trial111.stdout:700 2026-02-17T11:54:25.484 INFO:teuthology.orchestra.run.trial111.stdout:750 2026-02-17T11:54:25.565 INFO:teuthology.orchestra.run.trial111.stdout:800 2026-02-17T11:54:25.651 INFO:teuthology.orchestra.run.trial111.stdout:850 2026-02-17T11:54:25.720 INFO:teuthology.orchestra.run.trial111.stdout:900 2026-02-17T11:54:25.969 INFO:teuthology.orchestra.run.trial111.stdout:950 2026-02-17T11:54:26.052 INFO:teuthology.orchestra.run.trial111.stdout:1000 2026-02-17T11:54:26.146 INFO:teuthology.orchestra.run.trial111.stdout:1050 2026-02-17T11:54:26.238 INFO:teuthology.orchestra.run.trial111.stdout:1100 2026-02-17T11:54:26.344 INFO:teuthology.orchestra.run.trial111.stdout:1150 2026-02-17T11:54:26.476 INFO:teuthology.orchestra.run.trial111.stdout:1200 2026-02-17T11:54:26.649 INFO:teuthology.orchestra.run.trial111.stdout:1250 2026-02-17T11:54:26.797 INFO:teuthology.orchestra.run.trial111.stdout:1300 2026-02-17T11:54:26.880 INFO:teuthology.orchestra.run.trial111.stdout:1350 2026-02-17T11:54:27.116 INFO:teuthology.orchestra.run.trial111.stdout:1400 2026-02-17T11:54:27.254 INFO:teuthology.orchestra.run.trial111.stdout:1450 2026-02-17T11:54:27.558 INFO:teuthology.orchestra.run.trial111.stdout:1500 2026-02-17T11:54:27.793 INFO:teuthology.orchestra.run.trial111.stdout:1550 2026-02-17T11:54:27.979 INFO:teuthology.orchestra.run.trial111.stdout:1600 2026-02-17T11:54:28.224 INFO:teuthology.orchestra.run.trial111.stdout:1650 2026-02-17T11:54:28.313 INFO:teuthology.orchestra.run.trial111.stdout:1700 2026-02-17T11:54:28.419 INFO:teuthology.orchestra.run.trial111.stdout:1750 2026-02-17T11:54:28.420 INFO:teuthology.orchestra.run.trial111.stdout:1800 2026-02-17T11:54:28.501 INFO:teuthology.orchestra.run.trial111.stdout:1850 2026-02-17T11:54:28.571 INFO:teuthology.orchestra.run.trial111.stdout:1900 2026-02-17T11:54:28.679 INFO:teuthology.orchestra.run.trial111.stdout:1950 2026-02-17T11:54:28.785 INFO:teuthology.orchestra.run.trial111.stdout:2000 2026-02-17T11:54:28.849 INFO:teuthology.orchestra.run.trial111.stdout:2050 2026-02-17T11:54:29.035 INFO:teuthology.orchestra.run.trial111.stdout:2100 2026-02-17T11:54:29.125 INFO:teuthology.orchestra.run.trial111.stdout:2150 2026-02-17T11:54:29.125 INFO:teuthology.orchestra.run.trial111.stdout:2200 2026-02-17T11:54:29.225 INFO:teuthology.orchestra.run.trial111.stdout:2250 2026-02-17T11:54:29.226 INFO:teuthology.orchestra.run.trial111.stdout:2300 2026-02-17T11:54:29.310 INFO:teuthology.orchestra.run.trial111.stdout:2350 2026-02-17T11:54:29.391 INFO:teuthology.orchestra.run.trial111.stdout:2400 2026-02-17T11:54:29.478 INFO:teuthology.orchestra.run.trial111.stdout:2450 2026-02-17T11:54:29.478 INFO:teuthology.orchestra.run.trial111.stdout:2500 2026-02-17T11:54:29.560 INFO:teuthology.orchestra.run.trial111.stdout:2550 2026-02-17T11:54:29.765 INFO:teuthology.orchestra.run.trial111.stdout:2600 2026-02-17T11:54:29.842 INFO:teuthology.orchestra.run.trial111.stdout:2650 2026-02-17T11:54:29.899 INFO:teuthology.orchestra.run.trial111.stdout:2700 2026-02-17T11:54:29.899 INFO:teuthology.orchestra.run.trial111.stdout:2750 2026-02-17T11:54:29.991 INFO:teuthology.orchestra.run.trial111.stdout:2800 2026-02-17T11:54:30.104 INFO:teuthology.orchestra.run.trial111.stdout:2850 2026-02-17T11:54:30.184 INFO:teuthology.orchestra.run.trial111.stdout:2900 2026-02-17T11:54:30.269 INFO:teuthology.orchestra.run.trial111.stdout:2950 2026-02-17T11:54:30.437 INFO:teuthology.orchestra.run.trial111.stdout:3000 2026-02-17T11:54:30.615 INFO:teuthology.orchestra.run.trial111.stdout:3050 2026-02-17T11:54:30.778 INFO:teuthology.orchestra.run.trial111.stdout:3100 2026-02-17T11:54:30.937 INFO:teuthology.orchestra.run.trial111.stdout:3150 2026-02-17T11:54:31.135 INFO:teuthology.orchestra.run.trial111.stdout:3200 2026-02-17T11:54:31.323 INFO:teuthology.orchestra.run.trial111.stdout:3250 2026-02-17T11:54:31.493 INFO:teuthology.orchestra.run.trial111.stdout:3300 2026-02-17T11:54:31.570 INFO:teuthology.orchestra.run.trial111.stdout:3350 2026-02-17T11:54:31.804 INFO:teuthology.orchestra.run.trial111.stdout:3400 2026-02-17T11:54:31.877 INFO:teuthology.orchestra.run.trial111.stdout:3450 2026-02-17T11:54:32.011 INFO:teuthology.orchestra.run.trial111.stdout:3500 2026-02-17T11:54:32.091 INFO:teuthology.orchestra.run.trial111.stdout:3550 2026-02-17T11:54:32.245 INFO:teuthology.orchestra.run.trial111.stdout:3600 2026-02-17T11:54:32.328 INFO:teuthology.orchestra.run.trial111.stdout:3650 2026-02-17T11:54:32.402 INFO:teuthology.orchestra.run.trial111.stdout:3700 2026-02-17T11:54:32.577 INFO:teuthology.orchestra.run.trial111.stdout:3750 2026-02-17T11:54:32.745 INFO:teuthology.orchestra.run.trial111.stdout:3800 2026-02-17T11:54:32.832 INFO:teuthology.orchestra.run.trial111.stdout:3850 2026-02-17T11:54:32.987 INFO:teuthology.orchestra.run.trial111.stdout:3900 2026-02-17T11:54:33.207 INFO:teuthology.orchestra.run.trial111.stdout:3950 2026-02-17T11:54:33.374 INFO:teuthology.orchestra.run.trial111.stdout:4000 2026-02-17T11:54:33.543 INFO:teuthology.orchestra.run.trial111.stdout:4050 2026-02-17T11:54:33.709 INFO:teuthology.orchestra.run.trial111.stdout:4100 2026-02-17T11:54:34.013 INFO:teuthology.orchestra.run.trial111.stdout:4150 2026-02-17T11:54:34.329 INFO:teuthology.orchestra.run.trial111.stdout:4200 2026-02-17T11:54:34.508 INFO:teuthology.orchestra.run.trial111.stdout:4250 2026-02-17T11:54:34.808 INFO:teuthology.orchestra.run.trial111.stdout:4300 2026-02-17T11:54:34.944 INFO:teuthology.orchestra.run.trial111.stdout:4350 2026-02-17T11:54:35.121 INFO:teuthology.orchestra.run.trial111.stdout:4400 2026-02-17T11:54:35.308 INFO:teuthology.orchestra.run.trial111.stdout:4450 2026-02-17T11:54:35.453 INFO:teuthology.orchestra.run.trial111.stdout:4500 2026-02-17T11:54:35.625 INFO:teuthology.orchestra.run.trial111.stdout:4550 2026-02-17T11:54:35.705 INFO:teuthology.orchestra.run.trial111.stdout:4600 2026-02-17T11:54:35.866 INFO:teuthology.orchestra.run.trial111.stdout:4650 2026-02-17T11:54:36.090 INFO:teuthology.orchestra.run.trial111.stdout:4700 2026-02-17T11:54:36.175 INFO:teuthology.orchestra.run.trial111.stdout:4750 2026-02-17T11:54:36.360 INFO:teuthology.orchestra.run.trial111.stdout:4800 2026-02-17T11:54:36.458 INFO:teuthology.orchestra.run.trial111.stdout:4850 2026-02-17T11:54:36.617 INFO:teuthology.orchestra.run.trial111.stdout:4900 2026-02-17T11:54:36.770 INFO:teuthology.orchestra.run.trial111.stdout:4950 2026-02-17T11:54:37.024 INFO:teuthology.orchestra.run.trial111.stdout:[ OK ] SnapMapperTest.More (12841 ms) 2026-02-17T11:54:37.024 INFO:teuthology.orchestra.run.trial111.stdout:[ RUN ] SnapMapperTest.MultiPG 2026-02-17T11:54:37.024 INFO:teuthology.orchestra.run.trial111.stdout:0 2026-02-17T11:54:37.024 INFO:teuthology.orchestra.run.trial111.stdout:50 2026-02-17T11:54:37.024 INFO:teuthology.orchestra.run.trial111.stdout:100 2026-02-17T11:54:37.024 INFO:teuthology.orchestra.run.trial111.stdout:150 2026-02-17T11:54:37.024 INFO:teuthology.orchestra.run.trial111.stdout:200 2026-02-17T11:54:37.024 INFO:teuthology.orchestra.run.trial111.stdout:250 2026-02-17T11:54:37.024 INFO:teuthology.orchestra.run.trial111.stdout:300 2026-02-17T11:54:37.025 INFO:teuthology.orchestra.run.trial111.stdout:350 2026-02-17T11:54:37.106 INFO:teuthology.orchestra.run.trial111.stdout:400 2026-02-17T11:54:37.106 INFO:teuthology.orchestra.run.trial111.stdout:450 2026-02-17T11:54:37.188 INFO:teuthology.orchestra.run.trial111.stdout:500 2026-02-17T11:54:37.189 INFO:teuthology.orchestra.run.trial111.stdout:550 2026-02-17T11:54:37.271 INFO:teuthology.orchestra.run.trial111.stdout:600 2026-02-17T11:54:37.271 INFO:teuthology.orchestra.run.trial111.stdout:650 2026-02-17T11:54:37.271 INFO:teuthology.orchestra.run.trial111.stdout:700 2026-02-17T11:54:37.337 INFO:teuthology.orchestra.run.trial111.stdout:750 2026-02-17T11:54:37.337 INFO:teuthology.orchestra.run.trial111.stdout:800 2026-02-17T11:54:37.337 INFO:teuthology.orchestra.run.trial111.stdout:850 2026-02-17T11:54:37.405 INFO:teuthology.orchestra.run.trial111.stdout:900 2026-02-17T11:54:37.405 INFO:teuthology.orchestra.run.trial111.stdout:950 2026-02-17T11:54:37.491 INFO:teuthology.orchestra.run.trial111.stdout:1000 2026-02-17T11:54:37.491 INFO:teuthology.orchestra.run.trial111.stdout:1050 2026-02-17T11:54:37.583 INFO:teuthology.orchestra.run.trial111.stdout:1100 2026-02-17T11:54:37.583 INFO:teuthology.orchestra.run.trial111.stdout:1150 2026-02-17T11:54:37.688 INFO:teuthology.orchestra.run.trial111.stdout:1200 2026-02-17T11:54:37.766 INFO:teuthology.orchestra.run.trial111.stdout:1250 2026-02-17T11:54:37.829 INFO:teuthology.orchestra.run.trial111.stdout:1300 2026-02-17T11:54:37.829 INFO:teuthology.orchestra.run.trial111.stdout:1350 2026-02-17T11:54:37.916 INFO:teuthology.orchestra.run.trial111.stdout:1400 2026-02-17T11:54:37.971 INFO:teuthology.orchestra.run.trial111.stdout:1450 2026-02-17T11:54:38.056 INFO:teuthology.orchestra.run.trial111.stdout:1500 2026-02-17T11:54:38.056 INFO:teuthology.orchestra.run.trial111.stdout:1550 2026-02-17T11:54:38.155 INFO:teuthology.orchestra.run.trial111.stdout:1600 2026-02-17T11:54:38.156 INFO:teuthology.orchestra.run.trial111.stdout:1650 2026-02-17T11:54:38.246 INFO:teuthology.orchestra.run.trial111.stdout:1700 2026-02-17T11:54:38.346 INFO:teuthology.orchestra.run.trial111.stdout:1750 2026-02-17T11:54:38.433 INFO:teuthology.orchestra.run.trial111.stdout:1800 2026-02-17T11:54:38.433 INFO:teuthology.orchestra.run.trial111.stdout:1850 2026-02-17T11:54:38.514 INFO:teuthology.orchestra.run.trial111.stdout:1900 2026-02-17T11:54:38.605 INFO:teuthology.orchestra.run.trial111.stdout:1950 2026-02-17T11:54:38.682 INFO:teuthology.orchestra.run.trial111.stdout:2000 2026-02-17T11:54:38.683 INFO:teuthology.orchestra.run.trial111.stdout:2050 2026-02-17T11:54:38.793 INFO:teuthology.orchestra.run.trial111.stdout:2100 2026-02-17T11:54:38.873 INFO:teuthology.orchestra.run.trial111.stdout:2150 2026-02-17T11:54:38.873 INFO:teuthology.orchestra.run.trial111.stdout:2200 2026-02-17T11:54:38.938 INFO:teuthology.orchestra.run.trial111.stdout:2250 2026-02-17T11:54:39.128 INFO:teuthology.orchestra.run.trial111.stdout:2300 2026-02-17T11:54:39.203 INFO:teuthology.orchestra.run.trial111.stdout:2350 2026-02-17T11:54:39.287 INFO:teuthology.orchestra.run.trial111.stdout:2400 2026-02-17T11:54:39.407 INFO:teuthology.orchestra.run.trial111.stdout:2450 2026-02-17T11:54:39.521 INFO:teuthology.orchestra.run.trial111.stdout:2500 2026-02-17T11:54:39.618 INFO:teuthology.orchestra.run.trial111.stdout:2550 2026-02-17T11:54:39.717 INFO:teuthology.orchestra.run.trial111.stdout:2600 2026-02-17T11:54:39.792 INFO:teuthology.orchestra.run.trial111.stdout:2650 2026-02-17T11:54:39.879 INFO:teuthology.orchestra.run.trial111.stdout:2700 2026-02-17T11:54:39.947 INFO:teuthology.orchestra.run.trial111.stdout:2750 2026-02-17T11:54:40.035 INFO:teuthology.orchestra.run.trial111.stdout:2800 2026-02-17T11:54:40.128 INFO:teuthology.orchestra.run.trial111.stdout:2850 2026-02-17T11:54:40.232 INFO:teuthology.orchestra.run.trial111.stdout:2900 2026-02-17T11:54:40.336 INFO:teuthology.orchestra.run.trial111.stdout:2950 2026-02-17T11:54:40.427 INFO:teuthology.orchestra.run.trial111.stdout:3000 2026-02-17T11:54:40.524 INFO:teuthology.orchestra.run.trial111.stdout:3050 2026-02-17T11:54:40.524 INFO:teuthology.orchestra.run.trial111.stdout:3100 2026-02-17T11:54:40.610 INFO:teuthology.orchestra.run.trial111.stdout:3150 2026-02-17T11:54:40.718 INFO:teuthology.orchestra.run.trial111.stdout:3200 2026-02-17T11:54:40.819 INFO:teuthology.orchestra.run.trial111.stdout:3250 2026-02-17T11:54:40.920 INFO:teuthology.orchestra.run.trial111.stdout:3300 2026-02-17T11:54:41.006 INFO:teuthology.orchestra.run.trial111.stdout:3350 2026-02-17T11:54:41.092 INFO:teuthology.orchestra.run.trial111.stdout:3400 2026-02-17T11:54:41.146 INFO:teuthology.orchestra.run.trial111.stdout:3450 2026-02-17T11:54:41.146 INFO:teuthology.orchestra.run.trial111.stdout:3500 2026-02-17T11:54:41.221 INFO:teuthology.orchestra.run.trial111.stdout:3550 2026-02-17T11:54:41.303 INFO:teuthology.orchestra.run.trial111.stdout:3600 2026-02-17T11:54:41.386 INFO:teuthology.orchestra.run.trial111.stdout:3650 2026-02-17T11:54:41.476 INFO:teuthology.orchestra.run.trial111.stdout:3700 2026-02-17T11:54:41.545 INFO:teuthology.orchestra.run.trial111.stdout:3750 2026-02-17T11:54:41.658 INFO:teuthology.orchestra.run.trial111.stdout:3800 2026-02-17T11:54:41.742 INFO:teuthology.orchestra.run.trial111.stdout:3850 2026-02-17T11:54:41.826 INFO:teuthology.orchestra.run.trial111.stdout:3900 2026-02-17T11:54:41.909 INFO:teuthology.orchestra.run.trial111.stdout:3950 2026-02-17T11:54:41.910 INFO:teuthology.orchestra.run.trial111.stdout:4000 2026-02-17T11:54:41.988 INFO:teuthology.orchestra.run.trial111.stdout:4050 2026-02-17T11:54:42.171 INFO:teuthology.orchestra.run.trial111.stdout:4100 2026-02-17T11:54:42.171 INFO:teuthology.orchestra.run.trial111.stdout:4150 2026-02-17T11:54:42.268 INFO:teuthology.orchestra.run.trial111.stdout:4200 2026-02-17T11:54:42.350 INFO:teuthology.orchestra.run.trial111.stdout:4250 2026-02-17T11:54:42.462 INFO:teuthology.orchestra.run.trial111.stdout:4300 2026-02-17T11:54:42.538 INFO:teuthology.orchestra.run.trial111.stdout:4350 2026-02-17T11:54:42.641 INFO:teuthology.orchestra.run.trial111.stdout:4400 2026-02-17T11:54:42.731 INFO:teuthology.orchestra.run.trial111.stdout:4450 2026-02-17T11:54:42.833 INFO:teuthology.orchestra.run.trial111.stdout:4500 2026-02-17T11:54:42.934 INFO:teuthology.orchestra.run.trial111.stdout:4550 2026-02-17T11:54:43.031 INFO:teuthology.orchestra.run.trial111.stdout:4600 2026-02-17T11:54:43.090 INFO:teuthology.orchestra.run.trial111.stdout:4650 2026-02-17T11:54:43.194 INFO:teuthology.orchestra.run.trial111.stdout:4700 2026-02-17T11:54:43.287 INFO:teuthology.orchestra.run.trial111.stdout:4750 2026-02-17T11:54:43.365 INFO:teuthology.orchestra.run.trial111.stdout:4800 2026-02-17T11:54:43.506 INFO:teuthology.orchestra.run.trial111.stdout:4850 2026-02-17T11:54:43.585 INFO:teuthology.orchestra.run.trial111.stdout:4900 2026-02-17T11:54:43.642 INFO:teuthology.orchestra.run.trial111.stdout:4950 2026-02-17T11:54:43.822 INFO:teuthology.orchestra.run.trial111.stdout:[ OK ] SnapMapperTest.MultiPG (6799 ms) 2026-02-17T11:54:43.822 INFO:teuthology.orchestra.run.trial111.stdout:[ RUN ] SnapMapperTest.CheckObjectKeyFormat 2026-02-17T11:54:43.823 INFO:teuthology.orchestra.run.trial111.stdout:[ OK ] SnapMapperTest.CheckObjectKeyFormat (0 ms) 2026-02-17T11:54:43.823 INFO:teuthology.orchestra.run.trial111.stdout:[ RUN ] SnapMapperTest.CheckRawKeyFormat 2026-02-17T11:54:43.823 INFO:teuthology.orchestra.run.trial111.stdout:[ OK ] SnapMapperTest.CheckRawKeyFormat (0 ms) 2026-02-17T11:54:43.823 INFO:teuthology.orchestra.run.trial111.stdout:[ RUN ] SnapMapperTest.CheckMakePurgedSnapKeyFormat 2026-02-17T11:54:43.823 INFO:teuthology.orchestra.run.trial111.stdout:[ OK ] SnapMapperTest.CheckMakePurgedSnapKeyFormat (0 ms) 2026-02-17T11:54:43.823 INFO:teuthology.orchestra.run.trial111.stdout:[ RUN ] SnapMapperTest.LegacyKeyConvertion 2026-02-17T11:54:43.823 INFO:teuthology.orchestra.run.trial111.stdout:[ OK ] SnapMapperTest.LegacyKeyConvertion (0 ms) 2026-02-17T11:54:43.823 INFO:teuthology.orchestra.run.trial111.stdout:[----------] 8 tests from SnapMapperTest (22394 ms total) 2026-02-17T11:54:43.823 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:54:43.823 INFO:teuthology.orchestra.run.trial111.stdout:[----------] 2 tests from DirectMapperTest 2026-02-17T11:54:43.823 INFO:teuthology.orchestra.run.trial111.stdout:[ RUN ] DirectMapperTest.BasciObject 2026-02-17T11:54:43.826 INFO:teuthology.orchestra.run.trial111.stdout:[ OK ] DirectMapperTest.BasciObject (4 ms) 2026-02-17T11:54:43.826 INFO:teuthology.orchestra.run.trial111.stdout:[ RUN ] DirectMapperTest.CorruptedSnaRecord 2026-02-17T11:54:43.837 INFO:teuthology.orchestra.run.trial111.stdout:[ OK ] DirectMapperTest.CorruptedSnaRecord (11 ms) 2026-02-17T11:54:43.837 INFO:teuthology.orchestra.run.trial111.stdout:[----------] 2 tests from DirectMapperTest (15 ms total) 2026-02-17T11:54:43.837 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:54:43.837 INFO:teuthology.orchestra.run.trial111.stdout:[----------] Global test environment tear-down 2026-02-17T11:54:43.837 INFO:teuthology.orchestra.run.trial111.stdout:[==========] 12 tests from 3 test suites ran. (27598 ms total) 2026-02-17T11:54:43.837 INFO:teuthology.orchestra.run.trial111.stdout:[ PASSED ] 12 tests. 2026-02-17T11:54:43.840 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-17T11:54:43.851 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-17T11:54:43.851 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:54:44.038 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:54:44.039 INFO:teuthology.orchestra.run.trial111.stderr:dumped all 2026-02-17T11:54:44.047 INFO:teuthology.orchestra.run.trial111.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2026-02-17T11:54:42.491905+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":81300,"kb_used_data":392,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":314491500,"statfs":{"total":322122547200,"available":322039296000,"internally_reserved":0,"allocated":401408,"data_stored":107174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82767186},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.000822"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":25,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T11:54:19.425646+0000","last_change":"2026-02-17T11:54:12.515246+0000","last_active":"2026-02-17T11:54:19.425646+0000","last_peered":"2026-02-17T11:54:19.425646+0000","last_clean":"2026-02-17T11:54:19.425646+0000","last_became_active":"2026-02-17T11:54:10.512332+0000","last_became_peered":"2026-02-17T11:54:10.512332+0000","last_unstale":"2026-02-17T11:54:19.425646+0000","last_undegraded":"2026-02-17T11:54:19.425646+0000","last_fullsized":"2026-02-17T11:54:19.425646+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:08:48.093975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043342499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":25,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T11:54:19.425619+0000","last_change":"2026-02-17T11:54:12.514976+0000","last_active":"2026-02-17T11:54:19.425619+0000","last_peered":"2026-02-17T11:54:19.425619+0000","last_clean":"2026-02-17T11:54:19.425619+0000","last_became_active":"2026-02-17T11:54:10.512549+0000","last_became_peered":"2026-02-17T11:54:10.512549+0000","last_unstale":"2026-02-17T11:54:19.425619+0000","last_undegraded":"2026-02-17T11:54:19.425619+0000","last_fullsized":"2026-02-17T11:54:19.425619+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T17:17:11.200247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000176157,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":25,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T11:54:19.444974+0000","last_change":"2026-02-17T11:54:12.512566+0000","last_active":"2026-02-17T11:54:19.444974+0000","last_peered":"2026-02-17T11:54:19.444974+0000","last_clean":"2026-02-17T11:54:19.444974+0000","last_became_active":"2026-02-17T11:54:10.512020+0000","last_became_peered":"2026-02-17T11:54:10.512020+0000","last_unstale":"2026-02-17T11:54:19.444974+0000","last_undegraded":"2026-02-17T11:54:19.444974+0000","last_fullsized":"2026-02-17T11:54:19.444974+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:10:33.476467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000232532,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":25,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T11:54:19.425611+0000","last_change":"2026-02-17T11:54:12.515052+0000","last_active":"2026-02-17T11:54:19.425611+0000","last_peered":"2026-02-17T11:54:19.425611+0000","last_clean":"2026-02-17T11:54:19.425611+0000","last_became_active":"2026-02-17T11:54:10.512514+0000","last_became_peered":"2026-02-17T11:54:10.512514+0000","last_unstale":"2026-02-17T11:54:19.425611+0000","last_undegraded":"2026-02-17T11:54:19.425611+0000","last_fullsized":"2026-02-17T11:54:19.425611+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:19:39.263096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025007499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"10'1","reported_seq":26,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T11:54:19.425642+0000","last_change":"2026-02-17T11:54:12.515074+0000","last_active":"2026-02-17T11:54:19.425642+0000","last_peered":"2026-02-17T11:54:19.425642+0000","last_clean":"2026-02-17T11:54:19.425642+0000","last_became_active":"2026-02-17T11:54:10.512167+0000","last_became_peered":"2026-02-17T11:54:10.512167+0000","last_unstale":"2026-02-17T11:54:19.425642+0000","last_undegraded":"2026-02-17T11:54:19.425642+0000","last_fullsized":"2026-02-17T11:54:19.425642+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:39:07.853573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026985099999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"12'2","reported_seq":26,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T11:54:19.252820+0000","last_change":"2026-02-17T11:54:12.514277+0000","last_active":"2026-02-17T11:54:19.252820+0000","last_peered":"2026-02-17T11:54:19.252820+0000","last_clean":"2026-02-17T11:54:19.252820+0000","last_became_active":"2026-02-17T11:54:10.512290+0000","last_became_peered":"2026-02-17T11:54:10.512290+0000","last_unstale":"2026-02-17T11:54:19.252820+0000","last_undegraded":"2026-02-17T11:54:19.252820+0000","last_fullsized":"2026-02-17T11:54:19.252820+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:47:01.655250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074857000000000005,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":25,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T11:54:19.444966+0000","last_change":"2026-02-17T11:54:12.512568+0000","last_active":"2026-02-17T11:54:19.444966+0000","last_peered":"2026-02-17T11:54:19.444966+0000","last_clean":"2026-02-17T11:54:19.444966+0000","last_became_active":"2026-02-17T11:54:10.512150+0000","last_became_peered":"2026-02-17T11:54:10.512150+0000","last_unstale":"2026-02-17T11:54:19.444966+0000","last_undegraded":"2026-02-17T11:54:19.444966+0000","last_fullsized":"2026-02-17T11:54:19.444966+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:07:24.737813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00020471000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":25,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T11:54:19.425591+0000","last_change":"2026-02-17T11:54:12.514938+0000","last_active":"2026-02-17T11:54:19.425591+0000","last_peered":"2026-02-17T11:54:19.425591+0000","last_clean":"2026-02-17T11:54:19.425591+0000","last_became_active":"2026-02-17T11:54:10.512283+0000","last_became_peered":"2026-02-17T11:54:10.512283+0000","last_unstale":"2026-02-17T11:54:19.425591+0000","last_undegraded":"2026-02-17T11:54:19.425591+0000","last_fullsized":"2026-02-17T11:54:19.425591+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:38:53.546987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017416299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738378,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27100,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830500,"statfs":{"total":107374182400,"available":107346432000,"internally_reserved":0,"allocated":131072,"data_stored":35712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738378,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27100,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830500,"statfs":{"total":107374182400,"available":107346432000,"internally_reserved":0,"allocated":135168,"data_stored":35731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738379,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27100,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830500,"statfs":{"total":107374182400,"available":107346432000,"internally_reserved":0,"allocated":135168,"data_stored":35731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:54:44.048 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:54:44.204 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:54:44.204 INFO:teuthology.orchestra.run.trial111.stderr:dumped all 2026-02-17T11:54:44.212 INFO:teuthology.orchestra.run.trial111.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2026-02-17T11:54:42.491905+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":81300,"kb_used_data":392,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":314491500,"statfs":{"total":322122547200,"available":322039296000,"internally_reserved":0,"allocated":401408,"data_stored":107174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82767186},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.000822"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":25,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T11:54:19.425646+0000","last_change":"2026-02-17T11:54:12.515246+0000","last_active":"2026-02-17T11:54:19.425646+0000","last_peered":"2026-02-17T11:54:19.425646+0000","last_clean":"2026-02-17T11:54:19.425646+0000","last_became_active":"2026-02-17T11:54:10.512332+0000","last_became_peered":"2026-02-17T11:54:10.512332+0000","last_unstale":"2026-02-17T11:54:19.425646+0000","last_undegraded":"2026-02-17T11:54:19.425646+0000","last_fullsized":"2026-02-17T11:54:19.425646+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:08:48.093975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043342499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":25,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T11:54:19.425619+0000","last_change":"2026-02-17T11:54:12.514976+0000","last_active":"2026-02-17T11:54:19.425619+0000","last_peered":"2026-02-17T11:54:19.425619+0000","last_clean":"2026-02-17T11:54:19.425619+0000","last_became_active":"2026-02-17T11:54:10.512549+0000","last_became_peered":"2026-02-17T11:54:10.512549+0000","last_unstale":"2026-02-17T11:54:19.425619+0000","last_undegraded":"2026-02-17T11:54:19.425619+0000","last_fullsized":"2026-02-17T11:54:19.425619+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T17:17:11.200247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000176157,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":25,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T11:54:19.444974+0000","last_change":"2026-02-17T11:54:12.512566+0000","last_active":"2026-02-17T11:54:19.444974+0000","last_peered":"2026-02-17T11:54:19.444974+0000","last_clean":"2026-02-17T11:54:19.444974+0000","last_became_active":"2026-02-17T11:54:10.512020+0000","last_became_peered":"2026-02-17T11:54:10.512020+0000","last_unstale":"2026-02-17T11:54:19.444974+0000","last_undegraded":"2026-02-17T11:54:19.444974+0000","last_fullsized":"2026-02-17T11:54:19.444974+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:10:33.476467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000232532,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":25,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T11:54:19.425611+0000","last_change":"2026-02-17T11:54:12.515052+0000","last_active":"2026-02-17T11:54:19.425611+0000","last_peered":"2026-02-17T11:54:19.425611+0000","last_clean":"2026-02-17T11:54:19.425611+0000","last_became_active":"2026-02-17T11:54:10.512514+0000","last_became_peered":"2026-02-17T11:54:10.512514+0000","last_unstale":"2026-02-17T11:54:19.425611+0000","last_undegraded":"2026-02-17T11:54:19.425611+0000","last_fullsized":"2026-02-17T11:54:19.425611+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:19:39.263096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025007499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"10'1","reported_seq":26,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T11:54:19.425642+0000","last_change":"2026-02-17T11:54:12.515074+0000","last_active":"2026-02-17T11:54:19.425642+0000","last_peered":"2026-02-17T11:54:19.425642+0000","last_clean":"2026-02-17T11:54:19.425642+0000","last_became_active":"2026-02-17T11:54:10.512167+0000","last_became_peered":"2026-02-17T11:54:10.512167+0000","last_unstale":"2026-02-17T11:54:19.425642+0000","last_undegraded":"2026-02-17T11:54:19.425642+0000","last_fullsized":"2026-02-17T11:54:19.425642+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:39:07.853573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026985099999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"12'2","reported_seq":26,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T11:54:19.252820+0000","last_change":"2026-02-17T11:54:12.514277+0000","last_active":"2026-02-17T11:54:19.252820+0000","last_peered":"2026-02-17T11:54:19.252820+0000","last_clean":"2026-02-17T11:54:19.252820+0000","last_became_active":"2026-02-17T11:54:10.512290+0000","last_became_peered":"2026-02-17T11:54:10.512290+0000","last_unstale":"2026-02-17T11:54:19.252820+0000","last_undegraded":"2026-02-17T11:54:19.252820+0000","last_fullsized":"2026-02-17T11:54:19.252820+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:47:01.655250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074857000000000005,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":25,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T11:54:19.444966+0000","last_change":"2026-02-17T11:54:12.512568+0000","last_active":"2026-02-17T11:54:19.444966+0000","last_peered":"2026-02-17T11:54:19.444966+0000","last_clean":"2026-02-17T11:54:19.444966+0000","last_became_active":"2026-02-17T11:54:10.512150+0000","last_became_peered":"2026-02-17T11:54:10.512150+0000","last_unstale":"2026-02-17T11:54:19.444966+0000","last_undegraded":"2026-02-17T11:54:19.444966+0000","last_fullsized":"2026-02-17T11:54:19.444966+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:07:24.737813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00020471000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":25,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T11:54:19.425591+0000","last_change":"2026-02-17T11:54:12.514938+0000","last_active":"2026-02-17T11:54:19.425591+0000","last_peered":"2026-02-17T11:54:19.425591+0000","last_clean":"2026-02-17T11:54:19.425591+0000","last_became_active":"2026-02-17T11:54:10.512283+0000","last_became_peered":"2026-02-17T11:54:10.512283+0000","last_unstale":"2026-02-17T11:54:19.425591+0000","last_undegraded":"2026-02-17T11:54:19.425591+0000","last_fullsized":"2026-02-17T11:54:19.425591+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:38:53.546987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017416299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738378,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27100,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830500,"statfs":{"total":107374182400,"available":107346432000,"internally_reserved":0,"allocated":131072,"data_stored":35712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738378,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27100,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830500,"statfs":{"total":107374182400,"available":107346432000,"internally_reserved":0,"allocated":135168,"data_stored":35731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738379,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27100,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830500,"statfs":{"total":107374182400,"available":107346432000,"internally_reserved":0,"allocated":135168,"data_stored":35731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:54:44.213 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-17T11:54:44.213 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:54:44.366 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:54:44.367 INFO:teuthology.orchestra.run.trial111.stderr:dumped all 2026-02-17T11:54:44.374 INFO:teuthology.orchestra.run.trial111.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2026-02-17T11:54:42.491905+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":81300,"kb_used_data":392,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":314491500,"statfs":{"total":322122547200,"available":322039296000,"internally_reserved":0,"allocated":401408,"data_stored":107174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82767186},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.000822"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":25,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T11:54:19.425646+0000","last_change":"2026-02-17T11:54:12.515246+0000","last_active":"2026-02-17T11:54:19.425646+0000","last_peered":"2026-02-17T11:54:19.425646+0000","last_clean":"2026-02-17T11:54:19.425646+0000","last_became_active":"2026-02-17T11:54:10.512332+0000","last_became_peered":"2026-02-17T11:54:10.512332+0000","last_unstale":"2026-02-17T11:54:19.425646+0000","last_undegraded":"2026-02-17T11:54:19.425646+0000","last_fullsized":"2026-02-17T11:54:19.425646+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:08:48.093975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043342499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":25,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T11:54:19.425619+0000","last_change":"2026-02-17T11:54:12.514976+0000","last_active":"2026-02-17T11:54:19.425619+0000","last_peered":"2026-02-17T11:54:19.425619+0000","last_clean":"2026-02-17T11:54:19.425619+0000","last_became_active":"2026-02-17T11:54:10.512549+0000","last_became_peered":"2026-02-17T11:54:10.512549+0000","last_unstale":"2026-02-17T11:54:19.425619+0000","last_undegraded":"2026-02-17T11:54:19.425619+0000","last_fullsized":"2026-02-17T11:54:19.425619+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T17:17:11.200247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000176157,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":25,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T11:54:19.444974+0000","last_change":"2026-02-17T11:54:12.512566+0000","last_active":"2026-02-17T11:54:19.444974+0000","last_peered":"2026-02-17T11:54:19.444974+0000","last_clean":"2026-02-17T11:54:19.444974+0000","last_became_active":"2026-02-17T11:54:10.512020+0000","last_became_peered":"2026-02-17T11:54:10.512020+0000","last_unstale":"2026-02-17T11:54:19.444974+0000","last_undegraded":"2026-02-17T11:54:19.444974+0000","last_fullsized":"2026-02-17T11:54:19.444974+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:10:33.476467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000232532,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":25,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T11:54:19.425611+0000","last_change":"2026-02-17T11:54:12.515052+0000","last_active":"2026-02-17T11:54:19.425611+0000","last_peered":"2026-02-17T11:54:19.425611+0000","last_clean":"2026-02-17T11:54:19.425611+0000","last_became_active":"2026-02-17T11:54:10.512514+0000","last_became_peered":"2026-02-17T11:54:10.512514+0000","last_unstale":"2026-02-17T11:54:19.425611+0000","last_undegraded":"2026-02-17T11:54:19.425611+0000","last_fullsized":"2026-02-17T11:54:19.425611+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:19:39.263096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025007499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"10'1","reported_seq":26,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T11:54:19.425642+0000","last_change":"2026-02-17T11:54:12.515074+0000","last_active":"2026-02-17T11:54:19.425642+0000","last_peered":"2026-02-17T11:54:19.425642+0000","last_clean":"2026-02-17T11:54:19.425642+0000","last_became_active":"2026-02-17T11:54:10.512167+0000","last_became_peered":"2026-02-17T11:54:10.512167+0000","last_unstale":"2026-02-17T11:54:19.425642+0000","last_undegraded":"2026-02-17T11:54:19.425642+0000","last_fullsized":"2026-02-17T11:54:19.425642+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:39:07.853573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026985099999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"12'2","reported_seq":26,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T11:54:19.252820+0000","last_change":"2026-02-17T11:54:12.514277+0000","last_active":"2026-02-17T11:54:19.252820+0000","last_peered":"2026-02-17T11:54:19.252820+0000","last_clean":"2026-02-17T11:54:19.252820+0000","last_became_active":"2026-02-17T11:54:10.512290+0000","last_became_peered":"2026-02-17T11:54:10.512290+0000","last_unstale":"2026-02-17T11:54:19.252820+0000","last_undegraded":"2026-02-17T11:54:19.252820+0000","last_fullsized":"2026-02-17T11:54:19.252820+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:47:01.655250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074857000000000005,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":25,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T11:54:19.444966+0000","last_change":"2026-02-17T11:54:12.512568+0000","last_active":"2026-02-17T11:54:19.444966+0000","last_peered":"2026-02-17T11:54:19.444966+0000","last_clean":"2026-02-17T11:54:19.444966+0000","last_became_active":"2026-02-17T11:54:10.512150+0000","last_became_peered":"2026-02-17T11:54:10.512150+0000","last_unstale":"2026-02-17T11:54:19.444966+0000","last_undegraded":"2026-02-17T11:54:19.444966+0000","last_fullsized":"2026-02-17T11:54:19.444966+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:07:24.737813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00020471000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":25,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T11:54:19.425591+0000","last_change":"2026-02-17T11:54:12.514938+0000","last_active":"2026-02-17T11:54:19.425591+0000","last_peered":"2026-02-17T11:54:19.425591+0000","last_clean":"2026-02-17T11:54:19.425591+0000","last_became_active":"2026-02-17T11:54:10.512283+0000","last_became_peered":"2026-02-17T11:54:10.512283+0000","last_unstale":"2026-02-17T11:54:19.425591+0000","last_undegraded":"2026-02-17T11:54:19.425591+0000","last_fullsized":"2026-02-17T11:54:19.425591+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:38:53.546987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017416299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738378,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27100,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830500,"statfs":{"total":107374182400,"available":107346432000,"internally_reserved":0,"allocated":131072,"data_stored":35712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738378,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27100,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830500,"statfs":{"total":107374182400,"available":107346432000,"internally_reserved":0,"allocated":135168,"data_stored":35731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738379,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27100,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830500,"statfs":{"total":107374182400,"available":107346432000,"internally_reserved":0,"allocated":135168,"data_stored":35731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:54:44.375 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:54:44.530 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:54:44.531 INFO:teuthology.orchestra.run.trial111.stdout:{"epoch":15,"fsid":"e0aed382-97c1-4a49-9fc0-e493e1bf10c5","created":"2026-02-17T11:53:54.254177+0000","modified":"2026-02-17T11:54:19.251687+0000","last_up_change":"2026-02-17T11:54:02.495464+0000","last_in_change":"2026-02-17T11:53:54.934619+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-17T11:54:08.544352+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":12,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2100a40a-c685-4262-8d9d-adb86669012c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6818","nonce":32633150},{"type":"v1","addr":"10.20.193.111:6819","nonce":32633150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6820","nonce":32633150},{"type":"v1","addr":"10.20.193.111:6821","nonce":32633150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6824","nonce":32633150},{"type":"v1","addr":"10.20.193.111:6825","nonce":32633150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6822","nonce":32633150},{"type":"v1","addr":"10.20.193.111:6823","nonce":32633150}]},"public_addr":"10.20.193.111:6819/32633150","cluster_addr":"10.20.193.111:6821/32633150","heartbeat_back_addr":"10.20.193.111:6825/32633150","heartbeat_front_addr":"10.20.193.111:6823/32633150","state":["exists","up"]},{"osd":1,"uuid":"96a73a27-c806-46a7-91a6-4c2d2a357981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6810","nonce":1136208209},{"type":"v1","addr":"10.20.193.111:6811","nonce":1136208209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6812","nonce":1136208209},{"type":"v1","addr":"10.20.193.111:6813","nonce":1136208209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6816","nonce":1136208209},{"type":"v1","addr":"10.20.193.111:6817","nonce":1136208209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6814","nonce":1136208209},{"type":"v1","addr":"10.20.193.111:6815","nonce":1136208209}]},"public_addr":"10.20.193.111:6811/1136208209","cluster_addr":"10.20.193.111:6813/1136208209","heartbeat_back_addr":"10.20.193.111:6817/1136208209","heartbeat_front_addr":"10.20.193.111:6815/1136208209","state":["exists","up"]},{"osd":2,"uuid":"1ab737cb-5eb6-42c2-b7bb-21f6794d7912","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6800","nonce":2365909075},{"type":"v1","addr":"10.20.193.111:6801","nonce":2365909075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6802","nonce":2365909075},{"type":"v1","addr":"10.20.193.111:6803","nonce":2365909075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6806","nonce":2365909075},{"type":"v1","addr":"10.20.193.111:6807","nonce":2365909075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6804","nonce":2365909075},{"type":"v1","addr":"10.20.193.111:6805","nonce":2365909075}]},"public_addr":"10.20.193.111:6801/2365909075","cluster_addr":"10.20.193.111:6803/2365909075","heartbeat_back_addr":"10.20.193.111:6807/2365909075","heartbeat_front_addr":"10.20.193.111:6805/2365909075","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:54:01.145976+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:54:00.784431+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:54:00.662978+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:54:45.540 INFO:tasks.ceph:Scrubbing osd.0 2026-02-17T11:54:45.540 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-17T11:54:45.623 INFO:teuthology.orchestra.run.trial111.stdout:{ 2026-02-17T11:54:45.623 INFO:teuthology.orchestra.run.trial111.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T11:54:45.623 INFO:teuthology.orchestra.run.trial111.stdout:} 2026-02-17T11:54:45.630 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-17T11:54:45.786 INFO:teuthology.orchestra.run.trial111.stderr:instructed osd(s) 0 to deep-scrub 2026-02-17T11:54:45.794 INFO:tasks.ceph:Scrubbing osd.1 2026-02-17T11:54:45.794 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-17T11:54:45.875 INFO:teuthology.orchestra.run.trial111.stdout:{ 2026-02-17T11:54:45.875 INFO:teuthology.orchestra.run.trial111.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T11:54:45.876 INFO:teuthology.orchestra.run.trial111.stdout:} 2026-02-17T11:54:45.881 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-17T11:54:46.038 INFO:teuthology.orchestra.run.trial111.stderr:instructed osd(s) 1 to deep-scrub 2026-02-17T11:54:46.046 INFO:tasks.ceph:Scrubbing osd.2 2026-02-17T11:54:46.046 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-17T11:54:46.125 INFO:teuthology.orchestra.run.trial111.stdout:{ 2026-02-17T11:54:46.126 INFO:teuthology.orchestra.run.trial111.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T11:54:46.126 INFO:teuthology.orchestra.run.trial111.stdout:} 2026-02-17T11:54:46.131 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-17T11:54:46.286 INFO:teuthology.orchestra.run.trial111.stderr:instructed osd(s) 2 to deep-scrub 2026-02-17T11:54:46.294 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:54:46.455 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:54:46.455 INFO:teuthology.orchestra.run.trial111.stderr:dumped all 2026-02-17T11:54:46.464 INFO:teuthology.orchestra.run.trial111.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2026-02-17T11:54:44.492055+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":81300,"kb_used_data":392,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":314491500,"statfs":{"total":322122547200,"available":322039296000,"internally_reserved":0,"allocated":401408,"data_stored":107174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82767186},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.000815"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":25,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T11:54:19.425646+0000","last_change":"2026-02-17T11:54:12.515246+0000","last_active":"2026-02-17T11:54:19.425646+0000","last_peered":"2026-02-17T11:54:19.425646+0000","last_clean":"2026-02-17T11:54:19.425646+0000","last_became_active":"2026-02-17T11:54:10.512332+0000","last_became_peered":"2026-02-17T11:54:10.512332+0000","last_unstale":"2026-02-17T11:54:19.425646+0000","last_undegraded":"2026-02-17T11:54:19.425646+0000","last_fullsized":"2026-02-17T11:54:19.425646+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:08:48.093975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043342499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":25,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T11:54:19.425619+0000","last_change":"2026-02-17T11:54:12.514976+0000","last_active":"2026-02-17T11:54:19.425619+0000","last_peered":"2026-02-17T11:54:19.425619+0000","last_clean":"2026-02-17T11:54:19.425619+0000","last_became_active":"2026-02-17T11:54:10.512549+0000","last_became_peered":"2026-02-17T11:54:10.512549+0000","last_unstale":"2026-02-17T11:54:19.425619+0000","last_undegraded":"2026-02-17T11:54:19.425619+0000","last_fullsized":"2026-02-17T11:54:19.425619+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T17:17:11.200247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000176157,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":25,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T11:54:19.444974+0000","last_change":"2026-02-17T11:54:12.512566+0000","last_active":"2026-02-17T11:54:19.444974+0000","last_peered":"2026-02-17T11:54:19.444974+0000","last_clean":"2026-02-17T11:54:19.444974+0000","last_became_active":"2026-02-17T11:54:10.512020+0000","last_became_peered":"2026-02-17T11:54:10.512020+0000","last_unstale":"2026-02-17T11:54:19.444974+0000","last_undegraded":"2026-02-17T11:54:19.444974+0000","last_fullsized":"2026-02-17T11:54:19.444974+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:10:33.476467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000232532,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":25,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T11:54:19.425611+0000","last_change":"2026-02-17T11:54:12.515052+0000","last_active":"2026-02-17T11:54:19.425611+0000","last_peered":"2026-02-17T11:54:19.425611+0000","last_clean":"2026-02-17T11:54:19.425611+0000","last_became_active":"2026-02-17T11:54:10.512514+0000","last_became_peered":"2026-02-17T11:54:10.512514+0000","last_unstale":"2026-02-17T11:54:19.425611+0000","last_undegraded":"2026-02-17T11:54:19.425611+0000","last_fullsized":"2026-02-17T11:54:19.425611+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:19:39.263096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025007499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"10'1","reported_seq":26,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T11:54:19.425642+0000","last_change":"2026-02-17T11:54:12.515074+0000","last_active":"2026-02-17T11:54:19.425642+0000","last_peered":"2026-02-17T11:54:19.425642+0000","last_clean":"2026-02-17T11:54:19.425642+0000","last_became_active":"2026-02-17T11:54:10.512167+0000","last_became_peered":"2026-02-17T11:54:10.512167+0000","last_unstale":"2026-02-17T11:54:19.425642+0000","last_undegraded":"2026-02-17T11:54:19.425642+0000","last_fullsized":"2026-02-17T11:54:19.425642+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:39:07.853573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026985099999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"12'2","reported_seq":26,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T11:54:19.252820+0000","last_change":"2026-02-17T11:54:12.514277+0000","last_active":"2026-02-17T11:54:19.252820+0000","last_peered":"2026-02-17T11:54:19.252820+0000","last_clean":"2026-02-17T11:54:19.252820+0000","last_became_active":"2026-02-17T11:54:10.512290+0000","last_became_peered":"2026-02-17T11:54:10.512290+0000","last_unstale":"2026-02-17T11:54:19.252820+0000","last_undegraded":"2026-02-17T11:54:19.252820+0000","last_fullsized":"2026-02-17T11:54:19.252820+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:47:01.655250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074857000000000005,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":25,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T11:54:19.444966+0000","last_change":"2026-02-17T11:54:12.512568+0000","last_active":"2026-02-17T11:54:19.444966+0000","last_peered":"2026-02-17T11:54:19.444966+0000","last_clean":"2026-02-17T11:54:19.444966+0000","last_became_active":"2026-02-17T11:54:10.512150+0000","last_became_peered":"2026-02-17T11:54:10.512150+0000","last_unstale":"2026-02-17T11:54:19.444966+0000","last_undegraded":"2026-02-17T11:54:19.444966+0000","last_fullsized":"2026-02-17T11:54:19.444966+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:07:24.737813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00020471000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":25,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T11:54:19.425591+0000","last_change":"2026-02-17T11:54:12.514938+0000","last_active":"2026-02-17T11:54:19.425591+0000","last_peered":"2026-02-17T11:54:19.425591+0000","last_clean":"2026-02-17T11:54:19.425591+0000","last_became_active":"2026-02-17T11:54:10.512283+0000","last_became_peered":"2026-02-17T11:54:10.512283+0000","last_unstale":"2026-02-17T11:54:19.425591+0000","last_undegraded":"2026-02-17T11:54:19.425591+0000","last_fullsized":"2026-02-17T11:54:19.425591+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:09.504520+0000","last_clean_scrub_stamp":"2026-02-17T11:54:09.504520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:38:53.546987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017416299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738379,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27100,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830500,"statfs":{"total":107374182400,"available":107346432000,"internally_reserved":0,"allocated":131072,"data_stored":35712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738379,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27100,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830500,"statfs":{"total":107374182400,"available":107346432000,"internally_reserved":0,"allocated":135168,"data_stored":35731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738380,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27100,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830500,"statfs":{"total":107374182400,"available":107346432000,"internally_reserved":0,"allocated":135168,"data_stored":35731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:54:46.469 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2026-02-17T11:54:09.504520+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=54, tm_sec=9, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T11:54:46.469 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2026-02-17T11:54:09.504520+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=54, tm_sec=9, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T11:54:46.469 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2026-02-17T11:54:09.504520+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=54, tm_sec=9, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T11:54:46.469 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2026-02-17T11:54:09.504520+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=54, tm_sec=9, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T11:54:46.470 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2026-02-17T11:54:09.504520+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=54, tm_sec=9, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T11:54:46.470 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2026-02-17T11:54:09.504520+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=54, tm_sec=9, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T11:54:46.470 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2026-02-17T11:54:09.504520+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=54, tm_sec=9, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T11:54:46.470 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-17T11:54:09.504520+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=54, tm_sec=9, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T11:54:46.470 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-17T11:55:06.471 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:55:06.632 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-17T11:55:06.632 INFO:teuthology.orchestra.run.trial111.stderr:dumped all 2026-02-17T11:55:06.640 INFO:teuthology.orchestra.run.trial111.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2026-02-17T11:55:06.493827+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":81272,"kb_used_data":392,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":314491528,"statfs":{"total":322122547200,"available":322039324672,"internally_reserved":0,"allocated":401408,"data_stored":107174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82767186},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.000919"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":34,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T11:54:47.768290+0000","last_change":"2026-02-17T11:54:47.768302+0000","last_active":"2026-02-17T11:54:47.768290+0000","last_peered":"2026-02-17T11:54:47.768290+0000","last_clean":"2026-02-17T11:54:47.768290+0000","last_became_active":"2026-02-17T11:54:10.512332+0000","last_became_peered":"2026-02-17T11:54:10.512332+0000","last_unstale":"2026-02-17T11:54:47.768290+0000","last_undegraded":"2026-02-17T11:54:47.768290+0000","last_fullsized":"2026-02-17T11:54:47.768290+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:47.768246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:47.768246+0000","last_clean_scrub_stamp":"2026-02-17T11:54:47.768246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:33:22.611599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043342499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":34,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T11:54:49.800012+0000","last_change":"2026-02-17T11:54:49.800026+0000","last_active":"2026-02-17T11:54:49.800012+0000","last_peered":"2026-02-17T11:54:49.800012+0000","last_clean":"2026-02-17T11:54:49.800012+0000","last_became_active":"2026-02-17T11:54:10.512549+0000","last_became_peered":"2026-02-17T11:54:10.512549+0000","last_unstale":"2026-02-17T11:54:49.800012+0000","last_undegraded":"2026-02-17T11:54:49.800012+0000","last_fullsized":"2026-02-17T11:54:49.800012+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:49.799971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:49.799971+0000","last_clean_scrub_stamp":"2026-02-17T11:54:49.799971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:35:32.765150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000176157,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":34,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T11:54:46.396605+0000","last_change":"2026-02-17T11:54:46.396623+0000","last_active":"2026-02-17T11:54:46.396605+0000","last_peered":"2026-02-17T11:54:46.396605+0000","last_clean":"2026-02-17T11:54:46.396605+0000","last_became_active":"2026-02-17T11:54:10.512020+0000","last_became_peered":"2026-02-17T11:54:10.512020+0000","last_unstale":"2026-02-17T11:54:46.396605+0000","last_undegraded":"2026-02-17T11:54:46.396605+0000","last_fullsized":"2026-02-17T11:54:46.396605+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:46.396570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:46.396570+0000","last_clean_scrub_stamp":"2026-02-17T11:54:46.396570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:34:36.999344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000232532,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":34,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T11:54:48.771726+0000","last_change":"2026-02-17T11:54:48.771736+0000","last_active":"2026-02-17T11:54:48.771726+0000","last_peered":"2026-02-17T11:54:48.771726+0000","last_clean":"2026-02-17T11:54:48.771726+0000","last_became_active":"2026-02-17T11:54:10.512514+0000","last_became_peered":"2026-02-17T11:54:10.512514+0000","last_unstale":"2026-02-17T11:54:48.771726+0000","last_undegraded":"2026-02-17T11:54:48.771726+0000","last_fullsized":"2026-02-17T11:54:48.771726+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:48.771699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:48.771699+0000","last_clean_scrub_stamp":"2026-02-17T11:54:48.771699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:27:52.056180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025007499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"15'2","reported_seq":36,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T11:54:50.810176+0000","last_change":"2026-02-17T11:54:50.810200+0000","last_active":"2026-02-17T11:54:50.810176+0000","last_peered":"2026-02-17T11:54:50.810176+0000","last_clean":"2026-02-17T11:54:50.810176+0000","last_became_active":"2026-02-17T11:54:10.512167+0000","last_became_peered":"2026-02-17T11:54:10.512167+0000","last_unstale":"2026-02-17T11:54:50.810176+0000","last_undegraded":"2026-02-17T11:54:50.810176+0000","last_fullsized":"2026-02-17T11:54:50.810176+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'2","last_scrub_stamp":"2026-02-17T11:54:50.810122+0000","last_deep_scrub":"15'2","last_deep_scrub_stamp":"2026-02-17T11:54:50.810122+0000","last_clean_scrub_stamp":"2026-02-17T11:54:50.810122+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:11:13.111248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026985099999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"15'3","reported_seq":36,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T11:54:46.032185+0000","last_change":"2026-02-17T11:54:46.032201+0000","last_active":"2026-02-17T11:54:46.032185+0000","last_peered":"2026-02-17T11:54:46.032185+0000","last_clean":"2026-02-17T11:54:46.032185+0000","last_became_active":"2026-02-17T11:54:10.512290+0000","last_became_peered":"2026-02-17T11:54:10.512290+0000","last_unstale":"2026-02-17T11:54:46.032185+0000","last_undegraded":"2026-02-17T11:54:46.032185+0000","last_fullsized":"2026-02-17T11:54:46.032185+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'3","last_scrub_stamp":"2026-02-17T11:54:46.032146+0000","last_deep_scrub":"15'3","last_deep_scrub_stamp":"2026-02-17T11:54:46.032146+0000","last_clean_scrub_stamp":"2026-02-17T11:54:46.032146+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:58:31.932728+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00074857000000000005,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":34,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T11:54:47.346984+0000","last_change":"2026-02-17T11:54:47.346993+0000","last_active":"2026-02-17T11:54:47.346984+0000","last_peered":"2026-02-17T11:54:47.346984+0000","last_clean":"2026-02-17T11:54:47.346984+0000","last_became_active":"2026-02-17T11:54:10.512150+0000","last_became_peered":"2026-02-17T11:54:10.512150+0000","last_unstale":"2026-02-17T11:54:47.346984+0000","last_undegraded":"2026-02-17T11:54:47.346984+0000","last_fullsized":"2026-02-17T11:54:47.346984+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:47.346940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:47.346940+0000","last_clean_scrub_stamp":"2026-02-17T11:54:47.346940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:56:09.716037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00020471000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":34,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T11:54:46.769191+0000","last_change":"2026-02-17T11:54:46.769200+0000","last_active":"2026-02-17T11:54:46.769191+0000","last_peered":"2026-02-17T11:54:46.769191+0000","last_clean":"2026-02-17T11:54:46.769191+0000","last_became_active":"2026-02-17T11:54:10.512283+0000","last_became_peered":"2026-02-17T11:54:10.512283+0000","last_unstale":"2026-02-17T11:54:46.769191+0000","last_undegraded":"2026-02-17T11:54:46.769191+0000","last_fullsized":"2026-02-17T11:54:46.769191+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:54:46.769156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:54:46.769156+0000","last_clean_scrub_stamp":"2026-02-17T11:54:46.769156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:48:12.681536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017416299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738383,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27088,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830512,"statfs":{"total":107374182400,"available":107346444288,"internally_reserved":0,"allocated":131072,"data_stored":35712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738383,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27092,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830508,"statfs":{"total":107374182400,"available":107346440192,"internally_reserved":0,"allocated":135168,"data_stored":35731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738384,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27092,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830508,"statfs":{"total":107374182400,"available":107346440192,"internally_reserved":0,"allocated":135168,"data_stored":35731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:55:06.641 DEBUG:teuthology.orchestra.run.trial111:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-17T11:55:06.805 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-17T11:55:06.805 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-17T11:55:06.806 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-17T11:55:06.806 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T11:55:06.841 INFO:tasks.ceph.osd.0:Stopped 2026-02-17T11:55:06.841 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-17T11:55:06.841 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T11:55:06.912 INFO:tasks.ceph.osd.1:Stopped 2026-02-17T11:55:06.912 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-17T11:55:06.912 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T11:55:06.977 INFO:tasks.ceph.osd.2:Stopped 2026-02-17T11:55:06.977 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-17T11:55:06.977 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-17T11:55:06.977 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T11:55:07.048 INFO:tasks.ceph.mgr.x:Stopped 2026-02-17T11:55:07.048 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-17T11:55:07.048 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-17T11:55:07.048 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T11:55:07.097 INFO:tasks.ceph.mon.a:Stopped 2026-02-17T11:55:07.097 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-17T11:55:07.097 DEBUG:teuthology.orchestra.run.trial111:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | head -n 1 2026-02-17T11:55:07.164 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial111.front.sepia.ceph.com 2026-02-17T11:55:07.165 DEBUG:teuthology.orchestra.run.trial111:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-17T11:55:07.246 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial111.front.sepia.ceph.com 2026-02-17T11:55:07.246 DEBUG:teuthology.orchestra.run.trial111:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-17T11:55:07.314 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial111.front.sepia.ceph.com 2026-02-17T11:55:07.314 DEBUG:teuthology.orchestra.run.trial111:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-17T11:55:07.382 INFO:tasks.ceph:Archiving mon data... 2026-02-17T11:55:07.384 DEBUG:teuthology.misc:Transferring archived files from trial111:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51362/data/mon.a.tgz 2026-02-17T11:55:07.384 DEBUG:teuthology.orchestra.run.trial111:> mktemp 2026-02-17T11:55:07.438 INFO:teuthology.orchestra.run.trial111.stdout:/tmp/tmp.k69fl6lB1E 2026-02-17T11:55:07.439 DEBUG:teuthology.orchestra.run.trial111:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.k69fl6lB1E 2026-02-17T11:55:07.521 DEBUG:teuthology.orchestra.run.trial111:> sudo chmod 0666 /tmp/tmp.k69fl6lB1E 2026-02-17T11:55:07.643 DEBUG:teuthology.orchestra.remote:trial111:/tmp/tmp.k69fl6lB1E is 129KB 2026-02-17T11:55:07.694 DEBUG:teuthology.orchestra.run.trial111:> rm -fr /tmp/tmp.k69fl6lB1E 2026-02-17T11:55:07.710 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-17T11:55:07.710 DEBUG:teuthology.orchestra.run.trial111:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-17T11:55:07.833 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-17T11:55:07.833 INFO:tasks.ceph:Archiving crash dumps... 2026-02-17T11:55:07.835 DEBUG:teuthology.misc:Transferring archived files from trial111:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51362/remote/trial111/crash 2026-02-17T11:55:07.836 DEBUG:teuthology.orchestra.run.trial111:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-17T11:55:07.896 INFO:tasks.ceph:Compressing logs... 2026-02-17T11:55:07.896 DEBUG:teuthology.orchestra.run.trial111:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T11:55:07.962 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-17T11:55:07.965 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-17T11:55:07.965 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44316.log 2026-02-17T11:55:07.965 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42912.log 2026-02-17T11:55:07.965 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.44316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43924.log 2026-02-17T11:55:07.965 INFO:teuthology.orchestra.run.trial111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44316.log.gz 2026-02-17T11:55:07.965 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.42912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43100.log 2026-02-17T11:55:07.965 INFO:teuthology.orchestra.run.trial111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42912.log.gz 2026-02-17T11:55:07.965 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43350.log 2026-02-17T11:55:07.965 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.43924.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43924.log.gz 2026-02-17T11:55:07.965 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.43100.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43100.log.gz 2026-02-17T11:55:07.966 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44365.log 2026-02-17T11:55:07.966 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.43350.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-17T11:55:07.966 INFO:teuthology.orchestra.run.trial111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43350.log.gz 2026-02-17T11:55:07.966 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.44365.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44365.log.gz 2026-02-17T11:55:07.966 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41098.log 2026-02-17T11:55:07.976 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43051.log 2026-02-17T11:55:07.976 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.41098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43514.log 2026-02-17T11:55:07.976 INFO:teuthology.orchestra.run.trial111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41098.log.gz 2026-02-17T11:55:07.976 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.43051.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43051.log.gz 2026-02-17T11:55:07.976 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43590.log 2026-02-17T11:55:07.976 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.43514.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43514.log.gz 2026-02-17T11:55:07.977 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42842.log 2026-02-17T11:55:07.977 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.43590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40908.log 2026-02-17T11:55:07.977 INFO:teuthology.orchestra.run.trial111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43590.log.gz 2026-02-17T11:55:07.977 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.42842.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42842.log.gz 2026-02-17T11:55:07.977 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43203.log 2026-02-17T11:55:07.977 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43737.log 2026-02-17T11:55:07.977 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.40908.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40908.log.gz 2026-02-17T11:55:07.977 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.43203.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43203.log.gz 2026-02-17T11:55:07.977 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43202.log 2026-02-17T11:55:07.977 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.43737.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43737.log.gz 2026-02-17T11:55:07.977 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43002.log 2026-02-17T11:55:07.977 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.43202.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.43202.log.gz -- 2026-02-17T11:55:07.977 INFO:teuthology.orchestra.run.trial111.stderr: /var/log/ceph/ceph-client.admin.40796.log 2026-02-17T11:55:07.977 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.43002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43507.log 2026-02-17T11:55:07.977 INFO:teuthology.orchestra.run.trial111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43002.log.gz 2026-02-17T11:55:07.978 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.40796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43784.log 2026-02-17T11:55:07.978 INFO:teuthology.orchestra.run.trial111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40796.log.gz 2026-02-17T11:55:07.978 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.43507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44120.log 2026-02-17T11:55:07.978 INFO:teuthology.orchestra.run.trial111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43507.log.gz 2026-02-17T11:55:07.978 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.43784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42937.log 2026-02-17T11:55:07.978 INFO:teuthology.orchestra.run.trial111.stderr: 74.5% -- replaced with /var/log/ceph/ceph-client.admin.43784.log.gz 2026-02-17T11:55:07.978 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.44120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41272.log 2026-02-17T11:55:07.978 INFO:teuthology.orchestra.run.trial111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44120.log.gz 2026-02-17T11:55:07.978 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.42937.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42937.log.gz 2026-02-17T11:55:07.978 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43639.log 2026-02-17T11:55:07.978 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.41272.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.37284.log 2026-02-17T11:55:07.978 INFO:teuthology.orchestra.run.trial111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41272.log.gz 2026-02-17T11:55:07.978 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.43639.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43639.log.gz 2026-02-17T11:55:07.978 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43826.log 2026-02-17T11:55:07.978 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph.tmp-client.admin.37284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43443.log 2026-02-17T11:55:07.978 INFO:teuthology.orchestra.run.trial111.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.37284.log.gz 2026-02-17T11:55:07.978 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.43826.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43826.log.gz 2026-02-17T11:55:07.978 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44022.log 2026-02-17T11:55:07.978 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.43443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41051.log 2026-02-17T11:55:07.978 INFO:teuthology.orchestra.run.trial111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43443.log.gz 2026-02-17T11:55:07.978 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.44022.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44022.log.gz 2026-02-17T11:55:07.978 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41145.log 2026-02-17T11:55:07.978 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.41051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43973.log 2026-02-17T11:55:07.978 INFO:teuthology.orchestra.run.trial111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41051.log.gz 2026-02-17T11:55:07.978 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.41145.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41145.log.gz 2026-02-17T11:55:07.978 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41336.log 2026-02-17T11:55:07.978 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.43973.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-17T11:55:07.978 INFO:teuthology.orchestra.run.trial111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43973.log.gz 2026-02-17T11:55:07.978 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.41336.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41336.log.gz 2026-02-17T11:55:07.978 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42796.log 2026-02-17T11:55:07.978 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43348.log 2026-02-17T11:55:07.978 INFO:teuthology.orchestra.run.trial111.stderr: 87.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-17T11:55:07.978 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.42796.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-17T11:55:07.978 INFO:teuthology.orchestra.run.trial111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42796.log.gz 2026-02-17T11:55:07.978 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.43348.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43348.log.gz 2026-02-17T11:55:07.978 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44071.log 2026-02-17T11:55:07.978 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44267.log 2026-02-17T11:55:07.978 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.44071.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44071.log.gz 2026-02-17T11:55:07.978 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43688.log 2026-02-17T11:55:07.978 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.44267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43875.log 2026-02-17T11:55:07.978 INFO:teuthology.orchestra.run.trial111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44267.log.gz 2026-02-17T11:55:07.978 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.43688.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43688.log.gz 2026-02-17T11:55:07.978 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44218.log 2026-02-17T11:55:07.979 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.43875.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43875.log.gz 2026-02-17T11:55:07.979 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43201.log 2026-02-17T11:55:07.979 INFO:teuthology.orchestra.run.trial111.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-17T11:55:07.979 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.44218.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44218.log.gz 2026-02-17T11:55:07.979 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-17T11:55:07.979 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.43201.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43201.log.gz 2026-02-17T11:55:07.979 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43349.log 2026-02-17T11:55:07.979 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-17T11:55:07.979 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.43349.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43349.log.gz 2026-02-17T11:55:07.979 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44412.log 2026-02-17T11:55:07.979 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44169.log 2026-02-17T11:55:07.979 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.44412.log: 83.1% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-17T11:55:07.979 INFO:teuthology.orchestra.run.trial111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44412.log.gz 2026-02-17T11:55:07.979 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.44169.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44169.log.gz 2026-02-17T11:55:07.979 INFO:teuthology.orchestra.run.trial111.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-17T11:55:07.981 INFO:teuthology.orchestra.run.trial111.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-17T11:55:07.983 INFO:teuthology.orchestra.run.trial111.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-17T11:55:07.988 INFO:teuthology.orchestra.run.trial111.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-17T11:55:07.989 INFO:teuthology.orchestra.run.trial111.stderr: 2026-02-17T11:55:07.989 INFO:teuthology.orchestra.run.trial111.stderr:real 0m0.036s 2026-02-17T11:55:07.989 INFO:teuthology.orchestra.run.trial111.stderr:user 0m0.080s 2026-02-17T11:55:07.989 INFO:teuthology.orchestra.run.trial111.stderr:sys 0m0.036s 2026-02-17T11:55:07.990 INFO:tasks.ceph:Archiving logs... 2026-02-17T11:55:07.990 DEBUG:teuthology.misc:Transferring archived files from trial111:/var/log/ceph to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51362/remote/trial111/log 2026-02-17T11:55:07.991 DEBUG:teuthology.orchestra.run.trial111:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-17T11:55:08.115 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-17T11:55:08.135 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-17T11:55:08.135 DEBUG:teuthology.orchestra.run.trial111:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T11:55:08.252 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-17T11:55:08.263 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-17T11:55:08.263 DEBUG:teuthology.orchestra.run.trial111:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T11:55:08.279 INFO:teuthology.orchestra.run.trial111.stderr:bash: line 1: ntpq: command not found 2026-02-17T11:55:08.296 INFO:teuthology.orchestra.run.trial111.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T11:55:08.296 INFO:teuthology.orchestra.run.trial111.stdout:=============================================================================== 2026-02-17T11:55:08.296 INFO:teuthology.orchestra.run.trial111.stdout:^- 172-232-15-202.ip.linode> 2 6 77 13 -6127us[-6030us] +/- 75ms 2026-02-17T11:55:08.296 INFO:teuthology.orchestra.run.trial111.stdout:^- sushi.ruselabs.com 2 6 77 13 -1633us[-1536us] +/- 36ms 2026-02-17T11:55:08.296 INFO:teuthology.orchestra.run.trial111.stdout:^- owners.kjsl.com 2 6 77 13 -1736us[-1638us] +/- 47ms 2026-02-17T11:55:08.296 INFO:teuthology.orchestra.run.trial111.stdout:^* chi2.us.ntp.li 2 6 77 12 +24us[ +122us] +/- 11ms 2026-02-17T11:55:08.296 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-17T11:55:08.308 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-17T11:55:08.308 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-17T11:55:08.323 DEBUG:teuthology.orchestra.run.trial111:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-17T11:55:08.387 DEBUG:teuthology.orchestra.run.trial111:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T11:55:08.412 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T11:55:08.413 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-17T11:55:08.427 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-17T11:55:08.441 INFO:teuthology.task.internal:Duration was 324.000346 seconds 2026-02-17T11:55:08.442 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-17T11:55:08.459 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-17T11:55:08.459 DEBUG:teuthology.orchestra.run.trial111:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T11:55:08.497 INFO:teuthology.orchestra.run.trial111.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T11:55:08.685 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-17T11:55:08.685 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial111.front.sepia.ceph.com 2026-02-17T11:55:08.686 DEBUG:teuthology.orchestra.run.trial111:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T11:55:08.744 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-17T11:55:08.745 DEBUG:teuthology.orchestra.run.trial111:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T11:55:08.844 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-17T11:55:08.845 DEBUG:teuthology.orchestra.run.trial111:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T11:55:08.868 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T11:55:08.869 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T11:55:08.869 INFO:teuthology.orchestra.run.trial111.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T11:55:08.869 INFO:teuthology.orchestra.run.trial111.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T11:55:08.869 INFO:teuthology.orchestra.run.trial111.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T11:55:08.878 INFO:teuthology.orchestra.run.trial111.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 81.4% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T11:55:08.880 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-17T11:55:08.892 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-17T11:55:08.892 DEBUG:teuthology.orchestra.run.trial111:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T11:55:08.946 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-17T11:55:08.959 DEBUG:teuthology.orchestra.run.trial111:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T11:55:09.010 INFO:teuthology.orchestra.run.trial111.stdout:kernel.core_pattern = core 2026-02-17T11:55:09.027 DEBUG:teuthology.orchestra.run.trial111:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T11:55:09.082 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T11:55:09.083 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-17T11:55:09.100 INFO:teuthology.task.internal:Transferring archived files... 2026-02-17T11:55:09.101 DEBUG:teuthology.misc:Transferring archived files from trial111:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51362/remote/trial111 2026-02-17T11:55:09.102 DEBUG:teuthology.orchestra.run.trial111:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T11:55:09.160 INFO:teuthology.task.internal:Removing archive directory... 2026-02-17T11:55:09.160 DEBUG:teuthology.orchestra.run.trial111:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T11:55:09.209 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-17T11:55:09.227 INFO:teuthology.task.internal:Not uploading archives. 2026-02-17T11:55:09.228 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-17T11:55:09.244 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-17T11:55:09.245 DEBUG:teuthology.orchestra.run.trial111:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T11:55:09.266 INFO:teuthology.orchestra.run.trial111.stdout: 791887 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 11:55 /home/ubuntu/cephtest 2026-02-17T11:55:09.266 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-17T11:55:09.278 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-17T11:55:09.316 INFO:teuthology.run:Summary data: description: rados/singleton-nomsgr/{all/ceph-snapmapper mon_election/classic rados supported-random-distro$/{centos_latest}} duration: 324.0003459453583 flavor: default owner: scheduled_skanta@soko04.front.sepia.ceph.com success: true 2026-02-17T11:55:09.317 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T11:55:09.443 INFO:teuthology.run:pass