2026-02-17T10:49:50.868 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-17T10:49:50.883 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T10:49:50.959 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51222 branch: wip-bharath19-testing-2026-02-13-0903-squid description: rados/singleton-nomsgr/{all/ceph-snapmapper mon_election/connectivity rados supported-random-distro$/{centos_latest}} email: skanta@redhat.com first_in_suite: false flavor: default job_id: '51222' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-bharath19-testing-2026-02-13-0903-squid ceph: conf: global: mon election default strategy: 3 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon scrub interval: 300 osd: bluestore zero block detection: true debug ms: 1 debug osd: 20 osd debug verify cached snaps: true osd debug verify missing on start: true osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd op queue: debug_random osd op queue cut off: debug_random flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - but it is still running - overall HEALTH_ - \(POOL_APP_NOT_ENABLED\) pre-mgr-commands: - sudo ceph config set mgr mgr_pool false --force sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 workunit: branch: wip-bharath19-testing-2026-02-13-0903-squid sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e owner: scheduled_skanta@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 3603 sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-bharath19-testing-2026-02-13-0903-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e targets: trial138.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLQb6wNN8O16t1QekXJe8jEMfQ4pFod0sCy5I/CjEEvY/3MIh/bBr3YuFfzLisrB+WRd0ANkFnYuj1XIJp4Y+J4= tasks: - install: null - ceph: null - exec: client.0: - ceph_test_snap_mapper teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-17_04:03:08 tube: trial user: skanta verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682 2026-02-17T10:49:50.959 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa; will attempt to use it 2026-02-17T10:49:50.960 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks 2026-02-17T10:49:50.960 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-17T10:49:50.961 INFO:teuthology.task.internal:Checking packages... 2026-02-17T10:49:50.962 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e' 2026-02-17T10:49:50.962 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-17T10:49:50.962 INFO:teuthology.packaging:ref: None 2026-02-17T10:49:50.962 INFO:teuthology.packaging:tag: None 2026-02-17T10:49:50.962 INFO:teuthology.packaging:branch: wip-bharath19-testing-2026-02-13-0903-squid 2026-02-17T10:49:50.962 INFO:teuthology.packaging:sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T10:49:50.962 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-bharath19-testing-2026-02-13-0903-squid 2026-02-17T10:49:51.076 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-705.g04cf6dd4 2026-02-17T10:49:51.077 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-17T10:49:51.089 INFO:teuthology.task.internal:no buildpackages task found 2026-02-17T10:49:51.089 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-17T10:49:51.102 INFO:teuthology.task.internal:Saving configuration 2026-02-17T10:49:51.111 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-17T10:49:51.123 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-17T10:49:51.199 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial138.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51222', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 10:46:19.763400', 'locked_by': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLQb6wNN8O16t1QekXJe8jEMfQ4pFod0sCy5I/CjEEvY/3MIh/bBr3YuFfzLisrB+WRd0ANkFnYuj1XIJp4Y+J4='} 2026-02-17T10:49:51.199 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-17T10:49:51.211 INFO:teuthology.task.internal:roles: ubuntu@trial138.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2026-02-17T10:49:51.211 INFO:teuthology.run_tasks:Running task console_log... 2026-02-17T10:49:51.300 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7afb61168d60>, signals=[15]) 2026-02-17T10:49:51.300 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-17T10:49:51.311 INFO:teuthology.task.internal:Opening connections... 2026-02-17T10:49:51.311 DEBUG:teuthology.task.internal:connecting to ubuntu@trial138.front.sepia.ceph.com 2026-02-17T10:49:51.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T10:49:51.373 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-17T10:49:51.384 DEBUG:teuthology.orchestra.run.trial138:> uname -m 2026-02-17T10:49:51.447 INFO:teuthology.orchestra.run.trial138.stdout:x86_64 2026-02-17T10:49:51.448 DEBUG:teuthology.orchestra.run.trial138:> cat /etc/os-release 2026-02-17T10:49:51.504 INFO:teuthology.orchestra.run.trial138.stdout:NAME="CentOS Stream" 2026-02-17T10:49:51.504 INFO:teuthology.orchestra.run.trial138.stdout:VERSION="9" 2026-02-17T10:49:51.504 INFO:teuthology.orchestra.run.trial138.stdout:ID="centos" 2026-02-17T10:49:51.504 INFO:teuthology.orchestra.run.trial138.stdout:ID_LIKE="rhel fedora" 2026-02-17T10:49:51.504 INFO:teuthology.orchestra.run.trial138.stdout:VERSION_ID="9" 2026-02-17T10:49:51.504 INFO:teuthology.orchestra.run.trial138.stdout:PLATFORM_ID="platform:el9" 2026-02-17T10:49:51.505 INFO:teuthology.orchestra.run.trial138.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T10:49:51.505 INFO:teuthology.orchestra.run.trial138.stdout:ANSI_COLOR="0;31" 2026-02-17T10:49:51.505 INFO:teuthology.orchestra.run.trial138.stdout:LOGO="fedora-logo-icon" 2026-02-17T10:49:51.505 INFO:teuthology.orchestra.run.trial138.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T10:49:51.505 INFO:teuthology.orchestra.run.trial138.stdout:HOME_URL="https://centos.org/" 2026-02-17T10:49:51.505 INFO:teuthology.orchestra.run.trial138.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T10:49:51.505 INFO:teuthology.orchestra.run.trial138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T10:49:51.505 INFO:teuthology.orchestra.run.trial138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T10:49:51.506 INFO:teuthology.lock.ops:Updating trial138.front.sepia.ceph.com on lock server 2026-02-17T10:49:51.594 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-17T10:49:51.607 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-17T10:49:51.619 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-17T10:49:51.619 DEBUG:teuthology.orchestra.run.trial138:> test '!' -e /home/ubuntu/cephtest 2026-02-17T10:49:51.635 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-17T10:49:51.646 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-17T10:49:51.646 DEBUG:teuthology.orchestra.run.trial138:> test -z $(ls -A /var/lib/ceph) 2026-02-17T10:49:51.691 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-17T10:49:51.791 INFO:teuthology.run_tasks:Running task kernel... 2026-02-17T10:49:51.810 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-17T10:49:51.811 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-17T10:49:51.811 DEBUG:teuthology.orchestra.run.trial138:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T10:49:51.825 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T10:49:51.826 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-17T10:49:51.880 INFO:teuthology.orchestra.run.trial138.stdout:5.14.0-645.el9.x86_64 2026-02-17T10:49:51.880 INFO:teuthology.task.kernel:Running kernel on trial138: 5.14.0-645.el9.x86_64 2026-02-17T10:49:51.880 DEBUG:teuthology.orchestra.run.trial138:> sudo yum install -y kernel 2026-02-17T10:49:59.729 INFO:teuthology.orchestra.run.trial138.stdout:CentOS Stream 9 - BaseOS 1.2 MB/s | 8.9 MB 00:07 2026-02-17T10:50:27.817 INFO:teuthology.orchestra.run.trial138.stdout:CentOS Stream 9 - AppStream 996 kB/s | 27 MB 00:27 2026-02-17T10:50:31.482 INFO:teuthology.orchestra.run.trial138.stdout:CentOS Stream 9 - CRB 6.1 MB/s | 7.8 MB 00:01 2026-02-17T10:50:43.674 INFO:teuthology.orchestra.run.trial138.stdout:CentOS Stream 9 - Extras packages 1.8 kB/s | 20 kB 00:11 2026-02-17T10:50:59.792 INFO:teuthology.orchestra.run.trial138.stdout:Extra Packages for Enterprise Linux 1.3 MB/s | 20 MB 00:16 2026-02-17T10:51:02.965 INFO:teuthology.orchestra.run.trial138.stdout:lab-extras 1.7 MB/s | 50 kB 00:00 2026-02-17T10:51:03.982 INFO:teuthology.orchestra.run.trial138.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-17T10:51:04.002 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T10:51:04.002 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T10:51:04.003 INFO:teuthology.orchestra.run.trial138.stdout: Package Architecture Version Repository Size 2026-02-17T10:51:04.003 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T10:51:04.003 INFO:teuthology.orchestra.run.trial138.stdout:Installing: 2026-02-17T10:51:04.003 INFO:teuthology.orchestra.run.trial138.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-17T10:51:04.003 INFO:teuthology.orchestra.run.trial138.stdout:Installing dependencies: 2026-02-17T10:51:04.003 INFO:teuthology.orchestra.run.trial138.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-17T10:51:04.003 INFO:teuthology.orchestra.run.trial138.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-17T10:51:04.003 INFO:teuthology.orchestra.run.trial138.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-17T10:51:04.003 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:51:04.003 INFO:teuthology.orchestra.run.trial138.stdout:Transaction Summary 2026-02-17T10:51:04.003 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T10:51:04.003 INFO:teuthology.orchestra.run.trial138.stdout:Install 4 Packages 2026-02-17T10:51:04.003 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:51:04.003 INFO:teuthology.orchestra.run.trial138.stdout:Total download size: 88 M 2026-02-17T10:51:04.003 INFO:teuthology.orchestra.run.trial138.stdout:Installed size: 135 M 2026-02-17T10:51:04.003 INFO:teuthology.orchestra.run.trial138.stdout:Downloading Packages: 2026-02-17T10:51:05.509 INFO:teuthology.orchestra.run.trial138.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 570 kB/s | 803 kB 00:01 2026-02-17T10:51:13.889 INFO:teuthology.orchestra.run.trial138.stdout:(2/4): kernel-modules-core-5.14.0-681.el9.x86_6 3.7 MB/s | 31 MB 00:08 2026-02-17T10:51:20.407 INFO:teuthology.orchestra.run.trial138.stdout:(3/4): kernel-core-5.14.0-681.el9.x86_64.rpm 1.0 MB/s | 17 MB 00:16 2026-02-17T10:51:31.311 INFO:teuthology.orchestra.run.trial138.stdout:(4/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 1.5 MB/s | 40 MB 00:27 2026-02-17T10:51:31.313 INFO:teuthology.orchestra.run.trial138.stdout:-------------------------------------------------------------------------------- 2026-02-17T10:51:31.313 INFO:teuthology.orchestra.run.trial138.stdout:Total 3.2 MB/s | 88 MB 00:27 2026-02-17T10:51:31.504 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction check 2026-02-17T10:51:31.705 INFO:teuthology.orchestra.run.trial138.stdout:Transaction check succeeded. 2026-02-17T10:51:31.706 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction test 2026-02-17T10:51:32.052 INFO:teuthology.orchestra.run.trial138.stdout:Transaction test succeeded. 2026-02-17T10:51:32.052 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction 2026-02-17T10:51:33.144 INFO:teuthology.orchestra.run.trial138.stdout: Preparing : 1/1 2026-02-17T10:51:33.427 INFO:teuthology.orchestra.run.trial138.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-17T10:51:33.446 INFO:teuthology.orchestra.run.trial138.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T10:51:35.218 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T10:51:35.247 INFO:teuthology.orchestra.run.trial138.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T10:51:38.481 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T10:51:38.487 INFO:teuthology.orchestra.run.trial138.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T10:51:41.587 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T10:52:11.776 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T10:52:11.797 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-17T10:52:11.859 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T10:52:11.859 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-17T10:52:11.859 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T10:52:11.859 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T10:52:11.913 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T10:52:11.913 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:52:11.913 INFO:teuthology.orchestra.run.trial138.stdout:Installed: 2026-02-17T10:52:11.913 INFO:teuthology.orchestra.run.trial138.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-17T10:52:11.913 INFO:teuthology.orchestra.run.trial138.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-17T10:52:11.913 INFO:teuthology.orchestra.run.trial138.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-17T10:52:11.914 INFO:teuthology.orchestra.run.trial138.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-17T10:52:11.914 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:52:11.914 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T10:52:11.970 DEBUG:teuthology.orchestra.run.trial138:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T10:52:11.995 INFO:teuthology.orchestra.run.trial138.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T10:52:11.997 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T10:52:11.997 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-17T10:52:11.997 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T10:52:11.997 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T10:52:11.997 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-17T10:52:11.998 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial138.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T10:52:11.998 DEBUG:teuthology.orchestra.run.trial138:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T10:52:12.059 INFO:teuthology.orchestra.run.trial138.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T10:52:12.060 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T10:52:12.060 DEBUG:teuthology.orchestra.run.trial138:> sudo rpm -qi grub2-tools 2026-02-17T10:52:12.130 INFO:teuthology.orchestra.run.trial138.stdout:Name : grub2-tools 2026-02-17T10:52:12.130 INFO:teuthology.orchestra.run.trial138.stdout:Epoch : 1 2026-02-17T10:52:12.130 INFO:teuthology.orchestra.run.trial138.stdout:Version : 2.06 2026-02-17T10:52:12.130 INFO:teuthology.orchestra.run.trial138.stdout:Release : 118.el9 2026-02-17T10:52:12.130 INFO:teuthology.orchestra.run.trial138.stdout:Architecture: x86_64 2026-02-17T10:52:12.130 INFO:teuthology.orchestra.run.trial138.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-17T10:52:12.130 INFO:teuthology.orchestra.run.trial138.stdout:Group : Unspecified 2026-02-17T10:52:12.130 INFO:teuthology.orchestra.run.trial138.stdout:Size : 8393909 2026-02-17T10:52:12.131 INFO:teuthology.orchestra.run.trial138.stdout:License : GPLv3+ 2026-02-17T10:52:12.131 INFO:teuthology.orchestra.run.trial138.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-17T10:52:12.131 INFO:teuthology.orchestra.run.trial138.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-17T10:52:12.131 INFO:teuthology.orchestra.run.trial138.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-17T10:52:12.131 INFO:teuthology.orchestra.run.trial138.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-17T10:52:12.131 INFO:teuthology.orchestra.run.trial138.stdout:Packager : builder@centos.org 2026-02-17T10:52:12.131 INFO:teuthology.orchestra.run.trial138.stdout:Vendor : CentOS 2026-02-17T10:52:12.131 INFO:teuthology.orchestra.run.trial138.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-17T10:52:12.131 INFO:teuthology.orchestra.run.trial138.stdout:Summary : Support tools for GRUB. 2026-02-17T10:52:12.131 INFO:teuthology.orchestra.run.trial138.stdout:Description : 2026-02-17T10:52:12.131 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:52:12.132 INFO:teuthology.orchestra.run.trial138.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-17T10:52:12.132 INFO:teuthology.orchestra.run.trial138.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-17T10:52:12.132 INFO:teuthology.orchestra.run.trial138.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-17T10:52:12.132 INFO:teuthology.orchestra.run.trial138.stdout:hardware devices. 2026-02-17T10:52:12.132 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:52:12.132 INFO:teuthology.orchestra.run.trial138.stdout:This subpackage provides tools for support of all platforms. 2026-02-17T10:52:12.133 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-17T10:52:12.133 INFO:teuthology.task.kernel:Updating grub on trial138 to boot 5.14.0-681.el9.x86_64 2026-02-17T10:52:12.134 DEBUG:teuthology.orchestra.run.trial138:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-17T10:52:12.196 INFO:teuthology.orchestra.run.trial138.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T10:52:12.197 DEBUG:teuthology.orchestra.run.trial138:> sudo command -v grubby && echo yes || echo no 2026-02-17T10:52:12.260 INFO:teuthology.orchestra.run.trial138.stdout:/sbin/grubby 2026-02-17T10:52:12.261 INFO:teuthology.orchestra.run.trial138.stdout:yes 2026-02-17T10:52:12.262 DEBUG:teuthology.orchestra.run.trial138:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-17T10:52:12.325 INFO:teuthology.orchestra.run.trial138.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T10:52:12.326 DEBUG:teuthology.orchestra.run.trial138:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-17T10:52:12.398 DEBUG:teuthology.orchestra.run.trial138:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-17T10:52:12.604 INFO:teuthology.orchestra.run.trial138.stderr:Generating grub configuration file ... 2026-02-17T10:52:12.667 INFO:teuthology.orchestra.run.trial138.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-17T10:52:12.673 INFO:teuthology.orchestra.run.trial138.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-17T10:52:12.922 INFO:teuthology.orchestra.run.trial138.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-17T10:52:12.928 INFO:teuthology.orchestra.run.trial138.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-17T10:52:12.960 INFO:teuthology.orchestra.run.trial138.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-17T10:52:12.966 INFO:teuthology.orchestra.run.trial138.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-17T10:52:12.989 INFO:teuthology.orchestra.run.trial138.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-17T10:52:12.995 INFO:teuthology.orchestra.run.trial138.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-17T10:52:13.077 INFO:teuthology.orchestra.run.trial138.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T10:52:13.085 INFO:teuthology.orchestra.run.trial138.stderr:done 2026-02-17T10:52:13.087 DEBUG:teuthology.orchestra.run.trial138:> test -d /sys/firmware/efi 2026-02-17T10:52:13.103 DEBUG:teuthology.orchestra.run.trial138:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-17T10:52:13.169 INFO:teuthology.orchestra.run.trial138.stdout:/boot/efi/EFI/BOOT 2026-02-17T10:52:13.169 INFO:teuthology.orchestra.run.trial138.stdout:/boot/efi/EFI/centos 2026-02-17T10:52:13.170 DEBUG:teuthology.orchestra.run.trial138:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-17T10:52:13.236 INFO:teuthology.orchestra.run.trial138.stdout:no 2026-02-17T10:52:13.236 DEBUG:teuthology.orchestra.run.trial138:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-17T10:52:13.300 INFO:teuthology.orchestra.run.trial138.stdout:yes 2026-02-17T10:52:13.300 DEBUG:teuthology.orchestra.run.trial138:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-17T10:52:13.364 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial138 2026-02-17T10:52:13.364 DEBUG:teuthology.orchestra.run.trial138:> sudo bash -c ' 2026-02-17T10:52:13.364 DEBUG:teuthology.orchestra.run.trial138:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-17T10:52:13.364 DEBUG:teuthology.orchestra.run.trial138:> ' 2026-02-17T10:52:43.407 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-17T10:52:43.408 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-17T10:52:43.409 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T10:53:43.471 DEBUG:teuthology.orchestra.remote:timed out 2026-02-17T10:53:52.480 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-17T10:53:52.481 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T10:53:52.615 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-17T10:53:52.785 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-17T10:53:52.786 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-681.el9.x86_64"... 2026-02-17T10:53:52.786 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-17T10:53:52.842 INFO:teuthology.orchestra.run.trial138.stdout:5.14.0-681.el9.x86_64 2026-02-17T10:53:52.843 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-17T10:53:52.843 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T10:53:52.843 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-17T10:53:53.844 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-17T10:53:53.844 DEBUG:teuthology.orchestra.run.trial138:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T10:53:53.874 INFO:teuthology.orchestra.run.trial138.stdout:ttyS1 2026-02-17T10:53:53.899 DEBUG:teuthology.parallel:result is None 2026-02-17T10:53:53.899 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-17T10:53:53.911 INFO:teuthology.task.internal:Creating test directory... 2026-02-17T10:53:53.911 DEBUG:teuthology.orchestra.run.trial138:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T10:53:53.957 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-17T10:53:53.971 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-17T10:53:53.989 INFO:teuthology.task.internal:Creating archive directory... 2026-02-17T10:53:53.989 DEBUG:teuthology.orchestra.run.trial138:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T10:53:54.022 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-17T10:53:54.034 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-17T10:53:54.034 DEBUG:teuthology.orchestra.run.trial138:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T10:53:54.079 INFO:teuthology.orchestra.run.trial138.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T10:53:54.088 INFO:teuthology.orchestra.run.trial138.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T10:53:54.090 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-17T10:53:54.104 INFO:teuthology.task.internal:Configuring sudo... 2026-02-17T10:53:54.105 DEBUG:teuthology.orchestra.run.trial138:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T10:53:54.154 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-17T10:53:54.171 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-17T10:53:54.171 DEBUG:teuthology.orchestra.run.trial138:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T10:53:54.209 DEBUG:teuthology.orchestra.run.trial138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T10:53:54.368 DEBUG:teuthology.orchestra.run.trial138:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T10:53:54.393 DEBUG:teuthology.orchestra.run.trial138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T10:53:54.539 DEBUG:teuthology.orchestra.run.trial138:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T10:53:54.562 DEBUG:teuthology.orchestra.run.trial138:> set -ex 2026-02-17T10:53:54.562 DEBUG:teuthology.orchestra.run.trial138:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T10:53:54.627 DEBUG:teuthology.orchestra.run.trial138:> sudo service rsyslog restart 2026-02-17T10:53:54.696 INFO:teuthology.orchestra.run.trial138.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T10:53:55.091 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-17T10:53:55.104 INFO:teuthology.task.internal:Starting timer... 2026-02-17T10:53:55.105 INFO:teuthology.run_tasks:Running task pcp... 2026-02-17T10:53:55.136 INFO:teuthology.run_tasks:Running task selinux... 2026-02-17T10:53:55.154 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2026-02-17T10:53:55.154 DEBUG:teuthology.orchestra.run.trial138:> sudo service auditd rotate 2026-02-17T10:53:55.182 INFO:teuthology.orchestra.run.trial138.stdout:Rotating logs: 2026-02-17T10:53:55.183 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-17T10:53:55.184 DEBUG:teuthology.orchestra.run.trial138:> /usr/sbin/getenforce 2026-02-17T10:53:55.241 INFO:teuthology.orchestra.run.trial138.stdout:Permissive 2026-02-17T10:53:55.241 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial138.front.sepia.ceph.com': 'permissive'} 2026-02-17T10:53:55.242 DEBUG:teuthology.orchestra.run.trial138:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T10:53:55.306 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T10:53:55.307 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-17T10:53:55.307 DEBUG:teuthology.orchestra.run.trial138:> sudo /usr/sbin/setenforce permissive 2026-02-17T10:53:55.371 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-17T10:53:55.387 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-17T10:53:55.399 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-17T10:53:55.401 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial138.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-17T10:56:39.448 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial138.front.sepia.ceph.com')] 2026-02-17T10:56:39.449 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-17T10:56:39.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T10:56:39.525 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-17T10:56:39.602 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-17T10:56:39.602 INFO:teuthology.run_tasks:Running task clock... 2026-02-17T10:56:39.616 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-17T10:56:39.616 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T10:56:39.616 DEBUG:teuthology.orchestra.run.trial138:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T10:56:39.671 INFO:teuthology.orchestra.run.trial138.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-17T10:56:39.683 INFO:teuthology.orchestra.run.trial138.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-17T10:56:39.703 INFO:teuthology.orchestra.run.trial138.stderr:sudo: ntpd: command not found 2026-02-17T10:56:39.712 INFO:teuthology.orchestra.run.trial138.stdout:506 Cannot talk to daemon 2026-02-17T10:56:39.724 INFO:teuthology.orchestra.run.trial138.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-17T10:56:39.735 INFO:teuthology.orchestra.run.trial138.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-17T10:56:39.786 INFO:teuthology.orchestra.run.trial138.stderr:bash: line 1: ntpq: command not found 2026-02-17T10:56:39.788 INFO:teuthology.orchestra.run.trial138.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T10:56:39.788 INFO:teuthology.orchestra.run.trial138.stdout:=============================================================================== 2026-02-17T10:56:39.788 INFO:teuthology.run_tasks:Running task install... 2026-02-17T10:56:39.800 DEBUG:teuthology.task.install:project ceph 2026-02-17T10:56:39.800 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'}} 2026-02-17T10:56:39.801 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'} 2026-02-17T10:56:39.801 INFO:teuthology.task.install:Using flavor: default 2026-02-17T10:56:39.813 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-17T10:56:39.813 INFO:teuthology.task.install:extra packages: [] 2026-02-17T10:56:39.814 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e', 'tag': None, 'wait_for_package': False} 2026-02-17T10:56:39.814 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T10:56:39.974 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/ 2026-02-17T10:56:39.974 INFO:teuthology.task.install.rpm:Package version is 19.2.3-705.g04cf6dd4 2026-02-17T10:56:40.114 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-17T10:56:40.114 DEBUG:teuthology.orchestra.run.trial138:> set -ex 2026-02-17T10:56:40.114 DEBUG:teuthology.orchestra.run.trial138:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-17T10:56:40.139 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-17T10:56:40.140 DEBUG:teuthology.orchestra.run.trial138:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-17T10:56:40.207 DEBUG:teuthology.orchestra.run.trial138:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-17T10:56:40.280 DEBUG:teuthology.orchestra.run.trial138:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-17T10:56:40.344 INFO:teuthology.orchestra.run.trial138.stdout:check_obsoletes = 1 2026-02-17T10:56:40.346 DEBUG:teuthology.orchestra.run.trial138:> sudo yum clean all 2026-02-17T10:56:40.495 INFO:teuthology.orchestra.run.trial138.stdout:41 files removed 2026-02-17T10:56:40.510 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install ceph-radosgw 2026-02-17T10:56:40.778 INFO:teuthology.orchestra.run.trial138.stdout:ceph packages for x86_64 677 kB/s | 86 kB 00:00 2026-02-17T10:56:41.027 INFO:teuthology.orchestra.run.trial138.stdout:ceph noarch packages 53 kB/s | 12 kB 00:00 2026-02-17T10:56:41.497 INFO:teuthology.orchestra.run.trial138.stdout:ceph source packages 4.2 kB/s | 1.9 kB 00:00 2026-02-17T10:56:44.948 INFO:teuthology.orchestra.run.trial138.stdout:CentOS Stream 9 - BaseOS 2.6 MB/s | 8.9 MB 00:03 2026-02-17T10:56:48.985 INFO:teuthology.orchestra.run.trial138.stdout:CentOS Stream 9 - AppStream 7.7 MB/s | 27 MB 00:03 2026-02-17T10:56:52.745 INFO:teuthology.orchestra.run.trial138.stdout:CentOS Stream 9 - CRB 5.8 MB/s | 7.8 MB 00:01 2026-02-17T10:56:54.750 INFO:teuthology.orchestra.run.trial138.stdout:CentOS Stream 9 - Extras packages 16 kB/s | 20 kB 00:01 2026-02-17T10:56:55.415 INFO:teuthology.orchestra.run.trial138.stdout:Extra Packages for Enterprise Linux 34 MB/s | 20 MB 00:00 2026-02-17T10:56:58.614 INFO:teuthology.orchestra.run.trial138.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-17T10:56:59.841 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T10:56:59.843 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T10:56:59.843 INFO:teuthology.orchestra.run.trial138.stdout: Package Arch Version Repository Size 2026-02-17T10:56:59.843 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T10:56:59.843 INFO:teuthology.orchestra.run.trial138.stdout:Installing: 2026-02-17T10:56:59.843 INFO:teuthology.orchestra.run.trial138.stdout: ceph-radosgw x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 11 M 2026-02-17T10:56:59.843 INFO:teuthology.orchestra.run.trial138.stdout:Upgrading: 2026-02-17T10:56:59.843 INFO:teuthology.orchestra.run.trial138.stdout: librados2 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 3.4 M 2026-02-17T10:56:59.843 INFO:teuthology.orchestra.run.trial138.stdout: librbd1 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 3.2 M 2026-02-17T10:56:59.844 INFO:teuthology.orchestra.run.trial138.stdout:Installing dependencies: 2026-02-17T10:56:59.844 INFO:teuthology.orchestra.run.trial138.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-17T10:56:59.844 INFO:teuthology.orchestra.run.trial138.stdout: ceph-base x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 5.5 M 2026-02-17T10:56:59.844 INFO:teuthology.orchestra.run.trial138.stdout: ceph-common x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 22 M 2026-02-17T10:56:59.844 INFO:teuthology.orchestra.run.trial138.stdout: ceph-selinux x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 25 k 2026-02-17T10:56:59.844 INFO:teuthology.orchestra.run.trial138.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-17T10:56:59.844 INFO:teuthology.orchestra.run.trial138.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-17T10:56:59.844 INFO:teuthology.orchestra.run.trial138.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-17T10:56:59.844 INFO:teuthology.orchestra.run.trial138.stdout: libcephfs2 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 1.0 M 2026-02-17T10:56:59.844 INFO:teuthology.orchestra.run.trial138.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-17T10:56:59.844 INFO:teuthology.orchestra.run.trial138.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-17T10:56:59.845 INFO:teuthology.orchestra.run.trial138.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-17T10:56:59.845 INFO:teuthology.orchestra.run.trial138.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-17T10:56:59.845 INFO:teuthology.orchestra.run.trial138.stdout: libradosstriper1 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 503 k 2026-02-17T10:56:59.845 INFO:teuthology.orchestra.run.trial138.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-17T10:56:59.845 INFO:teuthology.orchestra.run.trial138.stdout: librgw2 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 5.4 M 2026-02-17T10:56:59.845 INFO:teuthology.orchestra.run.trial138.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-17T10:56:59.845 INFO:teuthology.orchestra.run.trial138.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-17T10:56:59.845 INFO:teuthology.orchestra.run.trial138.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-17T10:56:59.845 INFO:teuthology.orchestra.run.trial138.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-17T10:56:59.845 INFO:teuthology.orchestra.run.trial138.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-17T10:56:59.845 INFO:teuthology.orchestra.run.trial138.stdout: python3-ceph-argparse x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 45 k 2026-02-17T10:56:59.845 INFO:teuthology.orchestra.run.trial138.stdout: python3-ceph-common x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 154 k 2026-02-17T10:56:59.845 INFO:teuthology.orchestra.run.trial138.stdout: python3-cephfs x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 165 k 2026-02-17T10:56:59.846 INFO:teuthology.orchestra.run.trial138.stdout: python3-rados x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 323 k 2026-02-17T10:56:59.846 INFO:teuthology.orchestra.run.trial138.stdout: python3-rbd x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 303 k 2026-02-17T10:56:59.846 INFO:teuthology.orchestra.run.trial138.stdout: python3-rgw x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 100 k 2026-02-17T10:56:59.846 INFO:teuthology.orchestra.run.trial138.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-17T10:56:59.846 INFO:teuthology.orchestra.run.trial138.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-17T10:56:59.846 INFO:teuthology.orchestra.run.trial138.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-17T10:56:59.846 INFO:teuthology.orchestra.run.trial138.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-17T10:56:59.846 INFO:teuthology.orchestra.run.trial138.stdout:Installing weak dependencies: 2026-02-17T10:56:59.846 INFO:teuthology.orchestra.run.trial138.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-17T10:56:59.846 INFO:teuthology.orchestra.run.trial138.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-17T10:56:59.846 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:56:59.847 INFO:teuthology.orchestra.run.trial138.stdout:Transaction Summary 2026-02-17T10:56:59.847 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T10:56:59.847 INFO:teuthology.orchestra.run.trial138.stdout:Install 33 Packages 2026-02-17T10:56:59.847 INFO:teuthology.orchestra.run.trial138.stdout:Upgrade 2 Packages 2026-02-17T10:56:59.847 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:56:59.847 INFO:teuthology.orchestra.run.trial138.stdout:Total download size: 63 M 2026-02-17T10:56:59.848 INFO:teuthology.orchestra.run.trial138.stdout:Downloading Packages: 2026-02-17T10:57:01.293 INFO:teuthology.orchestra.run.trial138.stdout:(1/35): ceph-base-19.2.3-705.g04cf6dd4.el9.x86_ 5.6 MB/s | 5.5 MB 00:00 2026-02-17T10:57:01.304 INFO:teuthology.orchestra.run.trial138.stdout:(2/35): ceph-selinux-19.2.3-705.g04cf6dd4.el9.x 2.1 MB/s | 25 kB 00:00 2026-02-17T10:57:01.360 INFO:teuthology.orchestra.run.trial138.stdout:(3/35): libcephfs2-19.2.3-705.g04cf6dd4.el9.x86 18 MB/s | 1.0 MB 00:00 2026-02-17T10:57:01.398 INFO:teuthology.orchestra.run.trial138.stdout:(4/35): libradosstriper1-19.2.3-705.g04cf6dd4.e 13 MB/s | 503 kB 00:00 2026-02-17T10:57:01.540 INFO:teuthology.orchestra.run.trial138.stdout:(5/35): ceph-radosgw-19.2.3-705.g04cf6dd4.el9.x 8.8 MB/s | 11 MB 00:01 2026-02-17T10:57:01.562 INFO:teuthology.orchestra.run.trial138.stdout:(6/35): python3-ceph-argparse-19.2.3-705.g04cf6 2.0 MB/s | 45 kB 00:00 2026-02-17T10:57:01.586 INFO:teuthology.orchestra.run.trial138.stdout:(7/35): python3-ceph-common-19.2.3-705.g04cf6dd 6.3 MB/s | 154 kB 00:00 2026-02-17T10:57:01.611 INFO:teuthology.orchestra.run.trial138.stdout:(8/35): python3-cephfs-19.2.3-705.g04cf6dd4.el9 6.4 MB/s | 165 kB 00:00 2026-02-17T10:57:01.641 INFO:teuthology.orchestra.run.trial138.stdout:(9/35): python3-rados-19.2.3-705.g04cf6dd4.el9. 11 MB/s | 323 kB 00:00 2026-02-17T10:57:01.660 INFO:teuthology.orchestra.run.trial138.stdout:(10/35): librgw2-19.2.3-705.g04cf6dd4.el9.x86_6 21 MB/s | 5.4 MB 00:00 2026-02-17T10:57:01.667 INFO:teuthology.orchestra.run.trial138.stdout:(11/35): python3-rbd-19.2.3-705.g04cf6dd4.el9.x 11 MB/s | 303 kB 00:00 2026-02-17T10:57:01.681 INFO:teuthology.orchestra.run.trial138.stdout:(12/35): python3-rgw-19.2.3-705.g04cf6dd4.el9.x 4.6 MB/s | 100 kB 00:00 2026-02-17T10:57:01.818 INFO:teuthology.orchestra.run.trial138.stdout:(13/35): ceph-common-19.2.3-705.g04cf6dd4.el9.x 14 MB/s | 22 MB 00:01 2026-02-17T10:57:02.246 INFO:teuthology.orchestra.run.trial138.stdout:(14/35): mailcap-2.1.49-5.el9.noarch.rpm 57 kB/s | 33 kB 00:00 2026-02-17T10:57:02.288 INFO:teuthology.orchestra.run.trial138.stdout:(15/35): boost-program-options-1.75.0-13.el9.x8 2.4 MB/s | 104 kB 00:00 2026-02-17T10:57:02.307 INFO:teuthology.orchestra.run.trial138.stdout:(16/35): libnbd-1.20.3-4.el9.x86_64.rpm 8.8 MB/s | 164 kB 00:00 2026-02-17T10:57:02.318 INFO:teuthology.orchestra.run.trial138.stdout:(17/35): libpmemobj-1.12.1-1.el9.x86_64.rpm 13 MB/s | 160 kB 00:00 2026-02-17T10:57:02.328 INFO:teuthology.orchestra.run.trial138.stdout:(18/35): librabbitmq-0.11.0-7.el9.x86_64.rpm 4.8 MB/s | 45 kB 00:00 2026-02-17T10:57:02.351 INFO:teuthology.orchestra.run.trial138.stdout:(19/35): librdkafka-1.6.1-102.el9.x86_64.rpm 28 MB/s | 662 kB 00:00 2026-02-17T10:57:02.363 INFO:teuthology.orchestra.run.trial138.stdout:(20/35): lttng-ust-2.12.0-6.el9.x86_64.rpm 26 MB/s | 292 kB 00:00 2026-02-17T10:57:02.374 INFO:teuthology.orchestra.run.trial138.stdout:(21/35): qatlib-25.08.0-2.el9.x86_64.rpm 22 MB/s | 240 kB 00:00 2026-02-17T10:57:02.383 INFO:teuthology.orchestra.run.trial138.stdout:(22/35): qatlib-service-25.08.0-2.el9.x86_64.rp 4.0 MB/s | 37 kB 00:00 2026-02-17T10:57:02.392 INFO:teuthology.orchestra.run.trial138.stdout:(23/35): qatzip-libs-1.3.1-1.el9.x86_64.rpm 6.9 MB/s | 66 kB 00:00 2026-02-17T10:57:02.556 INFO:teuthology.orchestra.run.trial138.stdout:(24/35): pciutils-3.7.0-7.el9.x86_64.rpm 126 kB/s | 93 kB 00:00 2026-02-17T10:57:02.829 INFO:teuthology.orchestra.run.trial138.stdout:(25/35): gperftools-libs-2.9.1-3.el9.x86_64.rpm 704 kB/s | 308 kB 00:00 2026-02-17T10:57:03.046 INFO:teuthology.orchestra.run.trial138.stdout:(26/35): libarrow-doc-9.0.0-15.el9.noarch.rpm 114 kB/s | 25 kB 00:00 2026-02-17T10:57:03.332 INFO:teuthology.orchestra.run.trial138.stdout:(27/35): liboath-2.6.12-1.el9.x86_64.rpm 171 kB/s | 49 kB 00:00 2026-02-17T10:57:03.467 INFO:teuthology.orchestra.run.trial138.stdout:(28/35): libarrow-9.0.0-15.el9.x86_64.rpm 4.8 MB/s | 4.4 MB 00:00 2026-02-17T10:57:03.621 INFO:teuthology.orchestra.run.trial138.stdout:(29/35): libunwind-1.6.2-1.el9.x86_64.rpm 233 kB/s | 67 kB 00:00 2026-02-17T10:57:03.954 INFO:teuthology.orchestra.run.trial138.stdout:(30/35): parquet-libs-9.0.0-15.el9.x86_64.rpm 1.7 MB/s | 838 kB 00:00 2026-02-17T10:57:03.982 INFO:teuthology.orchestra.run.trial138.stdout:(31/35): re2-20211101-20.el9.x86_64.rpm 529 kB/s | 191 kB 00:00 2026-02-17T10:57:04.108 INFO:teuthology.orchestra.run.trial138.stdout:(32/35): librados2-19.2.3-705.g04cf6dd4.el9.x86 27 MB/s | 3.4 MB 00:00 2026-02-17T10:57:04.168 INFO:teuthology.orchestra.run.trial138.stdout:(33/35): librbd1-19.2.3-705.g04cf6dd4.el9.x86_6 53 MB/s | 3.2 MB 00:00 2026-02-17T10:57:04.520 INFO:teuthology.orchestra.run.trial138.stdout:(34/35): nvme-cli-2.13-1.el9.x86_64.rpm 396 kB/s | 1.1 MB 00:02 2026-02-17T10:57:04.584 INFO:teuthology.orchestra.run.trial138.stdout:(35/35): thrift-0.15.0-4.el9.x86_64.rpm 2.5 MB/s | 1.6 MB 00:00 2026-02-17T10:57:04.589 INFO:teuthology.orchestra.run.trial138.stdout:-------------------------------------------------------------------------------- 2026-02-17T10:57:04.589 INFO:teuthology.orchestra.run.trial138.stdout:Total 13 MB/s | 63 MB 00:04 2026-02-17T10:57:04.690 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction check 2026-02-17T10:57:04.708 INFO:teuthology.orchestra.run.trial138.stdout:Transaction check succeeded. 2026-02-17T10:57:04.708 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction test 2026-02-17T10:57:04.947 INFO:teuthology.orchestra.run.trial138.stdout:Transaction test succeeded. 2026-02-17T10:57:04.947 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction 2026-02-17T10:57:05.238 INFO:teuthology.orchestra.run.trial138.stdout: Preparing : 1/1 2026-02-17T10:57:05.246 INFO:teuthology.orchestra.run.trial138.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/37 2026-02-17T10:57:05.249 INFO:teuthology.orchestra.run.trial138.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/37 2026-02-17T10:57:05.260 INFO:teuthology.orchestra.run.trial138.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/37 2026-02-17T10:57:05.409 INFO:teuthology.orchestra.run.trial138.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/37 2026-02-17T10:57:05.413 INFO:teuthology.orchestra.run.trial138.stdout: Upgrading : librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/37 2026-02-17T10:57:05.444 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/37 2026-02-17T10:57:05.487 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-rados-2:19.2.3-705.g04cf6dd4.el9.x86_64 6/37 2026-02-17T10:57:05.488 INFO:teuthology.orchestra.run.trial138.stdout: Installing : libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 7/37 2026-02-17T10:57:05.500 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 7/37 2026-02-17T10:57:05.504 INFO:teuthology.orchestra.run.trial138.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/37 2026-02-17T10:57:05.514 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-ceph-argparse-2:19.2.3-705.g04cf6dd4.el9.x 9/37 2026-02-17T10:57:05.536 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-cephfs-2:19.2.3-705.g04cf6dd4.el9.x86_64 10/37 2026-02-17T10:57:05.537 INFO:teuthology.orchestra.run.trial138.stdout: Installing : libradosstriper1-2:19.2.3-705.g04cf6dd4.el9.x86_64 11/37 2026-02-17T10:57:05.550 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: libradosstriper1-2:19.2.3-705.g04cf6dd4.el9.x86_64 11/37 2026-02-17T10:57:05.581 INFO:teuthology.orchestra.run.trial138.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/37 2026-02-17T10:57:05.586 INFO:teuthology.orchestra.run.trial138.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/37 2026-02-17T10:57:05.592 INFO:teuthology.orchestra.run.trial138.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/37 2026-02-17T10:57:05.595 INFO:teuthology.orchestra.run.trial138.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/37 2026-02-17T10:57:05.598 INFO:teuthology.orchestra.run.trial138.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/37 2026-02-17T10:57:05.602 INFO:teuthology.orchestra.run.trial138.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/37 2026-02-17T10:57:05.741 INFO:teuthology.orchestra.run.trial138.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T10:57:05.742 INFO:teuthology.orchestra.run.trial138.stdout: Upgrading : librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 19/37 2026-02-17T10:57:05.767 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 19/37 2026-02-17T10:57:05.770 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-rbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 20/37 2026-02-17T10:57:05.776 INFO:teuthology.orchestra.run.trial138.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/37 2026-02-17T10:57:05.999 INFO:teuthology.orchestra.run.trial138.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/37 2026-02-17T10:57:06.000 INFO:teuthology.orchestra.run.trial138.stdout: Installing : librgw2-2:19.2.3-705.g04cf6dd4.el9.x86_64 23/37 2026-02-17T10:57:06.016 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: librgw2-2:19.2.3-705.g04cf6dd4.el9.x86_64 23/37 2026-02-17T10:57:06.020 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-rgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 24/37 2026-02-17T10:57:06.026 INFO:teuthology.orchestra.run.trial138.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/37 2026-02-17T10:57:06.028 INFO:teuthology.orchestra.run.trial138.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/37 2026-02-17T10:57:06.029 INFO:teuthology.orchestra.run.trial138.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T10:57:06.047 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T10:57:06.161 INFO:teuthology.orchestra.run.trial138.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/37 2026-02-17T10:57:06.163 INFO:teuthology.orchestra.run.trial138.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T10:57:06.447 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T10:57:06.447 INFO:teuthology.orchestra.run.trial138.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T10:57:06.448 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:06.487 INFO:teuthology.orchestra.run.trial138.stdout: Installing : mailcap-2.1.49-5.el9.noarch 30/37 2026-02-17T10:57:06.488 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86 31/37 2026-02-17T10:57:07.470 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 32/37 2026-02-17T10:57:07.472 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 32/37 2026-02-17T10:57:07.751 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 32/37 2026-02-17T10:57:07.755 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 33/37 2026-02-17T10:57:07.795 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 33/37 2026-02-17T10:57:07.795 INFO:teuthology.orchestra.run.trial138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-17T10:57:07.795 INFO:teuthology.orchestra.run.trial138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-17T10:57:07.795 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:07.799 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-selinux-2:19.2.3-705.g04cf6dd4.el9.x86_64 34/37 2026-02-17T10:57:12.305 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-selinux-2:19.2.3-705.g04cf6dd4.el9.x86_64 34/37 2026-02-17T10:57:12.305 INFO:teuthology.orchestra.run.trial138.stdout:skipping the directory /sys 2026-02-17T10:57:12.305 INFO:teuthology.orchestra.run.trial138.stdout:skipping the directory /proc 2026-02-17T10:57:12.305 INFO:teuthology.orchestra.run.trial138.stdout:skipping the directory /mnt 2026-02-17T10:57:12.306 INFO:teuthology.orchestra.run.trial138.stdout:skipping the directory /var/tmp 2026-02-17T10:57:12.306 INFO:teuthology.orchestra.run.trial138.stdout:skipping the directory /home 2026-02-17T10:57:12.306 INFO:teuthology.orchestra.run.trial138.stdout:skipping the directory /root 2026-02-17T10:57:12.306 INFO:teuthology.orchestra.run.trial138.stdout:skipping the directory /tmp 2026-02-17T10:57:12.306 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:12.759 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-radosgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 35/37 2026-02-17T10:57:12.782 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 35/37 2026-02-17T10:57:12.782 INFO:teuthology.orchestra.run.trial138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T10:57:12.782 INFO:teuthology.orchestra.run.trial138.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-17T10:57:12.782 INFO:teuthology.orchestra.run.trial138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T10:57:12.782 INFO:teuthology.orchestra.run.trial138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T10:57:12.783 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:12.784 INFO:teuthology.orchestra.run.trial138.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T10:57:12.798 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T10:57:12.798 INFO:teuthology.orchestra.run.trial138.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T10:57:12.854 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T10:57:12.854 INFO:teuthology.orchestra.run.trial138.stdout:Creating group 'qat' with GID 992. 2026-02-17T10:57:12.855 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:13.123 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/37 2026-02-17T10:57:13.123 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 2/37 2026-02-17T10:57:13.123 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-radosgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 3/37 2026-02-17T10:57:13.123 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-selinux-2:19.2.3-705.g04cf6dd4.el9.x86_64 4/37 2026-02-17T10:57:13.123 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/37 2026-02-17T10:57:13.123 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : libradosstriper1-2:19.2.3-705.g04cf6dd4.el9.x86_64 6/37 2026-02-17T10:57:13.123 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : librgw2-2:19.2.3-705.g04cf6dd4.el9.x86_64 7/37 2026-02-17T10:57:13.123 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-ceph-argparse-2:19.2.3-705.g04cf6dd4.el9.x 8/37 2026-02-17T10:57:13.123 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86 9/37 2026-02-17T10:57:13.123 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-cephfs-2:19.2.3-705.g04cf6dd4.el9.x86_64 10/37 2026-02-17T10:57:13.123 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-rados-2:19.2.3-705.g04cf6dd4.el9.x86_64 11/37 2026-02-17T10:57:13.123 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-rbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 12/37 2026-02-17T10:57:13.123 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-rgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 13/37 2026-02-17T10:57:13.123 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/37 2026-02-17T10:57:13.123 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 15/37 2026-02-17T10:57:13.123 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 16/37 2026-02-17T10:57:13.123 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 17/37 2026-02-17T10:57:13.123 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T10:57:13.123 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 19/37 2026-02-17T10:57:13.123 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 20/37 2026-02-17T10:57:13.123 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 21/37 2026-02-17T10:57:13.123 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 22/37 2026-02-17T10:57:13.123 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 23/37 2026-02-17T10:57:13.123 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 24/37 2026-02-17T10:57:13.124 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 25/37 2026-02-17T10:57:13.124 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 26/37 2026-02-17T10:57:13.124 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 27/37 2026-02-17T10:57:13.124 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 28/37 2026-02-17T10:57:13.124 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 29/37 2026-02-17T10:57:13.124 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 30/37 2026-02-17T10:57:13.124 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 31/37 2026-02-17T10:57:13.124 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : re2-1:20211101-20.el9.x86_64 32/37 2026-02-17T10:57:13.124 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 33/37 2026-02-17T10:57:13.124 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 34/37 2026-02-17T10:57:13.124 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 35/37 2026-02-17T10:57:13.124 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 36/37 2026-02-17T10:57:13.185 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T10:57:13.185 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:13.185 INFO:teuthology.orchestra.run.trial138.stdout:Upgraded: 2026-02-17T10:57:13.185 INFO:teuthology.orchestra.run.trial138.stdout: librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T10:57:13.185 INFO:teuthology.orchestra.run.trial138.stdout: librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T10:57:13.186 INFO:teuthology.orchestra.run.trial138.stdout:Installed: 2026-02-17T10:57:13.186 INFO:teuthology.orchestra.run.trial138.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-17T10:57:13.186 INFO:teuthology.orchestra.run.trial138.stdout: ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T10:57:13.186 INFO:teuthology.orchestra.run.trial138.stdout: ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T10:57:13.186 INFO:teuthology.orchestra.run.trial138.stdout: ceph-radosgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T10:57:13.186 INFO:teuthology.orchestra.run.trial138.stdout: ceph-selinux-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T10:57:13.186 INFO:teuthology.orchestra.run.trial138.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-17T10:57:13.186 INFO:teuthology.orchestra.run.trial138.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-17T10:57:13.186 INFO:teuthology.orchestra.run.trial138.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-17T10:57:13.186 INFO:teuthology.orchestra.run.trial138.stdout: libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T10:57:13.187 INFO:teuthology.orchestra.run.trial138.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-17T10:57:13.187 INFO:teuthology.orchestra.run.trial138.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-17T10:57:13.187 INFO:teuthology.orchestra.run.trial138.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-17T10:57:13.187 INFO:teuthology.orchestra.run.trial138.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-17T10:57:13.187 INFO:teuthology.orchestra.run.trial138.stdout: libradosstriper1-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T10:57:13.187 INFO:teuthology.orchestra.run.trial138.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-17T10:57:13.187 INFO:teuthology.orchestra.run.trial138.stdout: librgw2-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T10:57:13.187 INFO:teuthology.orchestra.run.trial138.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-17T10:57:13.188 INFO:teuthology.orchestra.run.trial138.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-17T10:57:13.188 INFO:teuthology.orchestra.run.trial138.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-17T10:57:13.188 INFO:teuthology.orchestra.run.trial138.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-17T10:57:13.188 INFO:teuthology.orchestra.run.trial138.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-17T10:57:13.188 INFO:teuthology.orchestra.run.trial138.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-17T10:57:13.188 INFO:teuthology.orchestra.run.trial138.stdout: python3-ceph-argparse-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T10:57:13.188 INFO:teuthology.orchestra.run.trial138.stdout: python3-ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T10:57:13.188 INFO:teuthology.orchestra.run.trial138.stdout: python3-cephfs-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T10:57:13.188 INFO:teuthology.orchestra.run.trial138.stdout: python3-rados-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T10:57:13.188 INFO:teuthology.orchestra.run.trial138.stdout: python3-rbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T10:57:13.188 INFO:teuthology.orchestra.run.trial138.stdout: python3-rgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T10:57:13.188 INFO:teuthology.orchestra.run.trial138.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-17T10:57:13.189 INFO:teuthology.orchestra.run.trial138.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-17T10:57:13.189 INFO:teuthology.orchestra.run.trial138.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-17T10:57:13.189 INFO:teuthology.orchestra.run.trial138.stdout: re2-1:20211101-20.el9.x86_64 2026-02-17T10:57:13.189 INFO:teuthology.orchestra.run.trial138.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-17T10:57:13.189 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:13.189 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T10:57:13.226 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install ceph-test 2026-02-17T10:57:13.536 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:15 ago on Tue 17 Feb 2026 10:56:58 AM UTC. 2026-02-17T10:57:13.617 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T10:57:13.618 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T10:57:13.618 INFO:teuthology.orchestra.run.trial138.stdout: Package Arch Version Repository Size 2026-02-17T10:57:13.618 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T10:57:13.618 INFO:teuthology.orchestra.run.trial138.stdout:Installing: 2026-02-17T10:57:13.619 INFO:teuthology.orchestra.run.trial138.stdout: ceph-test x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 50 M 2026-02-17T10:57:13.619 INFO:teuthology.orchestra.run.trial138.stdout:Installing dependencies: 2026-02-17T10:57:13.619 INFO:teuthology.orchestra.run.trial138.stdout: libcephsqlite x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 163 k 2026-02-17T10:57:13.619 INFO:teuthology.orchestra.run.trial138.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-17T10:57:13.619 INFO:teuthology.orchestra.run.trial138.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-17T10:57:13.619 INFO:teuthology.orchestra.run.trial138.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-17T10:57:13.619 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:13.619 INFO:teuthology.orchestra.run.trial138.stdout:Transaction Summary 2026-02-17T10:57:13.619 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T10:57:13.619 INFO:teuthology.orchestra.run.trial138.stdout:Install 5 Packages 2026-02-17T10:57:13.619 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:13.620 INFO:teuthology.orchestra.run.trial138.stdout:Total download size: 50 M 2026-02-17T10:57:13.620 INFO:teuthology.orchestra.run.trial138.stdout:Installed size: 212 M 2026-02-17T10:57:13.620 INFO:teuthology.orchestra.run.trial138.stdout:Downloading Packages: 2026-02-17T10:57:14.016 INFO:teuthology.orchestra.run.trial138.stdout:(1/5): libxslt-1.1.34-12.el9.x86_64.rpm 3.2 MB/s | 233 kB 00:00 2026-02-17T10:57:14.032 INFO:teuthology.orchestra.run.trial138.stdout:(2/5): libcephsqlite-19.2.3-705.g04cf6dd4.el9.x 1.8 MB/s | 163 kB 00:00 2026-02-17T10:57:14.048 INFO:teuthology.orchestra.run.trial138.stdout:(3/5): socat-1.7.4.1-8.el9.x86_64.rpm 9.2 MB/s | 303 kB 00:00 2026-02-17T10:57:14.054 INFO:teuthology.orchestra.run.trial138.stdout:(4/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.8 MB/s | 64 kB 00:00 2026-02-17T10:57:14.958 INFO:teuthology.orchestra.run.trial138.stdout:(5/5): ceph-test-19.2.3-705.g04cf6dd4.el9.x86_6 49 MB/s | 50 MB 00:01 2026-02-17T10:57:14.960 INFO:teuthology.orchestra.run.trial138.stdout:-------------------------------------------------------------------------------- 2026-02-17T10:57:14.960 INFO:teuthology.orchestra.run.trial138.stdout:Total 38 MB/s | 50 MB 00:01 2026-02-17T10:57:14.985 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction check 2026-02-17T10:57:14.994 INFO:teuthology.orchestra.run.trial138.stdout:Transaction check succeeded. 2026-02-17T10:57:14.994 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction test 2026-02-17T10:57:15.190 INFO:teuthology.orchestra.run.trial138.stdout:Transaction test succeeded. 2026-02-17T10:57:15.190 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction 2026-02-17T10:57:15.400 INFO:teuthology.orchestra.run.trial138.stdout: Preparing : 1/1 2026-02-17T10:57:15.406 INFO:teuthology.orchestra.run.trial138.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-17T10:57:15.410 INFO:teuthology.orchestra.run.trial138.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-17T10:57:15.418 INFO:teuthology.orchestra.run.trial138.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-17T10:57:15.419 INFO:teuthology.orchestra.run.trial138.stdout: Installing : libcephsqlite-2:19.2.3-705.g04cf6dd4.el9.x86_64 4/5 2026-02-17T10:57:17.669 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: libcephsqlite-2:19.2.3-705.g04cf6dd4.el9.x86_64 4/5 2026-02-17T10:57:17.687 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-test-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/5 2026-02-17T10:57:17.905 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-test-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/5 2026-02-17T10:57:17.905 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-test-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/5 2026-02-17T10:57:17.905 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : libcephsqlite-2:19.2.3-705.g04cf6dd4.el9.x86_64 2/5 2026-02-17T10:57:17.905 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-17T10:57:17.905 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-17T10:57:17.957 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-17T10:57:17.958 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:17.958 INFO:teuthology.orchestra.run.trial138.stdout:Installed: 2026-02-17T10:57:17.958 INFO:teuthology.orchestra.run.trial138.stdout: ceph-test-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T10:57:17.958 INFO:teuthology.orchestra.run.trial138.stdout: libcephsqlite-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T10:57:17.958 INFO:teuthology.orchestra.run.trial138.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-17T10:57:17.958 INFO:teuthology.orchestra.run.trial138.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-17T10:57:17.958 INFO:teuthology.orchestra.run.trial138.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-17T10:57:17.958 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:17.958 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T10:57:17.991 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install ceph 2026-02-17T10:57:18.299 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:20 ago on Tue 17 Feb 2026 10:56:58 AM UTC. 2026-02-17T10:57:18.386 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T10:57:18.389 INFO:teuthology.orchestra.run.trial138.stdout:====================================================================================== 2026-02-17T10:57:18.389 INFO:teuthology.orchestra.run.trial138.stdout: Package Arch Version Repository Size 2026-02-17T10:57:18.389 INFO:teuthology.orchestra.run.trial138.stdout:====================================================================================== 2026-02-17T10:57:18.389 INFO:teuthology.orchestra.run.trial138.stdout:Installing: 2026-02-17T10:57:18.389 INFO:teuthology.orchestra.run.trial138.stdout: ceph x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 6.5 k 2026-02-17T10:57:18.389 INFO:teuthology.orchestra.run.trial138.stdout:Installing dependencies: 2026-02-17T10:57:18.389 INFO:teuthology.orchestra.run.trial138.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-17T10:57:18.389 INFO:teuthology.orchestra.run.trial138.stdout: ceph-grafana-dashboards noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 31 k 2026-02-17T10:57:18.389 INFO:teuthology.orchestra.run.trial138.stdout: ceph-mds x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 2.4 M 2026-02-17T10:57:18.389 INFO:teuthology.orchestra.run.trial138.stdout: ceph-mgr x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 1.1 M 2026-02-17T10:57:18.390 INFO:teuthology.orchestra.run.trial138.stdout: ceph-mgr-modules-core noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 253 k 2026-02-17T10:57:18.390 INFO:teuthology.orchestra.run.trial138.stdout: ceph-mon x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 4.7 M 2026-02-17T10:57:18.390 INFO:teuthology.orchestra.run.trial138.stdout: ceph-osd x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 17 M 2026-02-17T10:57:18.390 INFO:teuthology.orchestra.run.trial138.stdout: ceph-prometheus-alerts noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 17 k 2026-02-17T10:57:18.390 INFO:teuthology.orchestra.run.trial138.stdout: cephadm noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 769 k 2026-02-17T10:57:18.390 INFO:teuthology.orchestra.run.trial138.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-17T10:57:18.390 INFO:teuthology.orchestra.run.trial138.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-17T10:57:18.390 INFO:teuthology.orchestra.run.trial138.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-17T10:57:18.390 INFO:teuthology.orchestra.run.trial138.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-17T10:57:18.390 INFO:teuthology.orchestra.run.trial138.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-17T10:57:18.390 INFO:teuthology.orchestra.run.trial138.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-17T10:57:18.390 INFO:teuthology.orchestra.run.trial138.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-17T10:57:18.391 INFO:teuthology.orchestra.run.trial138.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-17T10:57:18.391 INFO:teuthology.orchestra.run.trial138.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-17T10:57:18.391 INFO:teuthology.orchestra.run.trial138.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-17T10:57:18.391 INFO:teuthology.orchestra.run.trial138.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-17T10:57:18.391 INFO:teuthology.orchestra.run.trial138.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-17T10:57:18.391 INFO:teuthology.orchestra.run.trial138.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-17T10:57:18.391 INFO:teuthology.orchestra.run.trial138.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-17T10:57:18.391 INFO:teuthology.orchestra.run.trial138.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-17T10:57:18.391 INFO:teuthology.orchestra.run.trial138.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-17T10:57:18.391 INFO:teuthology.orchestra.run.trial138.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-17T10:57:18.391 INFO:teuthology.orchestra.run.trial138.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-17T10:57:18.391 INFO:teuthology.orchestra.run.trial138.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-17T10:57:18.392 INFO:teuthology.orchestra.run.trial138.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-17T10:57:18.392 INFO:teuthology.orchestra.run.trial138.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-17T10:57:18.392 INFO:teuthology.orchestra.run.trial138.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-17T10:57:18.392 INFO:teuthology.orchestra.run.trial138.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-17T10:57:18.392 INFO:teuthology.orchestra.run.trial138.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-17T10:57:18.392 INFO:teuthology.orchestra.run.trial138.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-17T10:57:18.392 INFO:teuthology.orchestra.run.trial138.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-17T10:57:18.392 INFO:teuthology.orchestra.run.trial138.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-17T10:57:18.392 INFO:teuthology.orchestra.run.trial138.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-17T10:57:18.392 INFO:teuthology.orchestra.run.trial138.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-17T10:57:18.392 INFO:teuthology.orchestra.run.trial138.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-17T10:57:18.392 INFO:teuthology.orchestra.run.trial138.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-17T10:57:18.392 INFO:teuthology.orchestra.run.trial138.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-17T10:57:18.393 INFO:teuthology.orchestra.run.trial138.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-17T10:57:18.393 INFO:teuthology.orchestra.run.trial138.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-17T10:57:18.393 INFO:teuthology.orchestra.run.trial138.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-17T10:57:18.393 INFO:teuthology.orchestra.run.trial138.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-17T10:57:18.393 INFO:teuthology.orchestra.run.trial138.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-17T10:57:18.393 INFO:teuthology.orchestra.run.trial138.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-17T10:57:18.393 INFO:teuthology.orchestra.run.trial138.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-17T10:57:18.393 INFO:teuthology.orchestra.run.trial138.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-17T10:57:18.393 INFO:teuthology.orchestra.run.trial138.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-17T10:57:18.393 INFO:teuthology.orchestra.run.trial138.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-17T10:57:18.393 INFO:teuthology.orchestra.run.trial138.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-17T10:57:18.393 INFO:teuthology.orchestra.run.trial138.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-17T10:57:18.394 INFO:teuthology.orchestra.run.trial138.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-17T10:57:18.394 INFO:teuthology.orchestra.run.trial138.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-17T10:57:18.394 INFO:teuthology.orchestra.run.trial138.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-17T10:57:18.394 INFO:teuthology.orchestra.run.trial138.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-17T10:57:18.394 INFO:teuthology.orchestra.run.trial138.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-17T10:57:18.394 INFO:teuthology.orchestra.run.trial138.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-17T10:57:18.394 INFO:teuthology.orchestra.run.trial138.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-17T10:57:18.394 INFO:teuthology.orchestra.run.trial138.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-17T10:57:18.394 INFO:teuthology.orchestra.run.trial138.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-17T10:57:18.394 INFO:teuthology.orchestra.run.trial138.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-17T10:57:18.394 INFO:teuthology.orchestra.run.trial138.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-17T10:57:18.394 INFO:teuthology.orchestra.run.trial138.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-17T10:57:18.394 INFO:teuthology.orchestra.run.trial138.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-17T10:57:18.395 INFO:teuthology.orchestra.run.trial138.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-17T10:57:18.395 INFO:teuthology.orchestra.run.trial138.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-17T10:57:18.395 INFO:teuthology.orchestra.run.trial138.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-17T10:57:18.395 INFO:teuthology.orchestra.run.trial138.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-17T10:57:18.395 INFO:teuthology.orchestra.run.trial138.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-17T10:57:18.395 INFO:teuthology.orchestra.run.trial138.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-17T10:57:18.395 INFO:teuthology.orchestra.run.trial138.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-17T10:57:18.395 INFO:teuthology.orchestra.run.trial138.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-17T10:57:18.395 INFO:teuthology.orchestra.run.trial138.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-17T10:57:18.395 INFO:teuthology.orchestra.run.trial138.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-17T10:57:18.395 INFO:teuthology.orchestra.run.trial138.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-17T10:57:18.395 INFO:teuthology.orchestra.run.trial138.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-17T10:57:18.396 INFO:teuthology.orchestra.run.trial138.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-17T10:57:18.396 INFO:teuthology.orchestra.run.trial138.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-17T10:57:18.396 INFO:teuthology.orchestra.run.trial138.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-17T10:57:18.396 INFO:teuthology.orchestra.run.trial138.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-17T10:57:18.396 INFO:teuthology.orchestra.run.trial138.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-17T10:57:18.396 INFO:teuthology.orchestra.run.trial138.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-17T10:57:18.396 INFO:teuthology.orchestra.run.trial138.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-17T10:57:18.396 INFO:teuthology.orchestra.run.trial138.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-17T10:57:18.396 INFO:teuthology.orchestra.run.trial138.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-17T10:57:18.396 INFO:teuthology.orchestra.run.trial138.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-17T10:57:18.396 INFO:teuthology.orchestra.run.trial138.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-17T10:57:18.396 INFO:teuthology.orchestra.run.trial138.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-17T10:57:18.396 INFO:teuthology.orchestra.run.trial138.stdout:Installing weak dependencies: 2026-02-17T10:57:18.397 INFO:teuthology.orchestra.run.trial138.stdout: ceph-mgr-cephadm noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 150 k 2026-02-17T10:57:18.397 INFO:teuthology.orchestra.run.trial138.stdout: ceph-mgr-dashboard noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 3.8 M 2026-02-17T10:57:18.397 INFO:teuthology.orchestra.run.trial138.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 7.4 M 2026-02-17T10:57:18.397 INFO:teuthology.orchestra.run.trial138.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 22 k 2026-02-17T10:57:18.397 INFO:teuthology.orchestra.run.trial138.stdout: ceph-mgr-rook noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 49 k 2026-02-17T10:57:18.397 INFO:teuthology.orchestra.run.trial138.stdout: ceph-volume noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 299 k 2026-02-17T10:57:18.397 INFO:teuthology.orchestra.run.trial138.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-17T10:57:18.397 INFO:teuthology.orchestra.run.trial138.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-17T10:57:18.397 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:18.397 INFO:teuthology.orchestra.run.trial138.stdout:Transaction Summary 2026-02-17T10:57:18.397 INFO:teuthology.orchestra.run.trial138.stdout:====================================================================================== 2026-02-17T10:57:18.397 INFO:teuthology.orchestra.run.trial138.stdout:Install 99 Packages 2026-02-17T10:57:18.398 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:18.398 INFO:teuthology.orchestra.run.trial138.stdout:Total download size: 95 M 2026-02-17T10:57:18.398 INFO:teuthology.orchestra.run.trial138.stdout:Installed size: 520 M 2026-02-17T10:57:18.399 INFO:teuthology.orchestra.run.trial138.stdout:Downloading Packages: 2026-02-17T10:57:18.987 INFO:teuthology.orchestra.run.trial138.stdout:(1/99): ceph-19.2.3-705.g04cf6dd4.el9.x86_64.rp 116 kB/s | 6.5 kB 00:00 2026-02-17T10:57:19.062 INFO:teuthology.orchestra.run.trial138.stdout:(2/99): ceph-mgr-19.2.3-705.g04cf6dd4.el9.x86_6 8.2 MB/s | 1.1 MB 00:00 2026-02-17T10:57:19.086 INFO:teuthology.orchestra.run.trial138.stdout:(3/99): ceph-mds-19.2.3-705.g04cf6dd4.el9.x86_6 16 MB/s | 2.4 MB 00:00 2026-02-17T10:57:19.114 INFO:teuthology.orchestra.run.trial138.stdout:(4/99): ceph-grafana-dashboards-19.2.3-705.g04c 1.1 MB/s | 31 kB 00:00 2026-02-17T10:57:19.145 INFO:teuthology.orchestra.run.trial138.stdout:(5/99): ceph-mgr-cephadm-19.2.3-705.g04cf6dd4.e 4.8 MB/s | 150 kB 00:00 2026-02-17T10:57:19.288 INFO:teuthology.orchestra.run.trial138.stdout:(6/99): ceph-mon-19.2.3-705.g04cf6dd4.el9.x86_6 16 MB/s | 4.7 MB 00:00 2026-02-17T10:57:19.306 INFO:teuthology.orchestra.run.trial138.stdout:(7/99): ceph-mgr-dashboard-19.2.3-705.g04cf6dd4 24 MB/s | 3.8 MB 00:00 2026-02-17T10:57:19.340 INFO:teuthology.orchestra.run.trial138.stdout:(8/99): ceph-mgr-k8sevents-19.2.3-705.g04cf6dd4 649 kB/s | 22 kB 00:00 2026-02-17T10:57:19.382 INFO:teuthology.orchestra.run.trial138.stdout:(9/99): ceph-mgr-modules-core-19.2.3-705.g04cf6 5.9 MB/s | 253 kB 00:00 2026-02-17T10:57:19.421 INFO:teuthology.orchestra.run.trial138.stdout:(10/99): ceph-mgr-rook-19.2.3-705.g04cf6dd4.el9 1.2 MB/s | 49 kB 00:00 2026-02-17T10:57:19.462 INFO:teuthology.orchestra.run.trial138.stdout:(11/99): ceph-prometheus-alerts-19.2.3-705.g04c 413 kB/s | 17 kB 00:00 2026-02-17T10:57:19.510 INFO:teuthology.orchestra.run.trial138.stdout:(12/99): ceph-volume-19.2.3-705.g04cf6dd4.el9.n 6.1 MB/s | 299 kB 00:00 2026-02-17T10:57:19.570 INFO:teuthology.orchestra.run.trial138.stdout:(13/99): cephadm-19.2.3-705.g04cf6dd4.el9.noarc 13 MB/s | 769 kB 00:00 2026-02-17T10:57:19.649 INFO:teuthology.orchestra.run.trial138.stdout:(14/99): ceph-mgr-diskprediction-local-19.2.3-7 21 MB/s | 7.4 MB 00:00 2026-02-17T10:57:19.687 INFO:teuthology.orchestra.run.trial138.stdout:(15/99): ceph-osd-19.2.3-705.g04cf6dd4.el9.x86_ 27 MB/s | 17 MB 00:00 2026-02-17T10:57:20.103 INFO:teuthology.orchestra.run.trial138.stdout:(16/99): ledmon-libs-1.1.0-3.el9.x86_64.rpm 89 kB/s | 40 kB 00:00 2026-02-17T10:57:20.198 INFO:teuthology.orchestra.run.trial138.stdout:(17/99): libconfig-1.7.2-9.el9.x86_64.rpm 141 kB/s | 72 kB 00:00 2026-02-17T10:57:20.865 INFO:teuthology.orchestra.run.trial138.stdout:(18/99): libquadmath-11.5.0-14.el9.x86_64.rpm 277 kB/s | 184 kB 00:00 2026-02-17T10:57:21.097 INFO:teuthology.orchestra.run.trial138.stdout:(19/99): cryptsetup-2.8.1-2.el9.x86_64.rpm 229 kB/s | 350 kB 00:01 2026-02-17T10:57:21.144 INFO:teuthology.orchestra.run.trial138.stdout:(20/99): libgfortran-11.5.0-14.el9.x86_64.rpm 763 kB/s | 794 kB 00:01 2026-02-17T10:57:21.329 INFO:teuthology.orchestra.run.trial138.stdout:(21/99): python3-ply-3.11-14.el9.noarch.rpm 577 kB/s | 106 kB 00:00 2026-02-17T10:57:21.513 INFO:teuthology.orchestra.run.trial138.stdout:(22/99): python3-pycparser-2.20-6.el9.noarch.rp 733 kB/s | 135 kB 00:00 2026-02-17T10:57:21.572 INFO:teuthology.orchestra.run.trial138.stdout:(23/99): python3-cffi-1.14.5-5.el9.x86_64.rpm 358 kB/s | 253 kB 00:00 2026-02-17T10:57:21.779 INFO:teuthology.orchestra.run.trial138.stdout:(24/99): python3-pyparsing-2.4.7-9.el9.noarch.r 566 kB/s | 150 kB 00:00 2026-02-17T10:57:21.916 INFO:teuthology.orchestra.run.trial138.stdout:(25/99): python3-requests-2.25.1-10.el9.noarch. 368 kB/s | 126 kB 00:00 2026-02-17T10:57:22.127 INFO:teuthology.orchestra.run.trial138.stdout:(26/99): python3-urllib3-1.26.5-7.el9.noarch.rp 626 kB/s | 218 kB 00:00 2026-02-17T10:57:22.261 INFO:teuthology.orchestra.run.trial138.stdout:(27/99): unzip-6.0-59.el9.x86_64.rpm 528 kB/s | 182 kB 00:00 2026-02-17T10:57:22.289 INFO:teuthology.orchestra.run.trial138.stdout:(28/99): flexiblas-3.0.4-9.el9.x86_64.rpm 1.0 MB/s | 30 kB 00:00 2026-02-17T10:57:22.356 INFO:teuthology.orchestra.run.trial138.stdout:(29/99): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 45 MB/s | 3.0 MB 00:00 2026-02-17T10:57:22.365 INFO:teuthology.orchestra.run.trial138.stdout:(30/99): flexiblas-openblas-openmp-3.0.4-9.el9. 1.6 MB/s | 15 kB 00:00 2026-02-17T10:57:22.376 INFO:teuthology.orchestra.run.trial138.stdout:(31/99): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 22 MB/s | 246 kB 00:00 2026-02-17T10:57:22.387 INFO:teuthology.orchestra.run.trial138.stdout:(32/99): lua-5.4.4-4.el9.x86_64.rpm 17 MB/s | 188 kB 00:00 2026-02-17T10:57:22.396 INFO:teuthology.orchestra.run.trial138.stdout:(33/99): openblas-0.3.29-1.el9.x86_64.rpm 4.5 MB/s | 42 kB 00:00 2026-02-17T10:57:22.424 INFO:teuthology.orchestra.run.trial138.stdout:(34/99): openblas-openmp-0.3.29-1.el9.x86_64.rp 190 MB/s | 5.3 MB 00:00 2026-02-17T10:57:22.437 INFO:teuthology.orchestra.run.trial138.stdout:(35/99): protobuf-3.14.0-17.el9.x86_64.rpm 77 MB/s | 1.0 MB 00:00 2026-02-17T10:57:22.471 INFO:teuthology.orchestra.run.trial138.stdout:(36/99): python3-babel-2.9.1-2.el9.noarch.rpm 178 MB/s | 6.0 MB 00:00 2026-02-17T10:57:22.474 INFO:teuthology.orchestra.run.trial138.stdout:(37/99): zip-3.0-35.el9.x86_64.rpm 766 kB/s | 266 kB 00:00 2026-02-17T10:57:22.483 INFO:teuthology.orchestra.run.trial138.stdout:(38/99): python3-devel-3.9.25-2.el9.x86_64.rpm 20 MB/s | 244 kB 00:00 2026-02-17T10:57:22.494 INFO:teuthology.orchestra.run.trial138.stdout:(39/99): python3-libstoragemgmt-1.10.1-1.el9.x8 15 MB/s | 177 kB 00:00 2026-02-17T10:57:22.509 INFO:teuthology.orchestra.run.trial138.stdout:(40/99): python3-lxml-4.6.5-3.el9.x86_64.rpm 83 MB/s | 1.2 MB 00:00 2026-02-17T10:57:22.520 INFO:teuthology.orchestra.run.trial138.stdout:(41/99): python3-mako-1.1.4-6.el9.noarch.rpm 15 MB/s | 172 kB 00:00 2026-02-17T10:57:22.522 INFO:teuthology.orchestra.run.trial138.stdout:(42/99): python3-jinja2-2.11.3-8.el9.noarch.rpm 5.1 MB/s | 249 kB 00:00 2026-02-17T10:57:22.530 INFO:teuthology.orchestra.run.trial138.stdout:(43/99): python3-markupsafe-1.1.1-12.el9.x86_64 3.6 MB/s | 35 kB 00:00 2026-02-17T10:57:22.541 INFO:teuthology.orchestra.run.trial138.stdout:(44/99): python3-numpy-f2py-1.23.5-2.el9.x86_64 37 MB/s | 442 kB 00:00 2026-02-17T10:57:22.552 INFO:teuthology.orchestra.run.trial138.stdout:(45/99): python3-packaging-20.9-5.el9.noarch.rp 7.3 MB/s | 77 kB 00:00 2026-02-17T10:57:22.563 INFO:teuthology.orchestra.run.trial138.stdout:(46/99): python3-protobuf-3.14.0-17.el9.noarch. 24 MB/s | 267 kB 00:00 2026-02-17T10:57:22.574 INFO:teuthology.orchestra.run.trial138.stdout:(47/99): python3-pyasn1-0.4.8-6.el9.noarch.rpm 13 MB/s | 159 kB 00:00 2026-02-17T10:57:22.587 INFO:teuthology.orchestra.run.trial138.stdout:(48/99): python3-pyasn1-modules-0.4.8-6.el9.noa 23 MB/s | 279 kB 00:00 2026-02-17T10:57:22.597 INFO:teuthology.orchestra.run.trial138.stdout:(49/99): python3-requests-oauthlib-1.3.0-12.el9 5.2 MB/s | 54 kB 00:00 2026-02-17T10:57:22.657 INFO:teuthology.orchestra.run.trial138.stdout:(50/99): python3-numpy-1.23.5-2.el9.x86_64.rpm 45 MB/s | 6.1 MB 00:00 2026-02-17T10:57:22.691 INFO:teuthology.orchestra.run.trial138.stdout:(51/99): python3-scipy-1.9.3-2.el9.x86_64.rpm 205 MB/s | 19 MB 00:00 2026-02-17T10:57:22.691 INFO:teuthology.orchestra.run.trial138.stdout:(52/99): python3-toml-0.10.2-6.el9.noarch.rpm 1.2 MB/s | 42 kB 00:00 2026-02-17T10:57:22.701 INFO:teuthology.orchestra.run.trial138.stdout:(53/99): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 9.6 MB/s | 90 kB 00:00 2026-02-17T10:57:22.702 INFO:teuthology.orchestra.run.trial138.stdout:(54/99): xmlsec1-1.2.29-13.el9.x86_64.rpm 17 MB/s | 189 kB 00:00 2026-02-17T10:57:22.810 INFO:teuthology.orchestra.run.trial138.stdout:(55/99): lua-devel-5.4.4-4.el9.x86_64.rpm 204 kB/s | 22 kB 00:00 2026-02-17T10:57:22.828 INFO:teuthology.orchestra.run.trial138.stdout:(56/99): protobuf-compiler-3.14.0-17.el9.x86_64 6.7 MB/s | 862 kB 00:00 2026-02-17T10:57:22.940 INFO:teuthology.orchestra.run.trial138.stdout:(57/99): python3-cryptography-36.0.1-5.el9.x86_ 692 kB/s | 1.2 MB 00:01 2026-02-17T10:57:23.096 INFO:teuthology.orchestra.run.trial138.stdout:(58/99): grpc-data-1.46.7-10.el9.noarch.rpm 73 kB/s | 19 kB 00:00 2026-02-17T10:57:23.359 INFO:teuthology.orchestra.run.trial138.stdout:(59/99): luarocks-3.9.2-5.el9.noarch.rpm 361 kB/s | 151 kB 00:00 2026-02-17T10:57:23.367 INFO:teuthology.orchestra.run.trial138.stdout:(60/99): abseil-cpp-20211102.0-4.el9.x86_64.rpm 992 kB/s | 551 kB 00:00 2026-02-17T10:57:23.432 INFO:teuthology.orchestra.run.trial138.stdout:(61/99): python3-autocommand-2.2.2-8.el9.noarch 403 kB/s | 29 kB 00:00 2026-02-17T10:57:23.435 INFO:teuthology.orchestra.run.trial138.stdout:(62/99): python3-backports-tarfile-1.2.0-1.el9. 872 kB/s | 60 kB 00:00 2026-02-17T10:57:23.441 INFO:teuthology.orchestra.run.trial138.stdout:(63/99): python3-asyncssh-2.13.2-5.el9.noarch.r 1.6 MB/s | 548 kB 00:00 2026-02-17T10:57:23.503 INFO:teuthology.orchestra.run.trial138.stdout:(64/99): python3-cachetools-4.2.4-1.el9.noarch. 479 kB/s | 32 kB 00:00 2026-02-17T10:57:23.506 INFO:teuthology.orchestra.run.trial138.stdout:(65/99): python3-certifi-2023.05.07-4.el9.noarc 215 kB/s | 14 kB 00:00 2026-02-17T10:57:23.510 INFO:teuthology.orchestra.run.trial138.stdout:(66/99): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 557 kB/s | 43 kB 00:00 2026-02-17T10:57:23.582 INFO:teuthology.orchestra.run.trial138.stdout:(67/99): python3-cheroot-10.0.1-4.el9.noarch.rp 2.1 MB/s | 173 kB 00:00 2026-02-17T10:57:23.600 INFO:teuthology.orchestra.run.trial138.stdout:(68/99): python3-cherrypy-18.6.1-2.el9.noarch.r 3.8 MB/s | 358 kB 00:00 2026-02-17T10:57:23.653 INFO:teuthology.orchestra.run.trial138.stdout:(69/99): python3-google-auth-2.45.0-1.el9.noarc 1.7 MB/s | 254 kB 00:00 2026-02-17T10:57:23.676 INFO:teuthology.orchestra.run.trial138.stdout:(70/99): python3-grpcio-tools-1.46.7-10.el9.x86 1.9 MB/s | 144 kB 00:00 2026-02-17T10:57:23.732 INFO:teuthology.orchestra.run.trial138.stdout:(71/99): python3-influxdb-5.3.1-1.el9.noarch.rp 1.7 MB/s | 139 kB 00:00 2026-02-17T10:57:23.745 INFO:teuthology.orchestra.run.trial138.stdout:(72/99): python3-isodate-0.6.1-3.el9.noarch.rpm 815 kB/s | 56 kB 00:00 2026-02-17T10:57:23.793 INFO:teuthology.orchestra.run.trial138.stdout:(73/99): python3-grpcio-1.46.7-10.el9.x86_64.rp 9.6 MB/s | 2.0 MB 00:00 2026-02-17T10:57:23.797 INFO:teuthology.orchestra.run.trial138.stdout:(74/99): python3-jaraco-8.2.1-3.el9.noarch.rpm 163 kB/s | 11 kB 00:00 2026-02-17T10:57:23.810 INFO:teuthology.orchestra.run.trial138.stdout:(75/99): python3-jaraco-classes-3.2.1-5.el9.noa 268 kB/s | 18 kB 00:00 2026-02-17T10:57:23.859 INFO:teuthology.orchestra.run.trial138.stdout:(76/99): python3-jaraco-collections-3.0.0-8.el9 354 kB/s | 23 kB 00:00 2026-02-17T10:57:23.864 INFO:teuthology.orchestra.run.trial138.stdout:(77/99): python3-jaraco-context-6.0.1-3.el9.noa 297 kB/s | 20 kB 00:00 2026-02-17T10:57:23.876 INFO:teuthology.orchestra.run.trial138.stdout:(78/99): python3-jaraco-functools-3.5.0-2.el9.n 295 kB/s | 19 kB 00:00 2026-02-17T10:57:23.924 INFO:teuthology.orchestra.run.trial138.stdout:(79/99): python3-jaraco-text-4.0.0-2.el9.noarch 404 kB/s | 26 kB 00:00 2026-02-17T10:57:23.964 INFO:teuthology.orchestra.run.trial138.stdout:(80/99): python3-logutils-0.3.5-21.el9.noarch.r 529 kB/s | 46 kB 00:00 2026-02-17T10:57:23.991 INFO:teuthology.orchestra.run.trial138.stdout:(81/99): python3-more-itertools-8.12.0-2.el9.no 1.2 MB/s | 79 kB 00:00 2026-02-17T10:57:24.035 INFO:teuthology.orchestra.run.trial138.stdout:(82/99): python3-msgpack-1.0.3-2.el9.x86_64.rpm 1.2 MB/s | 86 kB 00:00 2026-02-17T10:57:24.046 INFO:teuthology.orchestra.run.trial138.stdout:(83/99): python3-kubernetes-26.1.0-3.el9.noarch 5.6 MB/s | 1.0 MB 00:00 2026-02-17T10:57:24.056 INFO:teuthology.orchestra.run.trial138.stdout:(84/99): python3-natsort-7.1.1-5.el9.noarch.rpm 875 kB/s | 58 kB 00:00 2026-02-17T10:57:24.112 INFO:teuthology.orchestra.run.trial138.stdout:(85/99): python3-portend-3.1.0-2.el9.noarch.rpm 251 kB/s | 16 kB 00:00 2026-02-17T10:57:24.123 INFO:teuthology.orchestra.run.trial138.stdout:(86/99): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.3 MB/s | 90 kB 00:00 2026-02-17T10:57:24.139 INFO:teuthology.orchestra.run.trial138.stdout:(87/99): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2026-02-17T10:57:24.177 INFO:teuthology.orchestra.run.trial138.stdout:(88/99): python3-repoze-lru-0.7-16.el9.noarch.r 469 kB/s | 31 kB 00:00 2026-02-17T10:57:24.192 INFO:teuthology.orchestra.run.trial138.stdout:(89/99): python3-routes-2.5.1-5.el9.noarch.rpm 2.7 MB/s | 188 kB 00:00 2026-02-17T10:57:24.208 INFO:teuthology.orchestra.run.trial138.stdout:(90/99): python3-rsa-4.9-2.el9.noarch.rpm 861 kB/s | 59 kB 00:00 2026-02-17T10:57:24.246 INFO:teuthology.orchestra.run.trial138.stdout:(91/99): python3-saml-1.16.0-1.el9.noarch.rpm 1.8 MB/s | 125 kB 00:00 2026-02-17T10:57:24.258 INFO:teuthology.orchestra.run.trial138.stdout:(92/99): python3-tempora-5.0.0-2.el9.noarch.rpm 544 kB/s | 36 kB 00:00 2026-02-17T10:57:24.280 INFO:teuthology.orchestra.run.trial138.stdout:(93/99): python3-typing-extensions-4.15.0-1.el9 1.2 MB/s | 86 kB 00:00 2026-02-17T10:57:24.325 INFO:teuthology.orchestra.run.trial138.stdout:(94/99): python3-websocket-client-1.2.3-2.el9.n 1.3 MB/s | 90 kB 00:00 2026-02-17T10:57:24.335 INFO:teuthology.orchestra.run.trial138.stdout:(95/99): python3-webob-1.8.8-2.el9.noarch.rpm 2.5 MB/s | 230 kB 00:00 2026-02-17T10:57:24.391 INFO:teuthology.orchestra.run.trial138.stdout:(96/99): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 735 kB/s | 48 kB 00:00 2026-02-17T10:57:24.392 INFO:teuthology.orchestra.run.trial138.stdout:(97/99): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.7 MB/s | 427 kB 00:00 2026-02-17T10:57:24.401 INFO:teuthology.orchestra.run.trial138.stdout:(98/99): python3-xmltodict-0.12.0-15.el9.noarch 335 kB/s | 22 kB 00:00 2026-02-17T10:57:24.456 INFO:teuthology.orchestra.run.trial138.stdout:(99/99): python3-zc-lockfile-2.0-10.el9.noarch. 305 kB/s | 20 kB 00:00 2026-02-17T10:57:24.462 INFO:teuthology.orchestra.run.trial138.stdout:-------------------------------------------------------------------------------- 2026-02-17T10:57:24.462 INFO:teuthology.orchestra.run.trial138.stdout:Total 16 MB/s | 95 MB 00:06 2026-02-17T10:57:24.884 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction check 2026-02-17T10:57:24.922 INFO:teuthology.orchestra.run.trial138.stdout:Transaction check succeeded. 2026-02-17T10:57:24.922 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction test 2026-02-17T10:57:25.336 INFO:teuthology.orchestra.run.trial138.stdout:Transaction test succeeded. 2026-02-17T10:57:25.336 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction 2026-02-17T10:57:25.782 INFO:teuthology.orchestra.run.trial138.stdout: Preparing : 1/1 2026-02-17T10:57:25.784 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/99 2026-02-17T10:57:25.815 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/99 2026-02-17T10:57:25.820 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/99 2026-02-17T10:57:25.841 INFO:teuthology.orchestra.run.trial138.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/99 2026-02-17T10:57:25.848 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/99 2026-02-17T10:57:25.881 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 6/99 2026-02-17T10:57:25.891 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 7/99 2026-02-17T10:57:25.896 INFO:teuthology.orchestra.run.trial138.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 8/99 2026-02-17T10:57:25.898 INFO:teuthology.orchestra.run.trial138.stdout: Installing : lua-5.4.4-4.el9.x86_64 9/99 2026-02-17T10:57:25.903 INFO:teuthology.orchestra.run.trial138.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 10/99 2026-02-17T10:57:25.926 INFO:teuthology.orchestra.run.trial138.stdout: Installing : unzip-6.0-59.el9.x86_64 11/99 2026-02-17T10:57:25.938 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 12/99 2026-02-17T10:57:25.942 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 13/99 2026-02-17T10:57:25.948 INFO:teuthology.orchestra.run.trial138.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 14/99 2026-02-17T10:57:25.950 INFO:teuthology.orchestra.run.trial138.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 15/99 2026-02-17T10:57:25.961 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 16/99 2026-02-17T10:57:25.967 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 17/99 2026-02-17T10:57:25.991 INFO:teuthology.orchestra.run.trial138.stdout: Installing : zip-3.0-35.el9.x86_64 18/99 2026-02-17T10:57:25.994 INFO:teuthology.orchestra.run.trial138.stdout: Installing : luarocks-3.9.2-5.el9.noarch 19/99 2026-02-17T10:57:26.001 INFO:teuthology.orchestra.run.trial138.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 20/99 2026-02-17T10:57:26.025 INFO:teuthology.orchestra.run.trial138.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 21/99 2026-02-17T10:57:26.077 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 22/99 2026-02-17T10:57:26.090 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 23/99 2026-02-17T10:57:26.092 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-rsa-4.9-2.el9.noarch 24/99 2026-02-17T10:57:26.097 INFO:teuthology.orchestra.run.trial138.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 25/99 2026-02-17T10:57:26.102 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 26/99 2026-02-17T10:57:26.107 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 27/99 2026-02-17T10:57:26.110 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 28/99 2026-02-17T10:57:26.124 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 29/99 2026-02-17T10:57:26.145 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 30/99 2026-02-17T10:57:26.150 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 31/99 2026-02-17T10:57:26.155 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 32/99 2026-02-17T10:57:26.166 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 33/99 2026-02-17T10:57:26.176 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 34/99 2026-02-17T10:57:26.182 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 35/99 2026-02-17T10:57:26.201 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 36/99 2026-02-17T10:57:26.210 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 37/99 2026-02-17T10:57:26.264 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 38/99 2026-02-17T10:57:26.277 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 39/99 2026-02-17T10:57:26.293 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 40/99 2026-02-17T10:57:26.297 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 41/99 2026-02-17T10:57:26.305 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 42/99 2026-02-17T10:57:26.345 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 43/99 2026-02-17T10:57:26.670 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 44/99 2026-02-17T10:57:26.680 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 45/99 2026-02-17T10:57:26.684 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 46/99 2026-02-17T10:57:26.690 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 47/99 2026-02-17T10:57:26.692 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 48/99 2026-02-17T10:57:26.721 INFO:teuthology.orchestra.run.trial138.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 49/99 2026-02-17T10:57:26.765 INFO:teuthology.orchestra.run.trial138.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 50/99 2026-02-17T10:57:26.772 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 51/99 2026-02-17T10:57:26.776 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 52/99 2026-02-17T10:57:26.781 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 53/99 2026-02-17T10:57:26.785 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 54/99 2026-02-17T10:57:26.792 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 55/99 2026-02-17T10:57:26.796 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 56/99 2026-02-17T10:57:26.824 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 57/99 2026-02-17T10:57:26.834 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 58/99 2026-02-17T10:57:26.869 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 59/99 2026-02-17T10:57:27.095 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 60/99 2026-02-17T10:57:27.118 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 61/99 2026-02-17T10:57:27.122 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 62/99 2026-02-17T10:57:27.181 INFO:teuthology.orchestra.run.trial138.stdout: Installing : openblas-0.3.29-1.el9.x86_64 63/99 2026-02-17T10:57:27.183 INFO:teuthology.orchestra.run.trial138.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 64/99 2026-02-17T10:57:27.205 INFO:teuthology.orchestra.run.trial138.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 65/99 2026-02-17T10:57:27.533 INFO:teuthology.orchestra.run.trial138.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 66/99 2026-02-17T10:57:27.607 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 67/99 2026-02-17T10:57:28.284 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 68/99 2026-02-17T10:57:28.302 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 69/99 2026-02-17T10:57:28.312 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 70/99 2026-02-17T10:57:28.319 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-packaging-20.9-5.el9.noarch 71/99 2026-02-17T10:57:28.332 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-ply-3.11-14.el9.noarch 72/99 2026-02-17T10:57:28.348 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 73/99 2026-02-17T10:57:28.424 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 74/99 2026-02-17T10:57:28.432 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 75/99 2026-02-17T10:57:28.456 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 76/99 2026-02-17T10:57:28.486 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 77/99 2026-02-17T10:57:28.537 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/99 2026-02-17T10:57:28.543 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 79/99 2026-02-17T10:57:28.546 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 80/99 2026-02-17T10:57:28.548 INFO:teuthology.orchestra.run.trial138.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 81/99 2026-02-17T10:57:28.565 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T10:57:28.565 INFO:teuthology.orchestra.run.trial138.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-17T10:57:28.565 INFO:teuthology.orchestra.run.trial138.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-17T10:57:28.565 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:28.575 INFO:teuthology.orchestra.run.trial138.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T10:57:28.602 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T10:57:28.602 INFO:teuthology.orchestra.run.trial138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-17T10:57:28.602 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:28.637 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 83/99 2026-02-17T10:57:28.701 INFO:teuthology.orchestra.run.trial138.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 84/99 2026-02-17T10:57:28.703 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch 85/99 2026-02-17T10:57:28.717 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch 85/99 2026-02-17T10:57:28.717 INFO:teuthology.orchestra.run.trial138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T10:57:28.718 INFO:teuthology.orchestra.run.trial138.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-17T10:57:28.718 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:29.425 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-osd-2:19.2.3-705.g04cf6dd4.el9.x86_64 86/99 2026-02-17T10:57:29.451 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-osd-2:19.2.3-705.g04cf6dd4.el9.x86_64 86/99 2026-02-17T10:57:29.451 INFO:teuthology.orchestra.run.trial138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T10:57:29.451 INFO:teuthology.orchestra.run.trial138.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-17T10:57:29.451 INFO:teuthology.orchestra.run.trial138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T10:57:29.451 INFO:teuthology.orchestra.run.trial138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T10:57:29.451 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:29.505 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 87/99 2026-02-17T10:57:29.506 INFO:teuthology.orchestra.run.trial138.stdout: Installing : cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 87/99 2026-02-17T10:57:29.511 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-705.g04cf6dd4.el9. 88/99 2026-02-17T10:57:29.531 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-705.g04cf6dd4.el9 89/99 2026-02-17T10:57:29.532 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 90/99 2026-02-17T10:57:30.022 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 90/99 2026-02-17T10:57:30.025 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noar 91/99 2026-02-17T10:57:30.482 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noar 91/99 2026-02-17T10:57:30.483 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6d 92/99 2026-02-17T10:57:30.497 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6d 92/99 2026-02-17T10:57:30.497 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-705.g04cf6dd4.el9.noar 93/99 2026-02-17T10:57:30.552 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-705.g04cf6dd4.el9.noar 93/99 2026-02-17T10:57:30.602 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-705.g04cf6dd4.el9.n 94/99 2026-02-17T10:57:30.604 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 95/99 2026-02-17T10:57:30.625 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 95/99 2026-02-17T10:57:30.625 INFO:teuthology.orchestra.run.trial138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T10:57:30.625 INFO:teuthology.orchestra.run.trial138.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-17T10:57:30.625 INFO:teuthology.orchestra.run.trial138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T10:57:30.625 INFO:teuthology.orchestra.run.trial138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T10:57:30.625 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:30.638 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch 96/99 2026-02-17T10:57:30.858 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch 96/99 2026-02-17T10:57:30.860 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-mon-2:19.2.3-705.g04cf6dd4.el9.x86_64 97/99 2026-02-17T10:57:30.881 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-mon-2:19.2.3-705.g04cf6dd4.el9.x86_64 97/99 2026-02-17T10:57:30.881 INFO:teuthology.orchestra.run.trial138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T10:57:30.882 INFO:teuthology.orchestra.run.trial138.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-17T10:57:30.882 INFO:teuthology.orchestra.run.trial138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T10:57:30.882 INFO:teuthology.orchestra.run.trial138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T10:57:30.882 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:30.984 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-mds-2:19.2.3-705.g04cf6dd4.el9.x86_64 98/99 2026-02-17T10:57:31.004 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-mds-2:19.2.3-705.g04cf6dd4.el9.x86_64 98/99 2026-02-17T10:57:31.004 INFO:teuthology.orchestra.run.trial138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T10:57:31.004 INFO:teuthology.orchestra.run.trial138.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-17T10:57:31.004 INFO:teuthology.orchestra.run.trial138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T10:57:31.005 INFO:teuthology.orchestra.run.trial138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T10:57:31.005 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:31.022 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-2:19.2.3-705.g04cf6dd4.el9.x86_64 99/99 2026-02-17T10:57:31.711 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-2:19.2.3-705.g04cf6dd4.el9.x86_64 99/99 2026-02-17T10:57:31.711 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/99 2026-02-17T10:57:31.711 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-mds-2:19.2.3-705.g04cf6dd4.el9.x86_64 2/99 2026-02-17T10:57:31.711 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 3/99 2026-02-17T10:57:31.711 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-mon-2:19.2.3-705.g04cf6dd4.el9.x86_64 4/99 2026-02-17T10:57:31.711 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-osd-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/99 2026-02-17T10:57:31.711 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-705.g04cf6dd4.el9 6/99 2026-02-17T10:57:31.712 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 7/99 2026-02-17T10:57:31.712 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noar 8/99 2026-02-17T10:57:31.712 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6d 9/99 2026-02-17T10:57:31.712 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-705.g04cf6dd4.el9.noar 10/99 2026-02-17T10:57:31.712 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-705.g04cf6dd4.el9.n 11/99 2026-02-17T10:57:31.712 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch 12/99 2026-02-17T10:57:31.712 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-705.g04cf6dd4.el9. 13/99 2026-02-17T10:57:31.712 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch 14/99 2026-02-17T10:57:31.712 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 15/99 2026-02-17T10:57:31.712 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/99 2026-02-17T10:57:31.712 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/99 2026-02-17T10:57:31.712 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/99 2026-02-17T10:57:31.713 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/99 2026-02-17T10:57:31.713 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/99 2026-02-17T10:57:31.713 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/99 2026-02-17T10:57:31.713 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/99 2026-02-17T10:57:31.713 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/99 2026-02-17T10:57:31.713 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/99 2026-02-17T10:57:31.713 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/99 2026-02-17T10:57:31.713 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/99 2026-02-17T10:57:31.713 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/99 2026-02-17T10:57:31.713 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/99 2026-02-17T10:57:31.713 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : zip-3.0-35.el9.x86_64 29/99 2026-02-17T10:57:31.713 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/99 2026-02-17T10:57:31.713 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/99 2026-02-17T10:57:31.714 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/99 2026-02-17T10:57:31.714 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/99 2026-02-17T10:57:31.714 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/99 2026-02-17T10:57:31.714 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/99 2026-02-17T10:57:31.714 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/99 2026-02-17T10:57:31.714 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/99 2026-02-17T10:57:31.714 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/99 2026-02-17T10:57:31.714 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 39/99 2026-02-17T10:57:31.714 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/99 2026-02-17T10:57:31.714 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 41/99 2026-02-17T10:57:31.714 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 42/99 2026-02-17T10:57:31.714 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 43/99 2026-02-17T10:57:31.715 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/99 2026-02-17T10:57:31.715 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/99 2026-02-17T10:57:31.715 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/99 2026-02-17T10:57:31.715 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/99 2026-02-17T10:57:31.715 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/99 2026-02-17T10:57:31.715 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/99 2026-02-17T10:57:31.715 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/99 2026-02-17T10:57:31.715 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/99 2026-02-17T10:57:31.715 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/99 2026-02-17T10:57:31.715 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/99 2026-02-17T10:57:31.715 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/99 2026-02-17T10:57:31.715 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/99 2026-02-17T10:57:31.716 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/99 2026-02-17T10:57:31.716 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/99 2026-02-17T10:57:31.716 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/99 2026-02-17T10:57:31.716 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/99 2026-02-17T10:57:31.716 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/99 2026-02-17T10:57:31.716 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/99 2026-02-17T10:57:31.716 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/99 2026-02-17T10:57:31.716 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/99 2026-02-17T10:57:31.716 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/99 2026-02-17T10:57:31.716 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/99 2026-02-17T10:57:31.716 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/99 2026-02-17T10:57:31.716 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/99 2026-02-17T10:57:31.716 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/99 2026-02-17T10:57:31.717 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/99 2026-02-17T10:57:31.717 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/99 2026-02-17T10:57:31.717 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/99 2026-02-17T10:57:31.717 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/99 2026-02-17T10:57:31.717 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/99 2026-02-17T10:57:31.717 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/99 2026-02-17T10:57:31.717 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/99 2026-02-17T10:57:31.717 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/99 2026-02-17T10:57:31.717 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/99 2026-02-17T10:57:31.717 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/99 2026-02-17T10:57:31.717 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/99 2026-02-17T10:57:31.717 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/99 2026-02-17T10:57:31.717 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 81/99 2026-02-17T10:57:31.718 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/99 2026-02-17T10:57:31.718 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/99 2026-02-17T10:57:31.718 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/99 2026-02-17T10:57:31.718 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 85/99 2026-02-17T10:57:31.718 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 86/99 2026-02-17T10:57:31.718 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/99 2026-02-17T10:57:31.718 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 88/99 2026-02-17T10:57:31.718 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 89/99 2026-02-17T10:57:31.718 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 90/99 2026-02-17T10:57:31.718 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 91/99 2026-02-17T10:57:31.718 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 92/99 2026-02-17T10:57:31.718 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 93/99 2026-02-17T10:57:31.718 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 94/99 2026-02-17T10:57:31.719 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 95/99 2026-02-17T10:57:31.719 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 96/99 2026-02-17T10:57:31.719 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 97/99 2026-02-17T10:57:31.719 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 98/99 2026-02-17T10:57:31.775 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 99/99 2026-02-17T10:57:31.775 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:31.775 INFO:teuthology.orchestra.run.trial138.stdout:Installed: 2026-02-17T10:57:31.775 INFO:teuthology.orchestra.run.trial138.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-17T10:57:31.775 INFO:teuthology.orchestra.run.trial138.stdout: ceph-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T10:57:31.775 INFO:teuthology.orchestra.run.trial138.stdout: ceph-grafana-dashboards-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T10:57:31.776 INFO:teuthology.orchestra.run.trial138.stdout: ceph-mds-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T10:57:31.776 INFO:teuthology.orchestra.run.trial138.stdout: ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T10:57:31.776 INFO:teuthology.orchestra.run.trial138.stdout: ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T10:57:31.776 INFO:teuthology.orchestra.run.trial138.stdout: ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T10:57:31.776 INFO:teuthology.orchestra.run.trial138.stdout: ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T10:57:31.776 INFO:teuthology.orchestra.run.trial138.stdout: ceph-mgr-k8sevents-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T10:57:31.776 INFO:teuthology.orchestra.run.trial138.stdout: ceph-mgr-modules-core-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T10:57:31.776 INFO:teuthology.orchestra.run.trial138.stdout: ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T10:57:31.776 INFO:teuthology.orchestra.run.trial138.stdout: ceph-mon-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T10:57:31.776 INFO:teuthology.orchestra.run.trial138.stdout: ceph-osd-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T10:57:31.776 INFO:teuthology.orchestra.run.trial138.stdout: ceph-prometheus-alerts-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T10:57:31.776 INFO:teuthology.orchestra.run.trial138.stdout: ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T10:57:31.777 INFO:teuthology.orchestra.run.trial138.stdout: cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T10:57:31.777 INFO:teuthology.orchestra.run.trial138.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-17T10:57:31.777 INFO:teuthology.orchestra.run.trial138.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-17T10:57:31.777 INFO:teuthology.orchestra.run.trial138.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-17T10:57:31.777 INFO:teuthology.orchestra.run.trial138.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-17T10:57:31.777 INFO:teuthology.orchestra.run.trial138.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-17T10:57:31.777 INFO:teuthology.orchestra.run.trial138.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-17T10:57:31.777 INFO:teuthology.orchestra.run.trial138.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-17T10:57:31.777 INFO:teuthology.orchestra.run.trial138.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-17T10:57:31.777 INFO:teuthology.orchestra.run.trial138.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-17T10:57:31.777 INFO:teuthology.orchestra.run.trial138.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T10:57:31.777 INFO:teuthology.orchestra.run.trial138.stdout: lua-5.4.4-4.el9.x86_64 2026-02-17T10:57:31.777 INFO:teuthology.orchestra.run.trial138.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-17T10:57:31.778 INFO:teuthology.orchestra.run.trial138.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-17T10:57:31.778 INFO:teuthology.orchestra.run.trial138.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-17T10:57:31.778 INFO:teuthology.orchestra.run.trial138.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-17T10:57:31.778 INFO:teuthology.orchestra.run.trial138.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-17T10:57:31.778 INFO:teuthology.orchestra.run.trial138.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-17T10:57:31.778 INFO:teuthology.orchestra.run.trial138.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-17T10:57:31.778 INFO:teuthology.orchestra.run.trial138.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-17T10:57:31.778 INFO:teuthology.orchestra.run.trial138.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-17T10:57:31.778 INFO:teuthology.orchestra.run.trial138.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-17T10:57:31.779 INFO:teuthology.orchestra.run.trial138.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-17T10:57:31.779 INFO:teuthology.orchestra.run.trial138.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-17T10:57:31.779 INFO:teuthology.orchestra.run.trial138.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-17T10:57:31.779 INFO:teuthology.orchestra.run.trial138.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-17T10:57:31.779 INFO:teuthology.orchestra.run.trial138.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-17T10:57:31.779 INFO:teuthology.orchestra.run.trial138.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-17T10:57:31.779 INFO:teuthology.orchestra.run.trial138.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-17T10:57:31.779 INFO:teuthology.orchestra.run.trial138.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-17T10:57:31.779 INFO:teuthology.orchestra.run.trial138.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-17T10:57:31.779 INFO:teuthology.orchestra.run.trial138.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-17T10:57:31.780 INFO:teuthology.orchestra.run.trial138.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-17T10:57:31.780 INFO:teuthology.orchestra.run.trial138.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-17T10:57:31.780 INFO:teuthology.orchestra.run.trial138.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-17T10:57:31.780 INFO:teuthology.orchestra.run.trial138.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-17T10:57:31.780 INFO:teuthology.orchestra.run.trial138.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-17T10:57:31.780 INFO:teuthology.orchestra.run.trial138.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-17T10:57:31.780 INFO:teuthology.orchestra.run.trial138.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-17T10:57:31.780 INFO:teuthology.orchestra.run.trial138.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-17T10:57:31.780 INFO:teuthology.orchestra.run.trial138.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-17T10:57:31.780 INFO:teuthology.orchestra.run.trial138.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-17T10:57:31.780 INFO:teuthology.orchestra.run.trial138.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-17T10:57:31.780 INFO:teuthology.orchestra.run.trial138.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T10:57:31.780 INFO:teuthology.orchestra.run.trial138.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-17T10:57:31.781 INFO:teuthology.orchestra.run.trial138.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-17T10:57:31.781 INFO:teuthology.orchestra.run.trial138.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-17T10:57:31.781 INFO:teuthology.orchestra.run.trial138.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-17T10:57:31.781 INFO:teuthology.orchestra.run.trial138.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-17T10:57:31.781 INFO:teuthology.orchestra.run.trial138.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-17T10:57:31.781 INFO:teuthology.orchestra.run.trial138.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-17T10:57:31.781 INFO:teuthology.orchestra.run.trial138.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-17T10:57:31.781 INFO:teuthology.orchestra.run.trial138.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-17T10:57:31.781 INFO:teuthology.orchestra.run.trial138.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-17T10:57:31.781 INFO:teuthology.orchestra.run.trial138.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-17T10:57:31.781 INFO:teuthology.orchestra.run.trial138.stdout: python3-ply-3.11-14.el9.noarch 2026-02-17T10:57:31.781 INFO:teuthology.orchestra.run.trial138.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-17T10:57:31.782 INFO:teuthology.orchestra.run.trial138.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-17T10:57:31.782 INFO:teuthology.orchestra.run.trial138.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-17T10:57:31.782 INFO:teuthology.orchestra.run.trial138.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-17T10:57:31.782 INFO:teuthology.orchestra.run.trial138.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-17T10:57:31.782 INFO:teuthology.orchestra.run.trial138.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-17T10:57:31.782 INFO:teuthology.orchestra.run.trial138.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-17T10:57:31.782 INFO:teuthology.orchestra.run.trial138.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-17T10:57:31.782 INFO:teuthology.orchestra.run.trial138.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-17T10:57:31.782 INFO:teuthology.orchestra.run.trial138.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-17T10:57:31.782 INFO:teuthology.orchestra.run.trial138.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-17T10:57:31.782 INFO:teuthology.orchestra.run.trial138.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-17T10:57:31.782 INFO:teuthology.orchestra.run.trial138.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-17T10:57:31.782 INFO:teuthology.orchestra.run.trial138.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-17T10:57:31.783 INFO:teuthology.orchestra.run.trial138.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-17T10:57:31.783 INFO:teuthology.orchestra.run.trial138.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-17T10:57:31.783 INFO:teuthology.orchestra.run.trial138.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-17T10:57:31.783 INFO:teuthology.orchestra.run.trial138.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-17T10:57:31.783 INFO:teuthology.orchestra.run.trial138.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-17T10:57:31.783 INFO:teuthology.orchestra.run.trial138.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-17T10:57:31.783 INFO:teuthology.orchestra.run.trial138.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-17T10:57:31.783 INFO:teuthology.orchestra.run.trial138.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-17T10:57:31.783 INFO:teuthology.orchestra.run.trial138.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-17T10:57:31.783 INFO:teuthology.orchestra.run.trial138.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-17T10:57:31.783 INFO:teuthology.orchestra.run.trial138.stdout: unzip-6.0-59.el9.x86_64 2026-02-17T10:57:31.783 INFO:teuthology.orchestra.run.trial138.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-17T10:57:31.783 INFO:teuthology.orchestra.run.trial138.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-17T10:57:31.784 INFO:teuthology.orchestra.run.trial138.stdout: zip-3.0-35.el9.x86_64 2026-02-17T10:57:31.784 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:31.784 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T10:57:31.832 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install ceph-base 2026-02-17T10:57:32.147 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 10:56:58 AM UTC. 2026-02-17T10:57:32.213 INFO:teuthology.orchestra.run.trial138.stdout:Package ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T10:57:32.230 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T10:57:32.231 INFO:teuthology.orchestra.run.trial138.stdout:Nothing to do. 2026-02-17T10:57:32.231 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T10:57:32.252 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install cephadm 2026-02-17T10:57:32.554 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 10:56:58 AM UTC. 2026-02-17T10:57:32.619 INFO:teuthology.orchestra.run.trial138.stdout:Package cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T10:57:32.636 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T10:57:32.637 INFO:teuthology.orchestra.run.trial138.stdout:Nothing to do. 2026-02-17T10:57:32.637 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T10:57:32.658 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install ceph-immutable-object-cache 2026-02-17T10:57:32.966 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 10:56:58 AM UTC. 2026-02-17T10:57:33.049 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T10:57:33.050 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T10:57:33.050 INFO:teuthology.orchestra.run.trial138.stdout: Package Arch Version Repo Size 2026-02-17T10:57:33.050 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T10:57:33.050 INFO:teuthology.orchestra.run.trial138.stdout:Installing: 2026-02-17T10:57:33.050 INFO:teuthology.orchestra.run.trial138.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 145 k 2026-02-17T10:57:33.050 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:33.050 INFO:teuthology.orchestra.run.trial138.stdout:Transaction Summary 2026-02-17T10:57:33.051 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T10:57:33.051 INFO:teuthology.orchestra.run.trial138.stdout:Install 1 Package 2026-02-17T10:57:33.051 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:33.051 INFO:teuthology.orchestra.run.trial138.stdout:Total download size: 145 k 2026-02-17T10:57:33.051 INFO:teuthology.orchestra.run.trial138.stdout:Installed size: 431 k 2026-02-17T10:57:33.051 INFO:teuthology.orchestra.run.trial138.stdout:Downloading Packages: 2026-02-17T10:57:33.148 INFO:teuthology.orchestra.run.trial138.stdout:ceph-immutable-object-cache-19.2.3-705.g04cf6dd 1.4 MB/s | 145 kB 00:00 2026-02-17T10:57:33.149 INFO:teuthology.orchestra.run.trial138.stdout:-------------------------------------------------------------------------------- 2026-02-17T10:57:33.149 INFO:teuthology.orchestra.run.trial138.stdout:Total 1.4 MB/s | 145 kB 00:00 2026-02-17T10:57:33.150 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction check 2026-02-17T10:57:33.153 INFO:teuthology.orchestra.run.trial138.stdout:Transaction check succeeded. 2026-02-17T10:57:33.153 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction test 2026-02-17T10:57:33.184 INFO:teuthology.orchestra.run.trial138.stdout:Transaction test succeeded. 2026-02-17T10:57:33.184 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction 2026-02-17T10:57:33.238 INFO:teuthology.orchestra.run.trial138.stdout: Preparing : 1/1 2026-02-17T10:57:33.239 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-705.g04cf6dd4.e 1/1 2026-02-17T10:57:33.261 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-705.g04cf6dd4.e 1/1 2026-02-17T10:57:33.261 INFO:teuthology.orchestra.run.trial138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T10:57:33.261 INFO:teuthology.orchestra.run.trial138.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-17T10:57:33.261 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:33.567 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-705.g04cf6dd4.e 1/1 2026-02-17T10:57:33.567 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:33.567 INFO:teuthology.orchestra.run.trial138.stdout:Installed: 2026-02-17T10:57:33.567 INFO:teuthology.orchestra.run.trial138.stdout: ceph-immutable-object-cache-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T10:57:33.567 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:33.567 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T10:57:33.596 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install ceph-mgr 2026-02-17T10:57:33.903 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 10:56:58 AM UTC. 2026-02-17T10:57:33.968 INFO:teuthology.orchestra.run.trial138.stdout:Package ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T10:57:33.985 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T10:57:33.986 INFO:teuthology.orchestra.run.trial138.stdout:Nothing to do. 2026-02-17T10:57:33.986 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T10:57:34.007 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install ceph-mgr-dashboard 2026-02-17T10:57:34.323 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 10:56:58 AM UTC. 2026-02-17T10:57:34.389 INFO:teuthology.orchestra.run.trial138.stdout:Package ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T10:57:34.407 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T10:57:34.408 INFO:teuthology.orchestra.run.trial138.stdout:Nothing to do. 2026-02-17T10:57:34.408 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T10:57:34.429 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-17T10:57:34.736 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 10:56:58 AM UTC. 2026-02-17T10:57:34.802 INFO:teuthology.orchestra.run.trial138.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T10:57:34.819 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T10:57:34.820 INFO:teuthology.orchestra.run.trial138.stdout:Nothing to do. 2026-02-17T10:57:34.820 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T10:57:34.841 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install ceph-mgr-rook 2026-02-17T10:57:35.156 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 10:56:58 AM UTC. 2026-02-17T10:57:35.221 INFO:teuthology.orchestra.run.trial138.stdout:Package ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T10:57:35.239 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T10:57:35.239 INFO:teuthology.orchestra.run.trial138.stdout:Nothing to do. 2026-02-17T10:57:35.239 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T10:57:35.261 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install ceph-mgr-cephadm 2026-02-17T10:57:35.575 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 10:56:58 AM UTC. 2026-02-17T10:57:35.641 INFO:teuthology.orchestra.run.trial138.stdout:Package ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T10:57:35.658 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T10:57:35.659 INFO:teuthology.orchestra.run.trial138.stdout:Nothing to do. 2026-02-17T10:57:35.659 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T10:57:35.681 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install ceph-fuse 2026-02-17T10:57:35.983 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 10:56:58 AM UTC. 2026-02-17T10:57:36.065 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T10:57:36.065 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T10:57:36.065 INFO:teuthology.orchestra.run.trial138.stdout: Package Architecture Version Repository Size 2026-02-17T10:57:36.065 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T10:57:36.065 INFO:teuthology.orchestra.run.trial138.stdout:Installing: 2026-02-17T10:57:36.065 INFO:teuthology.orchestra.run.trial138.stdout: ceph-fuse x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 1.2 M 2026-02-17T10:57:36.065 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:36.065 INFO:teuthology.orchestra.run.trial138.stdout:Transaction Summary 2026-02-17T10:57:36.065 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T10:57:36.065 INFO:teuthology.orchestra.run.trial138.stdout:Install 1 Package 2026-02-17T10:57:36.065 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:36.065 INFO:teuthology.orchestra.run.trial138.stdout:Total download size: 1.2 M 2026-02-17T10:57:36.065 INFO:teuthology.orchestra.run.trial138.stdout:Installed size: 3.6 M 2026-02-17T10:57:36.065 INFO:teuthology.orchestra.run.trial138.stdout:Downloading Packages: 2026-02-17T10:57:37.135 INFO:teuthology.orchestra.run.trial138.stdout:ceph-fuse-19.2.3-705.g04cf6dd4.el9.x86_64.rpm 1.1 MB/s | 1.2 MB 00:01 2026-02-17T10:57:37.135 INFO:teuthology.orchestra.run.trial138.stdout:-------------------------------------------------------------------------------- 2026-02-17T10:57:37.135 INFO:teuthology.orchestra.run.trial138.stdout:Total 1.1 MB/s | 1.2 MB 00:01 2026-02-17T10:57:37.135 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction check 2026-02-17T10:57:37.140 INFO:teuthology.orchestra.run.trial138.stdout:Transaction check succeeded. 2026-02-17T10:57:37.140 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction test 2026-02-17T10:57:37.174 INFO:teuthology.orchestra.run.trial138.stdout:Transaction test succeeded. 2026-02-17T10:57:37.174 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction 2026-02-17T10:57:37.276 INFO:teuthology.orchestra.run.trial138.stdout: Preparing : 1/1 2026-02-17T10:57:37.292 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T10:57:37.547 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T10:57:37.603 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T10:57:37.603 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:37.603 INFO:teuthology.orchestra.run.trial138.stdout:Installed: 2026-02-17T10:57:37.603 INFO:teuthology.orchestra.run.trial138.stdout: ceph-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T10:57:37.603 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:37.603 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T10:57:37.630 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install ceph-volume 2026-02-17T10:57:37.940 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 10:56:58 AM UTC. 2026-02-17T10:57:38.004 INFO:teuthology.orchestra.run.trial138.stdout:Package ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T10:57:38.021 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T10:57:38.022 INFO:teuthology.orchestra.run.trial138.stdout:Nothing to do. 2026-02-17T10:57:38.022 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T10:57:38.043 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install librados-devel 2026-02-17T10:57:38.356 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Feb 2026 10:56:58 AM UTC. 2026-02-17T10:57:38.440 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T10:57:38.440 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T10:57:38.440 INFO:teuthology.orchestra.run.trial138.stdout: Package Arch Version Repo Size 2026-02-17T10:57:38.441 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T10:57:38.441 INFO:teuthology.orchestra.run.trial138.stdout:Installing: 2026-02-17T10:57:38.441 INFO:teuthology.orchestra.run.trial138.stdout: librados-devel x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 126 k 2026-02-17T10:57:38.441 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:38.441 INFO:teuthology.orchestra.run.trial138.stdout:Transaction Summary 2026-02-17T10:57:38.441 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T10:57:38.441 INFO:teuthology.orchestra.run.trial138.stdout:Install 1 Package 2026-02-17T10:57:38.441 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:38.441 INFO:teuthology.orchestra.run.trial138.stdout:Total download size: 126 k 2026-02-17T10:57:38.441 INFO:teuthology.orchestra.run.trial138.stdout:Installed size: 456 k 2026-02-17T10:57:38.441 INFO:teuthology.orchestra.run.trial138.stdout:Downloading Packages: 2026-02-17T10:57:38.812 INFO:teuthology.orchestra.run.trial138.stdout:librados-devel-19.2.3-705.g04cf6dd4.el9.x86_64. 341 kB/s | 126 kB 00:00 2026-02-17T10:57:38.812 INFO:teuthology.orchestra.run.trial138.stdout:-------------------------------------------------------------------------------- 2026-02-17T10:57:38.812 INFO:teuthology.orchestra.run.trial138.stdout:Total 340 kB/s | 126 kB 00:00 2026-02-17T10:57:38.812 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction check 2026-02-17T10:57:38.815 INFO:teuthology.orchestra.run.trial138.stdout:Transaction check succeeded. 2026-02-17T10:57:38.815 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction test 2026-02-17T10:57:38.846 INFO:teuthology.orchestra.run.trial138.stdout:Transaction test succeeded. 2026-02-17T10:57:38.846 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction 2026-02-17T10:57:38.901 INFO:teuthology.orchestra.run.trial138.stdout: Preparing : 1/1 2026-02-17T10:57:38.918 INFO:teuthology.orchestra.run.trial138.stdout: Installing : librados-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T10:57:39.000 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: librados-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T10:57:39.057 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : librados-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T10:57:39.057 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:39.057 INFO:teuthology.orchestra.run.trial138.stdout:Installed: 2026-02-17T10:57:39.057 INFO:teuthology.orchestra.run.trial138.stdout: librados-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T10:57:39.057 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:39.057 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T10:57:39.084 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install libcephfs2 2026-02-17T10:57:39.393 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Feb 2026 10:56:58 AM UTC. 2026-02-17T10:57:39.457 INFO:teuthology.orchestra.run.trial138.stdout:Package libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T10:57:39.474 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T10:57:39.475 INFO:teuthology.orchestra.run.trial138.stdout:Nothing to do. 2026-02-17T10:57:39.475 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T10:57:39.497 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install libcephfs-devel 2026-02-17T10:57:39.805 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Feb 2026 10:56:58 AM UTC. 2026-02-17T10:57:39.887 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T10:57:39.888 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T10:57:39.888 INFO:teuthology.orchestra.run.trial138.stdout: Package Arch Version Repo Size 2026-02-17T10:57:39.888 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T10:57:39.888 INFO:teuthology.orchestra.run.trial138.stdout:Installing: 2026-02-17T10:57:39.888 INFO:teuthology.orchestra.run.trial138.stdout: libcephfs-devel x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 34 k 2026-02-17T10:57:39.888 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:39.888 INFO:teuthology.orchestra.run.trial138.stdout:Transaction Summary 2026-02-17T10:57:39.888 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T10:57:39.888 INFO:teuthology.orchestra.run.trial138.stdout:Install 1 Package 2026-02-17T10:57:39.888 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:39.888 INFO:teuthology.orchestra.run.trial138.stdout:Total download size: 34 k 2026-02-17T10:57:39.888 INFO:teuthology.orchestra.run.trial138.stdout:Installed size: 153 k 2026-02-17T10:57:39.888 INFO:teuthology.orchestra.run.trial138.stdout:Downloading Packages: 2026-02-17T10:57:40.139 INFO:teuthology.orchestra.run.trial138.stdout:libcephfs-devel-19.2.3-705.g04cf6dd4.el9.x86_64 134 kB/s | 34 kB 00:00 2026-02-17T10:57:40.139 INFO:teuthology.orchestra.run.trial138.stdout:-------------------------------------------------------------------------------- 2026-02-17T10:57:40.139 INFO:teuthology.orchestra.run.trial138.stdout:Total 133 kB/s | 34 kB 00:00 2026-02-17T10:57:40.139 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction check 2026-02-17T10:57:40.141 INFO:teuthology.orchestra.run.trial138.stdout:Transaction check succeeded. 2026-02-17T10:57:40.141 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction test 2026-02-17T10:57:40.144 INFO:teuthology.orchestra.run.trial138.stdout:Transaction test succeeded. 2026-02-17T10:57:40.144 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction 2026-02-17T10:57:40.166 INFO:teuthology.orchestra.run.trial138.stdout: Preparing : 1/1 2026-02-17T10:57:40.183 INFO:teuthology.orchestra.run.trial138.stdout: Installing : libcephfs-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T10:57:40.236 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T10:57:40.292 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : libcephfs-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T10:57:40.292 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:40.292 INFO:teuthology.orchestra.run.trial138.stdout:Installed: 2026-02-17T10:57:40.292 INFO:teuthology.orchestra.run.trial138.stdout: libcephfs-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T10:57:40.292 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:40.293 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T10:57:40.318 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install librados2 2026-02-17T10:57:40.628 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:42 ago on Tue 17 Feb 2026 10:56:58 AM UTC. 2026-02-17T10:57:40.694 INFO:teuthology.orchestra.run.trial138.stdout:Package librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T10:57:40.711 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T10:57:40.712 INFO:teuthology.orchestra.run.trial138.stdout:Nothing to do. 2026-02-17T10:57:40.712 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T10:57:40.734 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install librbd1 2026-02-17T10:57:41.041 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:43 ago on Tue 17 Feb 2026 10:56:58 AM UTC. 2026-02-17T10:57:41.105 INFO:teuthology.orchestra.run.trial138.stdout:Package librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T10:57:41.123 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T10:57:41.123 INFO:teuthology.orchestra.run.trial138.stdout:Nothing to do. 2026-02-17T10:57:41.124 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T10:57:41.144 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install python3-rados 2026-02-17T10:57:41.452 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:43 ago on Tue 17 Feb 2026 10:56:58 AM UTC. 2026-02-17T10:57:41.516 INFO:teuthology.orchestra.run.trial138.stdout:Package python3-rados-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T10:57:41.533 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T10:57:41.534 INFO:teuthology.orchestra.run.trial138.stdout:Nothing to do. 2026-02-17T10:57:41.534 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T10:57:41.555 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install python3-rgw 2026-02-17T10:57:41.861 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:43 ago on Tue 17 Feb 2026 10:56:58 AM UTC. 2026-02-17T10:57:41.925 INFO:teuthology.orchestra.run.trial138.stdout:Package python3-rgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T10:57:41.943 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T10:57:41.943 INFO:teuthology.orchestra.run.trial138.stdout:Nothing to do. 2026-02-17T10:57:41.943 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T10:57:41.965 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install python3-cephfs 2026-02-17T10:57:42.278 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:44 ago on Tue 17 Feb 2026 10:56:58 AM UTC. 2026-02-17T10:57:42.342 INFO:teuthology.orchestra.run.trial138.stdout:Package python3-cephfs-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T10:57:42.359 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T10:57:42.360 INFO:teuthology.orchestra.run.trial138.stdout:Nothing to do. 2026-02-17T10:57:42.360 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T10:57:42.383 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install python3-rbd 2026-02-17T10:57:42.694 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:44 ago on Tue 17 Feb 2026 10:56:58 AM UTC. 2026-02-17T10:57:42.759 INFO:teuthology.orchestra.run.trial138.stdout:Package python3-rbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T10:57:42.776 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T10:57:42.777 INFO:teuthology.orchestra.run.trial138.stdout:Nothing to do. 2026-02-17T10:57:42.777 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T10:57:42.799 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install rbd-fuse 2026-02-17T10:57:43.105 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:45 ago on Tue 17 Feb 2026 10:56:58 AM UTC. 2026-02-17T10:57:43.188 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T10:57:43.188 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T10:57:43.188 INFO:teuthology.orchestra.run.trial138.stdout: Package Architecture Version Repository Size 2026-02-17T10:57:43.188 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T10:57:43.188 INFO:teuthology.orchestra.run.trial138.stdout:Installing: 2026-02-17T10:57:43.188 INFO:teuthology.orchestra.run.trial138.stdout: rbd-fuse x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 85 k 2026-02-17T10:57:43.188 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:43.188 INFO:teuthology.orchestra.run.trial138.stdout:Transaction Summary 2026-02-17T10:57:43.188 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T10:57:43.189 INFO:teuthology.orchestra.run.trial138.stdout:Install 1 Package 2026-02-17T10:57:43.189 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:43.189 INFO:teuthology.orchestra.run.trial138.stdout:Total download size: 85 k 2026-02-17T10:57:43.189 INFO:teuthology.orchestra.run.trial138.stdout:Installed size: 227 k 2026-02-17T10:57:43.189 INFO:teuthology.orchestra.run.trial138.stdout:Downloading Packages: 2026-02-17T10:57:43.262 INFO:teuthology.orchestra.run.trial138.stdout:rbd-fuse-19.2.3-705.g04cf6dd4.el9.x86_64.rpm 1.1 MB/s | 85 kB 00:00 2026-02-17T10:57:43.262 INFO:teuthology.orchestra.run.trial138.stdout:-------------------------------------------------------------------------------- 2026-02-17T10:57:43.262 INFO:teuthology.orchestra.run.trial138.stdout:Total 1.1 MB/s | 85 kB 00:00 2026-02-17T10:57:43.262 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction check 2026-02-17T10:57:43.265 INFO:teuthology.orchestra.run.trial138.stdout:Transaction check succeeded. 2026-02-17T10:57:43.265 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction test 2026-02-17T10:57:43.295 INFO:teuthology.orchestra.run.trial138.stdout:Transaction test succeeded. 2026-02-17T10:57:43.296 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction 2026-02-17T10:57:43.346 INFO:teuthology.orchestra.run.trial138.stdout: Preparing : 1/1 2026-02-17T10:57:43.362 INFO:teuthology.orchestra.run.trial138.stdout: Installing : rbd-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T10:57:43.442 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: rbd-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T10:57:43.500 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : rbd-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T10:57:43.500 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:43.500 INFO:teuthology.orchestra.run.trial138.stdout:Installed: 2026-02-17T10:57:43.500 INFO:teuthology.orchestra.run.trial138.stdout: rbd-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T10:57:43.500 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:43.500 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T10:57:43.530 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install rbd-mirror 2026-02-17T10:57:43.837 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:45 ago on Tue 17 Feb 2026 10:56:58 AM UTC. 2026-02-17T10:57:43.920 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T10:57:43.920 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T10:57:43.920 INFO:teuthology.orchestra.run.trial138.stdout: Package Arch Version Repo Size 2026-02-17T10:57:43.920 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T10:57:43.920 INFO:teuthology.orchestra.run.trial138.stdout:Installing: 2026-02-17T10:57:43.920 INFO:teuthology.orchestra.run.trial138.stdout: rbd-mirror x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 3.1 M 2026-02-17T10:57:43.920 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:43.921 INFO:teuthology.orchestra.run.trial138.stdout:Transaction Summary 2026-02-17T10:57:43.921 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T10:57:43.921 INFO:teuthology.orchestra.run.trial138.stdout:Install 1 Package 2026-02-17T10:57:43.921 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:43.921 INFO:teuthology.orchestra.run.trial138.stdout:Total download size: 3.1 M 2026-02-17T10:57:43.921 INFO:teuthology.orchestra.run.trial138.stdout:Installed size: 13 M 2026-02-17T10:57:43.921 INFO:teuthology.orchestra.run.trial138.stdout:Downloading Packages: 2026-02-17T10:57:44.068 INFO:teuthology.orchestra.run.trial138.stdout:rbd-mirror-19.2.3-705.g04cf6dd4.el9.x86_64.rpm 21 MB/s | 3.1 MB 00:00 2026-02-17T10:57:44.068 INFO:teuthology.orchestra.run.trial138.stdout:-------------------------------------------------------------------------------- 2026-02-17T10:57:44.068 INFO:teuthology.orchestra.run.trial138.stdout:Total 21 MB/s | 3.1 MB 00:00 2026-02-17T10:57:44.069 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction check 2026-02-17T10:57:44.072 INFO:teuthology.orchestra.run.trial138.stdout:Transaction check succeeded. 2026-02-17T10:57:44.072 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction test 2026-02-17T10:57:44.114 INFO:teuthology.orchestra.run.trial138.stdout:Transaction test succeeded. 2026-02-17T10:57:44.114 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction 2026-02-17T10:57:44.311 INFO:teuthology.orchestra.run.trial138.stdout: Preparing : 1/1 2026-02-17T10:57:44.312 INFO:teuthology.orchestra.run.trial138.stdout: Installing : rbd-mirror-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T10:57:44.336 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: rbd-mirror-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T10:57:44.337 INFO:teuthology.orchestra.run.trial138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T10:57:44.337 INFO:teuthology.orchestra.run.trial138.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-17T10:57:44.337 INFO:teuthology.orchestra.run.trial138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T10:57:44.337 INFO:teuthology.orchestra.run.trial138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T10:57:44.337 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:44.654 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : rbd-mirror-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T10:57:44.654 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:44.654 INFO:teuthology.orchestra.run.trial138.stdout:Installed: 2026-02-17T10:57:44.654 INFO:teuthology.orchestra.run.trial138.stdout: rbd-mirror-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T10:57:44.654 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:44.654 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T10:57:44.682 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install rbd-nbd 2026-02-17T10:57:44.992 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:46 ago on Tue 17 Feb 2026 10:56:58 AM UTC. 2026-02-17T10:57:45.074 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T10:57:45.074 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T10:57:45.075 INFO:teuthology.orchestra.run.trial138.stdout: Package Architecture Version Repository Size 2026-02-17T10:57:45.075 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T10:57:45.075 INFO:teuthology.orchestra.run.trial138.stdout:Installing: 2026-02-17T10:57:45.075 INFO:teuthology.orchestra.run.trial138.stdout: rbd-nbd x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 171 k 2026-02-17T10:57:45.075 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:45.075 INFO:teuthology.orchestra.run.trial138.stdout:Transaction Summary 2026-02-17T10:57:45.075 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T10:57:45.075 INFO:teuthology.orchestra.run.trial138.stdout:Install 1 Package 2026-02-17T10:57:45.075 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:45.075 INFO:teuthology.orchestra.run.trial138.stdout:Total download size: 171 k 2026-02-17T10:57:45.076 INFO:teuthology.orchestra.run.trial138.stdout:Installed size: 490 k 2026-02-17T10:57:45.076 INFO:teuthology.orchestra.run.trial138.stdout:Downloading Packages: 2026-02-17T10:57:45.160 INFO:teuthology.orchestra.run.trial138.stdout:rbd-nbd-19.2.3-705.g04cf6dd4.el9.x86_64.rpm 2.0 MB/s | 171 kB 00:00 2026-02-17T10:57:45.160 INFO:teuthology.orchestra.run.trial138.stdout:-------------------------------------------------------------------------------- 2026-02-17T10:57:45.160 INFO:teuthology.orchestra.run.trial138.stdout:Total 2.0 MB/s | 171 kB 00:00 2026-02-17T10:57:45.160 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction check 2026-02-17T10:57:45.164 INFO:teuthology.orchestra.run.trial138.stdout:Transaction check succeeded. 2026-02-17T10:57:45.164 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction test 2026-02-17T10:57:45.194 INFO:teuthology.orchestra.run.trial138.stdout:Transaction test succeeded. 2026-02-17T10:57:45.195 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction 2026-02-17T10:57:45.249 INFO:teuthology.orchestra.run.trial138.stdout: Preparing : 1/1 2026-02-17T10:57:45.266 INFO:teuthology.orchestra.run.trial138.stdout: Installing : rbd-nbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T10:57:45.345 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: rbd-nbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T10:57:45.401 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : rbd-nbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T10:57:45.401 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:45.401 INFO:teuthology.orchestra.run.trial138.stdout:Installed: 2026-02-17T10:57:45.401 INFO:teuthology.orchestra.run.trial138.stdout: rbd-nbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T10:57:45.401 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:45.401 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T10:57:45.433 DEBUG:teuthology.parallel:result is None 2026-02-17T10:57:45.433 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T10:57:45.598 DEBUG:teuthology.orchestra.run.trial138:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-17T10:57:45.618 INFO:teuthology.orchestra.run.trial138.stdout:19.2.3-705.g04cf6dd4.el9 2026-02-17T10:57:45.619 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-705.g04cf6dd4.el9 2026-02-17T10:57:45.619 INFO:teuthology.task.install:The correct ceph version 19.2.3-705.g04cf6dd4 is installed. 2026-02-17T10:57:45.620 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-17T10:57:45.620 DEBUG:teuthology.orchestra.run.trial138:> set -ex 2026-02-17T10:57:45.620 DEBUG:teuthology.orchestra.run.trial138:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T10:57:45.684 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-17T10:57:45.684 DEBUG:teuthology.orchestra.run.trial138:> set -ex 2026-02-17T10:57:45.684 DEBUG:teuthology.orchestra.run.trial138:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T10:57:45.749 DEBUG:teuthology.orchestra.run.trial138:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T10:57:45.812 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-17T10:57:45.812 DEBUG:teuthology.orchestra.run.trial138:> set -ex 2026-02-17T10:57:45.813 DEBUG:teuthology.orchestra.run.trial138:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T10:57:45.878 DEBUG:teuthology.orchestra.run.trial138:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T10:57:45.942 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-17T10:57:45.942 DEBUG:teuthology.orchestra.run.trial138:> set -ex 2026-02-17T10:57:45.942 DEBUG:teuthology.orchestra.run.trial138:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T10:57:46.006 DEBUG:teuthology.orchestra.run.trial138:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T10:57:46.070 INFO:teuthology.run_tasks:Running task ceph... 2026-02-17T10:57:46.161 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-17T10:57:46.161 DEBUG:teuthology.orchestra.run.trial138:> sudo chmod 777 /var/log/ceph 2026-02-17T10:57:46.185 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-17T10:57:46.186 DEBUG:teuthology.orchestra.run.trial138:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-17T10:57:46.250 INFO:tasks.ceph:Creating extra log directories... 2026-02-17T10:57:46.250 DEBUG:teuthology.orchestra.run.trial138:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-17T10:57:46.324 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-17T10:57:46.324 INFO:tasks.ceph:config {'conf': {'global': {'mon election default strategy': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'but it is still running', 'overall HEALTH_', '\\(POOL_APP_NOT_ENABLED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-17T10:57:46.324 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51222', 'branch': 'wip-bharath19-testing-2026-02-13-0903-squid', 'description': 'rados/singleton-nomsgr/{all/ceph-snapmapper mon_election/connectivity rados supported-random-distro$/{centos_latest}}', 'email': 'skanta@redhat.com', 'first_in_suite': False, 'flavor': 'default', 'job_id': '51222', 'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-bharath19-testing-2026-02-13-0903-squid'}, 'ceph': {'conf': {'global': {'mon election default strategy': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'but it is still running', 'overall HEALTH_', '\\(POOL_APP_NOT_ENABLED\\)'], 'pre-mgr-commands': ['sudo ceph config set mgr mgr_pool false --force'], 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'workunit': {'branch': 'wip-bharath19-testing-2026-02-13-0903-squid', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'}}, 'owner': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'priority': 69, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0']], 'seed': 3603, 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-bharath19-testing-2026-02-13-0903-squid', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e', 'targets': {'trial138.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLQb6wNN8O16t1QekXJe8jEMfQ4pFod0sCy5I/CjEEvY/3MIh/bBr3YuFfzLisrB+WRd0ANkFnYuj1XIJp4Y+J4='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'exec': {'client.0': ['ceph_test_snap_mapper']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-17_04:03:08', 'tube': 'trial', 'user': 'skanta', 'verbose': True, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682'} 2026-02-17T10:57:46.324 DEBUG:teuthology.orchestra.run.trial138:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-17T10:57:46.371 DEBUG:teuthology.orchestra.run.trial138:> sudo install -d -m0777 -- /var/run/ceph 2026-02-17T10:57:46.436 DEBUG:teuthology.orchestra.run.trial138:> set -ex 2026-02-17T10:57:46.436 DEBUG:teuthology.orchestra.run.trial138:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T10:57:46.493 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T10:57:46.493 DEBUG:teuthology.orchestra.run.trial138:> stat /dev/vg_nvme/lv_1 2026-02-17T10:57:46.550 INFO:teuthology.orchestra.run.trial138.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T10:57:46.550 INFO:teuthology.orchestra.run.trial138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T10:57:46.550 INFO:teuthology.orchestra.run.trial138.stdout:Device: 6h/6d Inode: 1311 Links: 1 2026-02-17T10:57:46.550 INFO:teuthology.orchestra.run.trial138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T10:57:46.550 INFO:teuthology.orchestra.run.trial138.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T10:57:46.550 INFO:teuthology.orchestra.run.trial138.stdout:Access: 2026-02-17 10:57:44.474613385 +0000 2026-02-17T10:57:46.551 INFO:teuthology.orchestra.run.trial138.stdout:Modify: 2026-02-17 10:57:06.472264619 +0000 2026-02-17T10:57:46.551 INFO:teuthology.orchestra.run.trial138.stdout:Change: 2026-02-17 10:57:06.472264619 +0000 2026-02-17T10:57:46.551 INFO:teuthology.orchestra.run.trial138.stdout: Birth: 2026-02-17 10:57:06.472264619 +0000 2026-02-17T10:57:46.551 DEBUG:teuthology.orchestra.run.trial138:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T10:57:46.614 INFO:teuthology.orchestra.run.trial138.stderr:1+0 records in 2026-02-17T10:57:46.615 INFO:teuthology.orchestra.run.trial138.stderr:1+0 records out 2026-02-17T10:57:46.615 INFO:teuthology.orchestra.run.trial138.stderr:512 bytes copied, 0.000146442 s, 3.5 MB/s 2026-02-17T10:57:46.616 DEBUG:teuthology.orchestra.run.trial138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T10:57:46.673 DEBUG:teuthology.orchestra.run.trial138:> stat /dev/vg_nvme/lv_2 2026-02-17T10:57:46.729 INFO:teuthology.orchestra.run.trial138.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T10:57:46.729 INFO:teuthology.orchestra.run.trial138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T10:57:46.729 INFO:teuthology.orchestra.run.trial138.stdout:Device: 6h/6d Inode: 1301 Links: 1 2026-02-17T10:57:46.729 INFO:teuthology.orchestra.run.trial138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T10:57:46.729 INFO:teuthology.orchestra.run.trial138.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T10:57:46.730 INFO:teuthology.orchestra.run.trial138.stdout:Access: 2026-02-17 10:57:44.474613385 +0000 2026-02-17T10:57:46.730 INFO:teuthology.orchestra.run.trial138.stdout:Modify: 2026-02-17 10:57:06.472264619 +0000 2026-02-17T10:57:46.730 INFO:teuthology.orchestra.run.trial138.stdout:Change: 2026-02-17 10:57:06.472264619 +0000 2026-02-17T10:57:46.730 INFO:teuthology.orchestra.run.trial138.stdout: Birth: 2026-02-17 10:57:06.472264619 +0000 2026-02-17T10:57:46.730 DEBUG:teuthology.orchestra.run.trial138:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T10:57:46.791 INFO:teuthology.orchestra.run.trial138.stderr:1+0 records in 2026-02-17T10:57:46.791 INFO:teuthology.orchestra.run.trial138.stderr:1+0 records out 2026-02-17T10:57:46.792 INFO:teuthology.orchestra.run.trial138.stderr:512 bytes copied, 0.000141873 s, 3.6 MB/s 2026-02-17T10:57:46.793 DEBUG:teuthology.orchestra.run.trial138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T10:57:46.850 DEBUG:teuthology.orchestra.run.trial138:> stat /dev/vg_nvme/lv_3 2026-02-17T10:57:46.906 INFO:teuthology.orchestra.run.trial138.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T10:57:46.906 INFO:teuthology.orchestra.run.trial138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T10:57:46.906 INFO:teuthology.orchestra.run.trial138.stdout:Device: 6h/6d Inode: 1297 Links: 1 2026-02-17T10:57:46.906 INFO:teuthology.orchestra.run.trial138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T10:57:46.906 INFO:teuthology.orchestra.run.trial138.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T10:57:46.906 INFO:teuthology.orchestra.run.trial138.stdout:Access: 2026-02-17 10:57:44.475613368 +0000 2026-02-17T10:57:46.906 INFO:teuthology.orchestra.run.trial138.stdout:Modify: 2026-02-17 10:57:06.472264619 +0000 2026-02-17T10:57:46.906 INFO:teuthology.orchestra.run.trial138.stdout:Change: 2026-02-17 10:57:06.472264619 +0000 2026-02-17T10:57:46.906 INFO:teuthology.orchestra.run.trial138.stdout: Birth: 2026-02-17 10:57:06.472264619 +0000 2026-02-17T10:57:46.906 DEBUG:teuthology.orchestra.run.trial138:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T10:57:46.971 INFO:teuthology.orchestra.run.trial138.stderr:1+0 records in 2026-02-17T10:57:46.971 INFO:teuthology.orchestra.run.trial138.stderr:1+0 records out 2026-02-17T10:57:46.971 INFO:teuthology.orchestra.run.trial138.stderr:512 bytes copied, 0.00015091 s, 3.4 MB/s 2026-02-17T10:57:46.972 DEBUG:teuthology.orchestra.run.trial138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T10:57:47.030 DEBUG:teuthology.orchestra.run.trial138:> stat /dev/vg_nvme/lv_4 2026-02-17T10:57:47.087 INFO:teuthology.orchestra.run.trial138.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T10:57:47.087 INFO:teuthology.orchestra.run.trial138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T10:57:47.087 INFO:teuthology.orchestra.run.trial138.stdout:Device: 6h/6d Inode: 1316 Links: 1 2026-02-17T10:57:47.087 INFO:teuthology.orchestra.run.trial138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T10:57:47.088 INFO:teuthology.orchestra.run.trial138.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T10:57:47.088 INFO:teuthology.orchestra.run.trial138.stdout:Access: 2026-02-17 10:57:44.475613368 +0000 2026-02-17T10:57:47.088 INFO:teuthology.orchestra.run.trial138.stdout:Modify: 2026-02-17 10:57:06.472264619 +0000 2026-02-17T10:57:47.088 INFO:teuthology.orchestra.run.trial138.stdout:Change: 2026-02-17 10:57:06.472264619 +0000 2026-02-17T10:57:47.088 INFO:teuthology.orchestra.run.trial138.stdout: Birth: 2026-02-17 10:57:06.472264619 +0000 2026-02-17T10:57:47.088 DEBUG:teuthology.orchestra.run.trial138:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T10:57:47.150 INFO:teuthology.orchestra.run.trial138.stderr:1+0 records in 2026-02-17T10:57:47.150 INFO:teuthology.orchestra.run.trial138.stderr:1+0 records out 2026-02-17T10:57:47.150 INFO:teuthology.orchestra.run.trial138.stderr:512 bytes copied, 0.000165076 s, 3.1 MB/s 2026-02-17T10:57:47.152 DEBUG:teuthology.orchestra.run.trial138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T10:57:47.209 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T10:57:47.209 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial138.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2026-02-17T10:57:47.209 INFO:tasks.ceph:Generating config... 2026-02-17T10:57:47.212 INFO:tasks.ceph:[global] mon election default strategy = 3 2026-02-17T10:57:47.212 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-17T10:57:47.212 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-17T10:57:47.212 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-17T10:57:47.212 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-17T10:57:47.212 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-17T10:57:47.212 INFO:tasks.ceph:[mon] mon scrub interval = 300 2026-02-17T10:57:47.212 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2026-02-17T10:57:47.213 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-17T10:57:47.213 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-17T10:57:47.213 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2026-02-17T10:57:47.213 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2026-02-17T10:57:47.213 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2026-02-17T10:57:47.213 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2026-02-17T10:57:47.213 INFO:tasks.ceph:[osd] osd op queue = debug_random 2026-02-17T10:57:47.213 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2026-02-17T10:57:47.213 INFO:tasks.ceph:Setting up mon.a... 2026-02-17T10:57:47.214 DEBUG:teuthology.orchestra.run.trial138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-17T10:57:47.284 INFO:teuthology.orchestra.run.trial138.stdout:creating /etc/ceph/ceph.keyring 2026-02-17T10:57:47.287 DEBUG:teuthology.orchestra.run.trial138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-17T10:57:47.364 DEBUG:teuthology.orchestra.run.trial138:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T10:57:47.427 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.138')] 2026-02-17T10:57:47.428 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.138', 'mon election default strategy': 3}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd mclock override recovery settings': True, 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon scrub interval': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}} 2026-02-17T10:57:47.428 DEBUG:teuthology.orchestra.run.trial138:> set -ex 2026-02-17T10:57:47.428 DEBUG:teuthology.orchestra.run.trial138:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-17T10:57:47.484 DEBUG:teuthology.orchestra.run.trial138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.138 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-17T10:57:47.556 INFO:teuthology.orchestra.run.trial138.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-17T10:57:47.556 INFO:teuthology.orchestra.run.trial138.stdout:monmaptool: generated fsid b27dff50-edc3-4714-9f29-33172002e940 2026-02-17T10:57:47.556 INFO:teuthology.orchestra.run.trial138.stdout:setting min_mon_release = quincy 2026-02-17T10:57:47.556 INFO:teuthology.orchestra.run.trial138.stdout:epoch 0 2026-02-17T10:57:47.556 INFO:teuthology.orchestra.run.trial138.stdout:fsid b27dff50-edc3-4714-9f29-33172002e940 2026-02-17T10:57:47.557 INFO:teuthology.orchestra.run.trial138.stdout:last_changed 2026-02-17T10:57:47.555385+0000 2026-02-17T10:57:47.557 INFO:teuthology.orchestra.run.trial138.stdout:created 2026-02-17T10:57:47.555385+0000 2026-02-17T10:57:47.557 INFO:teuthology.orchestra.run.trial138.stdout:min_mon_release 17 (quincy) 2026-02-17T10:57:47.557 INFO:teuthology.orchestra.run.trial138.stdout:election_strategy: 3 2026-02-17T10:57:47.557 INFO:teuthology.orchestra.run.trial138.stdout:0: [v2:10.20.193.138:3300/0,v1:10.20.193.138:6789/0] mon.a 2026-02-17T10:57:47.557 INFO:teuthology.orchestra.run.trial138.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2026-02-17T10:57:47.559 DEBUG:teuthology.orchestra.run.trial138:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-17T10:57:47.615 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID b27dff50-edc3-4714-9f29-33172002e940... 2026-02-17T10:57:47.617 DEBUG:teuthology.orchestra.run.trial138:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-17T10:57:47.694 INFO:teuthology.orchestra.run.trial138.stdout:[global] 2026-02-17T10:57:47.695 INFO:teuthology.orchestra.run.trial138.stdout: chdir = "" 2026-02-17T10:57:47.695 INFO:teuthology.orchestra.run.trial138.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-17T10:57:47.695 INFO:teuthology.orchestra.run.trial138.stdout: auth supported = cephx 2026-02-17T10:57:47.695 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:47.695 INFO:teuthology.orchestra.run.trial138.stdout: filestore xattr use omap = true 2026-02-17T10:57:47.695 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:47.695 INFO:teuthology.orchestra.run.trial138.stdout: mon clock drift allowed = 1.000 2026-02-17T10:57:47.695 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:47.695 INFO:teuthology.orchestra.run.trial138.stdout: osd crush chooseleaf type = 0 2026-02-17T10:57:47.695 INFO:teuthology.orchestra.run.trial138.stdout: auth debug = true 2026-02-17T10:57:47.696 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:47.696 INFO:teuthology.orchestra.run.trial138.stdout: ms die on old message = true 2026-02-17T10:57:47.696 INFO:teuthology.orchestra.run.trial138.stdout: ms die on bug = true 2026-02-17T10:57:47.696 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:47.696 INFO:teuthology.orchestra.run.trial138.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-17T10:57:47.696 INFO:teuthology.orchestra.run.trial138.stdout: mon pg warn max object skew = 0 2026-02-17T10:57:47.696 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:47.696 INFO:teuthology.orchestra.run.trial138.stdout: # disable pg_autoscaler by default for new pools 2026-02-17T10:57:47.696 INFO:teuthology.orchestra.run.trial138.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-17T10:57:47.696 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:47.696 INFO:teuthology.orchestra.run.trial138.stdout: osd pool default size = 2 2026-02-17T10:57:47.697 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:47.697 INFO:teuthology.orchestra.run.trial138.stdout: mon osd allow primary affinity = true 2026-02-17T10:57:47.697 INFO:teuthology.orchestra.run.trial138.stdout: mon osd allow pg remap = true 2026-02-17T10:57:47.697 INFO:teuthology.orchestra.run.trial138.stdout: mon warn on legacy crush tunables = false 2026-02-17T10:57:47.697 INFO:teuthology.orchestra.run.trial138.stdout: mon warn on crush straw calc version zero = false 2026-02-17T10:57:47.697 INFO:teuthology.orchestra.run.trial138.stdout: mon warn on no sortbitwise = false 2026-02-17T10:57:47.697 INFO:teuthology.orchestra.run.trial138.stdout: mon warn on osd down out interval zero = false 2026-02-17T10:57:47.697 INFO:teuthology.orchestra.run.trial138.stdout: mon warn on too few osds = false 2026-02-17T10:57:47.697 INFO:teuthology.orchestra.run.trial138.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-17T10:57:47.697 INFO:teuthology.orchestra.run.trial138.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-17T10:57:47.697 INFO:teuthology.orchestra.run.trial138.stdout: mon_allow_pool_size_one = true 2026-02-17T10:57:47.698 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:47.698 INFO:teuthology.orchestra.run.trial138.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-17T10:57:47.698 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:47.698 INFO:teuthology.orchestra.run.trial138.stdout: osd default data pool replay window = 5 2026-02-17T10:57:47.698 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:47.698 INFO:teuthology.orchestra.run.trial138.stdout: mon allow pool delete = true 2026-02-17T10:57:47.698 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:47.698 INFO:teuthology.orchestra.run.trial138.stdout: mon cluster log file level = debug 2026-02-17T10:57:47.698 INFO:teuthology.orchestra.run.trial138.stdout: debug asserts on shutdown = true 2026-02-17T10:57:47.698 INFO:teuthology.orchestra.run.trial138.stdout: mon health detail to clog = false 2026-02-17T10:57:47.698 INFO:teuthology.orchestra.run.trial138.stdout: mon host = 10.20.193.138 2026-02-17T10:57:47.698 INFO:teuthology.orchestra.run.trial138.stdout: mon election default strategy = 3 2026-02-17T10:57:47.699 INFO:teuthology.orchestra.run.trial138.stdout: fsid = b27dff50-edc3-4714-9f29-33172002e940 2026-02-17T10:57:47.699 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:47.699 INFO:teuthology.orchestra.run.trial138.stdout:[osd] 2026-02-17T10:57:47.699 INFO:teuthology.orchestra.run.trial138.stdout: osd journal size = 100 2026-02-17T10:57:47.699 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:47.699 INFO:teuthology.orchestra.run.trial138.stdout: osd scrub load threshold = 5.0 2026-02-17T10:57:47.699 INFO:teuthology.orchestra.run.trial138.stdout: osd scrub max interval = 600 2026-02-17T10:57:47.699 INFO:teuthology.orchestra.run.trial138.stdout: osd mclock profile = high_recovery_ops 2026-02-17T10:57:47.699 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:47.699 INFO:teuthology.orchestra.run.trial138.stdout: osd recover clone overlap = true 2026-02-17T10:57:47.700 INFO:teuthology.orchestra.run.trial138.stdout: osd recovery max chunk = 1048576 2026-02-17T10:57:47.700 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:47.700 INFO:teuthology.orchestra.run.trial138.stdout: osd debug shutdown = true 2026-02-17T10:57:47.700 INFO:teuthology.orchestra.run.trial138.stdout: osd debug op order = true 2026-02-17T10:57:47.700 INFO:teuthology.orchestra.run.trial138.stdout: osd debug verify stray on activate = true 2026-02-17T10:57:47.700 INFO:teuthology.orchestra.run.trial138.stdout: osd debug trim objects = true 2026-02-17T10:57:47.700 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:47.700 INFO:teuthology.orchestra.run.trial138.stdout: osd open classes on start = true 2026-02-17T10:57:47.700 INFO:teuthology.orchestra.run.trial138.stdout: osd debug pg log writeout = true 2026-02-17T10:57:47.700 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:47.701 INFO:teuthology.orchestra.run.trial138.stdout: osd deep scrub update digest min age = 30 2026-02-17T10:57:47.701 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:47.701 INFO:teuthology.orchestra.run.trial138.stdout: osd map max advance = 10 2026-02-17T10:57:47.701 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:47.701 INFO:teuthology.orchestra.run.trial138.stdout: journal zero on create = true 2026-02-17T10:57:47.701 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:47.701 INFO:teuthology.orchestra.run.trial138.stdout: filestore ondisk finisher threads = 3 2026-02-17T10:57:47.701 INFO:teuthology.orchestra.run.trial138.stdout: filestore apply finisher threads = 3 2026-02-17T10:57:47.701 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:47.701 INFO:teuthology.orchestra.run.trial138.stdout: bdev debug aio = true 2026-02-17T10:57:47.701 INFO:teuthology.orchestra.run.trial138.stdout: osd debug misdirected ops = true 2026-02-17T10:57:47.701 INFO:teuthology.orchestra.run.trial138.stdout: bluestore zero block detection = True 2026-02-17T10:57:47.702 INFO:teuthology.orchestra.run.trial138.stdout: debug ms = 1 2026-02-17T10:57:47.702 INFO:teuthology.orchestra.run.trial138.stdout: debug osd = 20 2026-02-17T10:57:47.702 INFO:teuthology.orchestra.run.trial138.stdout: osd debug verify cached snaps = True 2026-02-17T10:57:47.702 INFO:teuthology.orchestra.run.trial138.stdout: osd debug verify missing on start = True 2026-02-17T10:57:47.702 INFO:teuthology.orchestra.run.trial138.stdout: osd mclock override recovery settings = True 2026-02-17T10:57:47.702 INFO:teuthology.orchestra.run.trial138.stdout: osd op queue = debug_random 2026-02-17T10:57:47.702 INFO:teuthology.orchestra.run.trial138.stdout: osd op queue cut off = debug_random 2026-02-17T10:57:47.702 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:47.702 INFO:teuthology.orchestra.run.trial138.stdout:[mgr] 2026-02-17T10:57:47.702 INFO:teuthology.orchestra.run.trial138.stdout: debug ms = 1 2026-02-17T10:57:47.702 INFO:teuthology.orchestra.run.trial138.stdout: debug mgr = 20 2026-02-17T10:57:47.702 INFO:teuthology.orchestra.run.trial138.stdout: debug mon = 20 2026-02-17T10:57:47.703 INFO:teuthology.orchestra.run.trial138.stdout: debug auth = 20 2026-02-17T10:57:47.703 INFO:teuthology.orchestra.run.trial138.stdout: mon reweight min pgs per osd = 4 2026-02-17T10:57:47.703 INFO:teuthology.orchestra.run.trial138.stdout: mon reweight min bytes per osd = 10 2026-02-17T10:57:47.703 INFO:teuthology.orchestra.run.trial138.stdout: mgr/telemetry/nag = false 2026-02-17T10:57:47.703 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:47.703 INFO:teuthology.orchestra.run.trial138.stdout:[mon] 2026-02-17T10:57:47.703 INFO:teuthology.orchestra.run.trial138.stdout: debug ms = 1 2026-02-17T10:57:47.703 INFO:teuthology.orchestra.run.trial138.stdout: debug mon = 20 2026-02-17T10:57:47.703 INFO:teuthology.orchestra.run.trial138.stdout: debug paxos = 20 2026-02-17T10:57:47.703 INFO:teuthology.orchestra.run.trial138.stdout: debug auth = 20 2026-02-17T10:57:47.703 INFO:teuthology.orchestra.run.trial138.stdout: mon data avail warn = 5 2026-02-17T10:57:47.704 INFO:teuthology.orchestra.run.trial138.stdout: mon mgr mkfs grace = 240 2026-02-17T10:57:47.704 INFO:teuthology.orchestra.run.trial138.stdout: mon reweight min pgs per osd = 4 2026-02-17T10:57:47.704 INFO:teuthology.orchestra.run.trial138.stdout: mon osd reporter subtree level = osd 2026-02-17T10:57:47.704 INFO:teuthology.orchestra.run.trial138.stdout: mon osd prime pg temp = true 2026-02-17T10:57:47.704 INFO:teuthology.orchestra.run.trial138.stdout: mon reweight min bytes per osd = 10 2026-02-17T10:57:47.704 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:47.704 INFO:teuthology.orchestra.run.trial138.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-17T10:57:47.704 INFO:teuthology.orchestra.run.trial138.stdout: auth mon ticket ttl = 660 # 11m 2026-02-17T10:57:47.704 INFO:teuthology.orchestra.run.trial138.stdout: auth service ticket ttl = 240 # 4m 2026-02-17T10:57:47.704 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:47.704 INFO:teuthology.orchestra.run.trial138.stdout: # don't complain about insecure global_id in the test suite 2026-02-17T10:57:47.704 INFO:teuthology.orchestra.run.trial138.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-17T10:57:47.704 INFO:teuthology.orchestra.run.trial138.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-17T10:57:47.705 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:47.705 INFO:teuthology.orchestra.run.trial138.stdout: # 1m isn't quite enough 2026-02-17T10:57:47.705 INFO:teuthology.orchestra.run.trial138.stdout: mon_down_mkfs_grace = 2m 2026-02-17T10:57:47.705 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:47.705 INFO:teuthology.orchestra.run.trial138.stdout: mon_warn_on_filestore_osds = false 2026-02-17T10:57:47.705 INFO:teuthology.orchestra.run.trial138.stdout: mon scrub interval = 300 2026-02-17T10:57:47.705 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:47.705 INFO:teuthology.orchestra.run.trial138.stdout:[client] 2026-02-17T10:57:47.705 INFO:teuthology.orchestra.run.trial138.stdout: rgw cache enabled = true 2026-02-17T10:57:47.705 INFO:teuthology.orchestra.run.trial138.stdout: rgw enable ops log = true 2026-02-17T10:57:47.705 INFO:teuthology.orchestra.run.trial138.stdout: rgw enable usage log = true 2026-02-17T10:57:47.705 INFO:teuthology.orchestra.run.trial138.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-17T10:57:47.706 INFO:teuthology.orchestra.run.trial138.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-17T10:57:47.706 INFO:teuthology.orchestra.run.trial138.stdout:[mon.a] 2026-02-17T10:57:47.707 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-17T10:57:47.707 DEBUG:teuthology.orchestra.run.trial138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-17T10:57:47.790 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-17T10:57:47.791 DEBUG:teuthology.orchestra.run.trial138:> set -ex 2026-02-17T10:57:47.791 DEBUG:teuthology.orchestra.run.trial138:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-17T10:57:47.845 DEBUG:teuthology.orchestra.run.trial138:> set -ex 2026-02-17T10:57:47.846 DEBUG:teuthology.orchestra.run.trial138:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-17T10:57:47.902 INFO:tasks.ceph:Sending monmap to node ubuntu@trial138.front.sepia.ceph.com 2026-02-17T10:57:47.903 DEBUG:teuthology.orchestra.run.trial138:> set -ex 2026-02-17T10:57:47.903 DEBUG:teuthology.orchestra.run.trial138:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-17T10:57:47.903 DEBUG:teuthology.orchestra.run.trial138:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T10:57:47.975 DEBUG:teuthology.orchestra.run.trial138:> set -ex 2026-02-17T10:57:47.975 DEBUG:teuthology.orchestra.run.trial138:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-17T10:57:48.030 INFO:tasks.ceph:Setting up mon nodes... 2026-02-17T10:57:48.030 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-17T10:57:48.030 DEBUG:teuthology.orchestra.run.trial138:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-17T10:57:48.114 INFO:teuthology.orchestra.run.trial138.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-17T10:57:48.116 INFO:tasks.ceph:Setting up mds nodes... 2026-02-17T10:57:48.117 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-17T10:57:48.117 DEBUG:teuthology.orchestra.run.trial138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-17T10:57:48.192 INFO:teuthology.orchestra.run.trial138.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-17T10:57:48.202 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-17T10:57:48.202 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial138.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2026-02-17T10:57:48.203 DEBUG:teuthology.orchestra.run.trial138:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-17T10:57:48.264 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T10:57:48.265 INFO:tasks.ceph:role: osd.0 2026-02-17T10:57:48.265 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial138.front.sepia.ceph.com 2026-02-17T10:57:48.265 DEBUG:teuthology.orchestra.run.trial138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-17T10:57:48.331 INFO:teuthology.orchestra.run.trial138.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T10:57:48.331 INFO:teuthology.orchestra.run.trial138.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T10:57:48.331 INFO:teuthology.orchestra.run.trial138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T10:57:48.332 INFO:teuthology.orchestra.run.trial138.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T10:57:48.332 INFO:teuthology.orchestra.run.trial138.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T10:57:48.332 INFO:teuthology.orchestra.run.trial138.stdout: = sunit=0 swidth=0 blks 2026-02-17T10:57:48.332 INFO:teuthology.orchestra.run.trial138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T10:57:48.332 INFO:teuthology.orchestra.run.trial138.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T10:57:48.332 INFO:teuthology.orchestra.run.trial138.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T10:57:48.332 INFO:teuthology.orchestra.run.trial138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T10:57:48.913 INFO:teuthology.orchestra.run.trial138.stdout:Discarding blocks...Done. 2026-02-17T10:57:48.915 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial138.front.sepia.ceph.com -o noatime 2026-02-17T10:57:48.916 DEBUG:teuthology.orchestra.run.trial138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-17T10:57:48.985 DEBUG:teuthology.orchestra.run.trial138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-17T10:57:49.052 DEBUG:teuthology.orchestra.run.trial138:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-17T10:57:49.117 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T10:57:49.118 INFO:tasks.ceph:role: osd.1 2026-02-17T10:57:49.118 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial138.front.sepia.ceph.com 2026-02-17T10:57:49.118 DEBUG:teuthology.orchestra.run.trial138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-17T10:57:49.183 INFO:teuthology.orchestra.run.trial138.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T10:57:49.184 INFO:teuthology.orchestra.run.trial138.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T10:57:49.184 INFO:teuthology.orchestra.run.trial138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T10:57:49.184 INFO:teuthology.orchestra.run.trial138.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T10:57:49.184 INFO:teuthology.orchestra.run.trial138.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T10:57:49.184 INFO:teuthology.orchestra.run.trial138.stdout: = sunit=0 swidth=0 blks 2026-02-17T10:57:49.184 INFO:teuthology.orchestra.run.trial138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T10:57:49.184 INFO:teuthology.orchestra.run.trial138.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T10:57:49.184 INFO:teuthology.orchestra.run.trial138.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T10:57:49.184 INFO:teuthology.orchestra.run.trial138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T10:57:49.747 INFO:teuthology.orchestra.run.trial138.stdout:Discarding blocks...Done. 2026-02-17T10:57:49.749 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial138.front.sepia.ceph.com -o noatime 2026-02-17T10:57:49.749 DEBUG:teuthology.orchestra.run.trial138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-17T10:57:49.817 DEBUG:teuthology.orchestra.run.trial138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-17T10:57:49.883 DEBUG:teuthology.orchestra.run.trial138:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-17T10:57:49.948 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T10:57:49.948 INFO:tasks.ceph:role: osd.2 2026-02-17T10:57:49.948 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial138.front.sepia.ceph.com 2026-02-17T10:57:49.948 DEBUG:teuthology.orchestra.run.trial138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-17T10:57:50.014 INFO:teuthology.orchestra.run.trial138.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T10:57:50.014 INFO:teuthology.orchestra.run.trial138.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T10:57:50.014 INFO:teuthology.orchestra.run.trial138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T10:57:50.014 INFO:teuthology.orchestra.run.trial138.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T10:57:50.015 INFO:teuthology.orchestra.run.trial138.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T10:57:50.015 INFO:teuthology.orchestra.run.trial138.stdout: = sunit=0 swidth=0 blks 2026-02-17T10:57:50.015 INFO:teuthology.orchestra.run.trial138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T10:57:50.015 INFO:teuthology.orchestra.run.trial138.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T10:57:50.015 INFO:teuthology.orchestra.run.trial138.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T10:57:50.015 INFO:teuthology.orchestra.run.trial138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T10:57:50.585 INFO:teuthology.orchestra.run.trial138.stdout:Discarding blocks...Done. 2026-02-17T10:57:50.587 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial138.front.sepia.ceph.com -o noatime 2026-02-17T10:57:50.587 DEBUG:teuthology.orchestra.run.trial138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2026-02-17T10:57:50.655 DEBUG:teuthology.orchestra.run.trial138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-17T10:57:50.721 DEBUG:teuthology.orchestra.run.trial138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T10:57:50.800 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T10:57:50.799+0000 7fe6d7c2a780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-17T10:57:50.801 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T10:57:50.799+0000 7fe6d7c2a780 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-17T10:57:50.801 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T10:57:50.799+0000 7fe6d7c2a780 -1 bdev(0x5573fb883800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-17T10:57:50.801 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T10:57:50.799+0000 7fe6d7c2a780 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-17T10:57:52.916 DEBUG:teuthology.orchestra.run.trial138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-17T10:57:52.980 DEBUG:teuthology.orchestra.run.trial138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T10:57:53.057 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T10:57:53.056+0000 7f606cc1c780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-17T10:57:53.057 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T10:57:53.056+0000 7f606cc1c780 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-17T10:57:53.057 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T10:57:53.056+0000 7f606cc1c780 -1 bdev(0x556f2b271800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-17T10:57:53.057 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T10:57:53.056+0000 7f606cc1c780 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-17T10:57:55.409 DEBUG:teuthology.orchestra.run.trial138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-17T10:57:55.474 DEBUG:teuthology.orchestra.run.trial138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T10:57:55.554 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T10:57:55.552+0000 7fb8c1995780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-17T10:57:55.554 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T10:57:55.552+0000 7fb8c1995780 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-17T10:57:55.554 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T10:57:55.552+0000 7fb8c1995780 -1 bdev(0x55becd8af800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-02-17T10:57:55.554 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T10:57:55.552+0000 7fb8c1995780 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-17T10:57:57.662 DEBUG:teuthology.orchestra.run.trial138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-17T10:57:57.726 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-17T10:57:57.726 DEBUG:teuthology.orchestra.run.trial138:> set -ex 2026-02-17T10:57:57.726 DEBUG:teuthology.orchestra.run.trial138:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-17T10:57:57.791 DEBUG:teuthology.orchestra.run.trial138:> set -ex 2026-02-17T10:57:57.791 DEBUG:teuthology.orchestra.run.trial138:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-17T10:57:57.855 DEBUG:teuthology.orchestra.run.trial138:> set -ex 2026-02-17T10:57:57.856 DEBUG:teuthology.orchestra.run.trial138:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-17T10:57:57.919 DEBUG:teuthology.orchestra.run.trial138:> set -ex 2026-02-17T10:57:57.919 DEBUG:teuthology.orchestra.run.trial138:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-17T10:57:57.983 DEBUG:teuthology.orchestra.run.trial138:> set -ex 2026-02-17T10:57:57.984 DEBUG:teuthology.orchestra.run.trial138:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-17T10:57:58.040 INFO:tasks.ceph:Adding keys to all mons... 2026-02-17T10:57:58.040 DEBUG:teuthology.orchestra.run.trial138:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-17T10:57:58.102 INFO:teuthology.orchestra.run.trial138.stdout:[mgr.x] 2026-02-17T10:57:58.102 INFO:teuthology.orchestra.run.trial138.stdout: key = AQCsSZRpkR7FBhAAl69vus8bgOpgy53kRCq2jA== 2026-02-17T10:57:58.102 INFO:teuthology.orchestra.run.trial138.stdout:[osd.0] 2026-02-17T10:57:58.103 INFO:teuthology.orchestra.run.trial138.stdout: key = AQCuSZRp+K+3LxAAzsIJ6A40ZSmse8NMr0+WCA== 2026-02-17T10:57:58.103 INFO:teuthology.orchestra.run.trial138.stdout:[osd.1] 2026-02-17T10:57:58.103 INFO:teuthology.orchestra.run.trial138.stdout: key = AQCxSZRpGpJhAxAAjl61erTo1OcrrmTv8AOVUQ== 2026-02-17T10:57:58.103 INFO:teuthology.orchestra.run.trial138.stdout:[osd.2] 2026-02-17T10:57:58.103 INFO:teuthology.orchestra.run.trial138.stdout: key = AQCzSZRpJyj0IBAAg6WwbIOhIPTaBn91rlVtag== 2026-02-17T10:57:58.103 INFO:teuthology.orchestra.run.trial138.stdout:[client.0] 2026-02-17T10:57:58.103 INFO:teuthology.orchestra.run.trial138.stdout: key = AQCsSZRpbZxoCxAAr8lUef0tcNjKY61gEr1WPw== 2026-02-17T10:57:58.104 DEBUG:teuthology.orchestra.run.trial138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-17T10:57:58.184 DEBUG:teuthology.orchestra.run.trial138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T10:57:58.264 DEBUG:teuthology.orchestra.run.trial138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T10:57:58.344 DEBUG:teuthology.orchestra.run.trial138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T10:57:58.425 DEBUG:teuthology.orchestra.run.trial138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-17T10:57:58.507 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-17T10:57:58.507 DEBUG:teuthology.orchestra.run.trial138:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-17T10:57:58.571 DEBUG:teuthology.orchestra.run.trial138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-17T10:57:58.660 DEBUG:teuthology.orchestra.run.trial138:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-17T10:57:58.683 DEBUG:teuthology.orchestra.run.trial138:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-17T10:57:58.739 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-17T10:57:58.740 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-17T10:57:58.740 DEBUG:teuthology.orchestra.run.trial138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-17T10:57:58.781 INFO:tasks.ceph.mon.a:Started 2026-02-17T10:57:58.782 DEBUG:teuthology.orchestra.run.trial138:> sudo ceph config set mgr mgr_pool false --force 2026-02-17T10:57:58.888 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-17T10:57:58.888 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-17T10:57:58.888 DEBUG:teuthology.orchestra.run.trial138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-17T10:57:58.890 INFO:tasks.ceph.mgr.x:Started 2026-02-17T10:57:58.891 INFO:tasks.ceph:Setting crush tunables to default 2026-02-17T10:57:58.891 DEBUG:teuthology.orchestra.run.trial138:> sudo ceph --cluster ceph osd crush tunables default 2026-02-17T10:57:58.991 INFO:teuthology.orchestra.run.trial138.stderr:adjusted tunables profile to default 2026-02-17T10:57:58.999 INFO:tasks.ceph:check_enable_crimson: False 2026-02-17T10:57:58.999 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-17T10:57:59.000 DEBUG:teuthology.orchestra.run.trial138:> set -ex 2026-02-17T10:57:59.000 DEBUG:teuthology.orchestra.run.trial138:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-17T10:57:59.024 DEBUG:teuthology.orchestra.run.trial138:> set -ex 2026-02-17T10:57:59.024 DEBUG:teuthology.orchestra.run.trial138:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-17T10:57:59.089 DEBUG:teuthology.orchestra.run.trial138:> set -ex 2026-02-17T10:57:59.089 DEBUG:teuthology.orchestra.run.trial138:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-17T10:57:59.154 DEBUG:teuthology.orchestra.run.trial138:> sudo ceph --cluster ceph osd new 269f882f-b38e-48df-bb86-c57d977c8b9d 0 2026-02-17T10:57:59.294 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T10:57:59.293+0000 7f814b213140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-17T10:57:59.300 INFO:teuthology.orchestra.run.trial138.stdout:0 2026-02-17T10:57:59.309 DEBUG:teuthology.orchestra.run.trial138:> sudo ceph --cluster ceph osd new 46864e5c-d4fc-44a3-b4f3-aa66dd95a209 1 2026-02-17T10:57:59.412 INFO:teuthology.orchestra.run.trial138.stdout:1 2026-02-17T10:57:59.416 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T10:57:59.415+0000 7f814b213140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-17T10:57:59.420 DEBUG:teuthology.orchestra.run.trial138:> sudo ceph --cluster ceph osd new 5149acb8-cb3a-40e0-b3ae-66d70ba42873 2 2026-02-17T10:57:59.443 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T10:57:59.442+0000 7f814b213140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-17T10:57:59.476 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T10:57:59.475+0000 7f814b213140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-17T10:57:59.498 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T10:57:59.497+0000 7f814b213140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-17T10:57:59.522 INFO:teuthology.orchestra.run.trial138.stdout:2 2026-02-17T10:57:59.525 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T10:57:59.524+0000 7f814b213140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-17T10:57:59.530 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-17T10:57:59.530 DEBUG:teuthology.orchestra.run.trial138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-17T10:57:59.572 INFO:tasks.ceph.osd.0:Started 2026-02-17T10:57:59.573 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-17T10:57:59.573 DEBUG:teuthology.orchestra.run.trial138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-02-17T10:57:59.575 INFO:tasks.ceph.osd.1:Started 2026-02-17T10:57:59.575 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-17T10:57:59.576 DEBUG:teuthology.orchestra.run.trial138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2026-02-17T10:57:59.578 INFO:tasks.ceph.osd.2:Started 2026-02-17T10:57:59.578 DEBUG:teuthology.orchestra.run.trial138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T10:57:59.581 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T10:57:59.579+0000 7f814b213140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-17T10:57:59.644 INFO:tasks.ceph.mgr.x.trial138.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-17T10:57:59.644 INFO:tasks.ceph.mgr.x.trial138.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-17T10:57:59.644 INFO:tasks.ceph.mgr.x.trial138.stderr: from numpy import show_config as show_numpy_config 2026-02-17T10:57:59.647 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T10:57:59.646+0000 7f814b213140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-17T10:57:59.672 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T10:57:59.672+0000 7f814b213140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-17T10:57:59.680 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:57:59.681 INFO:teuthology.orchestra.run.trial138.stdout:{"epoch":5,"fsid":"b27dff50-edc3-4714-9f29-33172002e940","created":"2026-02-17T10:57:58.842998+0000","modified":"2026-02-17T10:57:59.521336+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T10:57:59.521336+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"269f882f-b38e-48df-bb86-c57d977c8b9d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"46864e5c-d4fc-44a3-b4f3-aa66dd95a209","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5149acb8-cb3a-40e0-b3ae-66d70ba42873","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T10:57:59.689 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-17T10:57:59.689 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-17T10:57:59.727 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T10:57:59.726+0000 7f814b213140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-17T10:57:59.769 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T10:57:59.768+0000 7f814b213140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-17T10:57:59.794 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T10:57:59.793+0000 7f814b213140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-17T10:57:59.817 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T10:57:59.816+0000 7f814b213140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-17T10:57:59.842 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T10:57:59.841+0000 7f814b213140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-17T10:57:59.864 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T10:57:59.863+0000 7f814b213140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-17T10:57:59.992 DEBUG:teuthology.orchestra.run.trial138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T10:58:00.059 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T10:58:00.058+0000 7f814b213140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-17T10:58:00.085 INFO:teuthology.misc.health.trial138.stdout: 2026-02-17T10:58:00.085 INFO:teuthology.misc.health.trial138.stdout:{"epoch":5,"fsid":"b27dff50-edc3-4714-9f29-33172002e940","created":"2026-02-17T10:57:58.842998+0000","modified":"2026-02-17T10:57:59.521336+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T10:57:59.521336+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"269f882f-b38e-48df-bb86-c57d977c8b9d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"46864e5c-d4fc-44a3-b4f3-aa66dd95a209","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5149acb8-cb3a-40e0-b3ae-66d70ba42873","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T10:58:00.092 DEBUG:teuthology.misc:0 of 3 OSDs are up 2026-02-17T10:58:00.114 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T10:58:00.113+0000 7f814b213140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-17T10:58:00.136 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T10:58:00.135+0000 7f814b213140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-17T10:58:00.159 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T10:58:00.158+0000 7f814b213140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-17T10:58:00.212 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T10:58:00.211+0000 7f814b213140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-17T10:58:00.232 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T10:58:00.231+0000 7f814b213140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-17T10:58:00.283 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T10:58:00.282+0000 7f814b213140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-17T10:58:00.676 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T10:58:00.674+0000 7f814b213140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-17T10:58:00.697 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T10:58:00.696+0000 7f814b213140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-17T10:58:01.037 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T10:58:01.036+0000 7f814b213140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-17T10:58:01.265 INFO:tasks.ceph.osd.1.trial138.stderr:2026-02-17T10:58:01.264+0000 7fe031164780 -1 Falling back to public interface 2026-02-17T10:58:01.494 INFO:tasks.ceph.osd.0.trial138.stderr:2026-02-17T10:58:01.493+0000 7f36ab480780 -1 Falling back to public interface 2026-02-17T10:58:01.499 INFO:tasks.ceph.osd.2.trial138.stderr:2026-02-17T10:58:01.498+0000 7fc7add51780 -1 Falling back to public interface 2026-02-17T10:58:02.042 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T10:58:02.041+0000 7f8067dcb640 -1 mgr.server handle_report got status from non-daemon mon.a 2026-02-17T10:58:04.484 INFO:tasks.ceph.osd.0.trial138.stderr:2026-02-17T10:58:04.483+0000 7f36ab480780 -1 osd.0 0 log_to_monitors true 2026-02-17T10:58:04.487 INFO:tasks.ceph.osd.1.trial138.stderr:2026-02-17T10:58:04.486+0000 7fe031164780 -1 osd.1 0 log_to_monitors true 2026-02-17T10:58:04.520 INFO:tasks.ceph.osd.2.trial138.stderr:2026-02-17T10:58:04.519+0000 7fc7add51780 -1 osd.2 0 log_to_monitors true 2026-02-17T10:58:06.061 INFO:tasks.ceph.osd.1.trial138.stderr:2026-02-17T10:58:06.060+0000 7fe02d0f3640 -1 osd.1 0 waiting for initial osdmap 2026-02-17T10:58:06.062 INFO:tasks.ceph.osd.1.trial138.stderr:2026-02-17T10:58:06.061+0000 7fe028f1d640 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T10:58:06.064 INFO:tasks.ceph.osd.2.trial138.stderr:2026-02-17T10:58:06.064+0000 7fc7a9cde640 -1 osd.2 0 waiting for initial osdmap 2026-02-17T10:58:06.065 INFO:tasks.ceph.osd.0.trial138.stderr:2026-02-17T10:58:06.064+0000 7f36a740d640 -1 osd.0 0 waiting for initial osdmap 2026-02-17T10:58:06.066 INFO:tasks.ceph.osd.0.trial138.stderr:2026-02-17T10:58:06.065+0000 7f36a3237640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T10:58:06.067 INFO:tasks.ceph.osd.2.trial138.stderr:2026-02-17T10:58:06.066+0000 7fc7a5b08640 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T10:58:06.394 DEBUG:teuthology.orchestra.run.trial138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T10:58:06.547 INFO:teuthology.misc.health.trial138.stdout: 2026-02-17T10:58:06.548 INFO:teuthology.misc.health.trial138.stdout:{"epoch":7,"fsid":"b27dff50-edc3-4714-9f29-33172002e940","created":"2026-02-17T10:57:58.842998+0000","modified":"2026-02-17T10:58:06.044566+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T10:57:59.521336+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"269f882f-b38e-48df-bb86-c57d977c8b9d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"46864e5c-d4fc-44a3-b4f3-aa66dd95a209","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5149acb8-cb3a-40e0-b3ae-66d70ba42873","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T10:58:06.555 DEBUG:teuthology.misc:0 of 3 OSDs are up 2026-02-17T10:58:12.858 DEBUG:teuthology.orchestra.run.trial138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T10:58:13.007 INFO:teuthology.misc.health.trial138.stdout: 2026-02-17T10:58:13.007 INFO:teuthology.misc.health.trial138.stdout:{"epoch":8,"fsid":"b27dff50-edc3-4714-9f29-33172002e940","created":"2026-02-17T10:57:58.842998+0000","modified":"2026-02-17T10:58:07.046197+0000","last_up_change":"2026-02-17T10:58:07.046197+0000","last_in_change":"2026-02-17T10:57:59.521336+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"269f882f-b38e-48df-bb86-c57d977c8b9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6810","nonce":1335950096},{"type":"v1","addr":"10.20.193.138:6811","nonce":1335950096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6812","nonce":1335950096},{"type":"v1","addr":"10.20.193.138:6813","nonce":1335950096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6816","nonce":1335950096},{"type":"v1","addr":"10.20.193.138:6817","nonce":1335950096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6814","nonce":1335950096},{"type":"v1","addr":"10.20.193.138:6815","nonce":1335950096}]},"public_addr":"10.20.193.138:6811/1335950096","cluster_addr":"10.20.193.138:6813/1335950096","heartbeat_back_addr":"10.20.193.138:6817/1335950096","heartbeat_front_addr":"10.20.193.138:6815/1335950096","state":["exists","up"]},{"osd":1,"uuid":"46864e5c-d4fc-44a3-b4f3-aa66dd95a209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6802","nonce":1008918870},{"type":"v1","addr":"10.20.193.138:6803","nonce":1008918870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6804","nonce":1008918870},{"type":"v1","addr":"10.20.193.138:6805","nonce":1008918870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6808","nonce":1008918870},{"type":"v1","addr":"10.20.193.138:6809","nonce":1008918870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6806","nonce":1008918870},{"type":"v1","addr":"10.20.193.138:6807","nonce":1008918870}]},"public_addr":"10.20.193.138:6803/1008918870","cluster_addr":"10.20.193.138:6805/1008918870","heartbeat_back_addr":"10.20.193.138:6809/1008918870","heartbeat_front_addr":"10.20.193.138:6807/1008918870","state":["exists","up"]},{"osd":2,"uuid":"5149acb8-cb3a-40e0-b3ae-66d70ba42873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6818","nonce":885806557},{"type":"v1","addr":"10.20.193.138:6819","nonce":885806557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6820","nonce":885806557},{"type":"v1","addr":"10.20.193.138:6821","nonce":885806557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6824","nonce":885806557},{"type":"v1","addr":"10.20.193.138:6825","nonce":885806557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6822","nonce":885806557},{"type":"v1","addr":"10.20.193.138:6823","nonce":885806557}]},"public_addr":"10.20.193.138:6819/885806557","cluster_addr":"10.20.193.138:6821/885806557","heartbeat_back_addr":"10.20.193.138:6825/885806557","heartbeat_front_addr":"10.20.193.138:6823/885806557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T10:58:13.014 DEBUG:teuthology.misc:3 of 3 OSDs are up 2026-02-17T10:58:13.014 INFO:tasks.ceph:Creating RBD pool 2026-02-17T10:58:13.014 DEBUG:teuthology.orchestra.run.trial138:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-17T10:58:14.058 INFO:teuthology.orchestra.run.trial138.stderr:pool 'rbd' created 2026-02-17T10:58:14.070 DEBUG:teuthology.orchestra.run.trial138:> rbd --cluster ceph pool init rbd 2026-02-17T10:58:17.070 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-17T10:58:17.071 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-17T10:58:17.071 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-17T10:58:17.071 DEBUG:teuthology.orchestra.run.trial138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-17T10:58:17.072 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-17T10:58:17.250 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:58:17.257 INFO:teuthology.orchestra.run.trial138.stdout:{"epoch":4,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6800","nonce":1386876886},{"type":"v1","addr":"10.20.193.138:6801","nonce":1386876886}]},"active_addr":"10.20.193.138:6801/1386876886","active_change":"2026-02-17T10:58:01.037627+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.138:0","nonce":3008624143}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.138:0","nonce":2220369996}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.138:0","nonce":1034815167}]}]} 2026-02-17T10:58:17.261 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-17T10:58:17.261 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-17T10:58:17.261 DEBUG:teuthology.orchestra.run.trial138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T10:58:17.417 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:58:17.418 INFO:teuthology.orchestra.run.trial138.stdout:{"epoch":12,"fsid":"b27dff50-edc3-4714-9f29-33172002e940","created":"2026-02-17T10:57:58.842998+0000","modified":"2026-02-17T10:58:17.062359+0000","last_up_change":"2026-02-17T10:58:07.046197+0000","last_in_change":"2026-02-17T10:57:59.521336+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-17T10:58:13.169256+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":12,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"269f882f-b38e-48df-bb86-c57d977c8b9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6810","nonce":1335950096},{"type":"v1","addr":"10.20.193.138:6811","nonce":1335950096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6812","nonce":1335950096},{"type":"v1","addr":"10.20.193.138:6813","nonce":1335950096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6816","nonce":1335950096},{"type":"v1","addr":"10.20.193.138:6817","nonce":1335950096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6814","nonce":1335950096},{"type":"v1","addr":"10.20.193.138:6815","nonce":1335950096}]},"public_addr":"10.20.193.138:6811/1335950096","cluster_addr":"10.20.193.138:6813/1335950096","heartbeat_back_addr":"10.20.193.138:6817/1335950096","heartbeat_front_addr":"10.20.193.138:6815/1335950096","state":["exists","up"]},{"osd":1,"uuid":"46864e5c-d4fc-44a3-b4f3-aa66dd95a209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6802","nonce":1008918870},{"type":"v1","addr":"10.20.193.138:6803","nonce":1008918870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6804","nonce":1008918870},{"type":"v1","addr":"10.20.193.138:6805","nonce":1008918870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6808","nonce":1008918870},{"type":"v1","addr":"10.20.193.138:6809","nonce":1008918870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6806","nonce":1008918870},{"type":"v1","addr":"10.20.193.138:6807","nonce":1008918870}]},"public_addr":"10.20.193.138:6803/1008918870","cluster_addr":"10.20.193.138:6805/1008918870","heartbeat_back_addr":"10.20.193.138:6809/1008918870","heartbeat_front_addr":"10.20.193.138:6807/1008918870","state":["exists","up"]},{"osd":2,"uuid":"5149acb8-cb3a-40e0-b3ae-66d70ba42873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6818","nonce":885806557},{"type":"v1","addr":"10.20.193.138:6819","nonce":885806557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6820","nonce":885806557},{"type":"v1","addr":"10.20.193.138:6821","nonce":885806557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6824","nonce":885806557},{"type":"v1","addr":"10.20.193.138:6825","nonce":885806557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6822","nonce":885806557},{"type":"v1","addr":"10.20.193.138:6823","nonce":885806557}]},"public_addr":"10.20.193.138:6819/885806557","cluster_addr":"10.20.193.138:6821/885806557","heartbeat_back_addr":"10.20.193.138:6825/885806557","heartbeat_front_addr":"10.20.193.138:6823/885806557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T10:58:17.425 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-17T10:58:17.426 DEBUG:teuthology.orchestra.run.trial138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T10:58:17.582 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:58:17.582 INFO:teuthology.orchestra.run.trial138.stdout:{"epoch":12,"fsid":"b27dff50-edc3-4714-9f29-33172002e940","created":"2026-02-17T10:57:58.842998+0000","modified":"2026-02-17T10:58:17.062359+0000","last_up_change":"2026-02-17T10:58:07.046197+0000","last_in_change":"2026-02-17T10:57:59.521336+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-17T10:58:13.169256+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":12,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"269f882f-b38e-48df-bb86-c57d977c8b9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6810","nonce":1335950096},{"type":"v1","addr":"10.20.193.138:6811","nonce":1335950096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6812","nonce":1335950096},{"type":"v1","addr":"10.20.193.138:6813","nonce":1335950096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6816","nonce":1335950096},{"type":"v1","addr":"10.20.193.138:6817","nonce":1335950096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6814","nonce":1335950096},{"type":"v1","addr":"10.20.193.138:6815","nonce":1335950096}]},"public_addr":"10.20.193.138:6811/1335950096","cluster_addr":"10.20.193.138:6813/1335950096","heartbeat_back_addr":"10.20.193.138:6817/1335950096","heartbeat_front_addr":"10.20.193.138:6815/1335950096","state":["exists","up"]},{"osd":1,"uuid":"46864e5c-d4fc-44a3-b4f3-aa66dd95a209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6802","nonce":1008918870},{"type":"v1","addr":"10.20.193.138:6803","nonce":1008918870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6804","nonce":1008918870},{"type":"v1","addr":"10.20.193.138:6805","nonce":1008918870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6808","nonce":1008918870},{"type":"v1","addr":"10.20.193.138:6809","nonce":1008918870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6806","nonce":1008918870},{"type":"v1","addr":"10.20.193.138:6807","nonce":1008918870}]},"public_addr":"10.20.193.138:6803/1008918870","cluster_addr":"10.20.193.138:6805/1008918870","heartbeat_back_addr":"10.20.193.138:6809/1008918870","heartbeat_front_addr":"10.20.193.138:6807/1008918870","state":["exists","up"]},{"osd":2,"uuid":"5149acb8-cb3a-40e0-b3ae-66d70ba42873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6818","nonce":885806557},{"type":"v1","addr":"10.20.193.138:6819","nonce":885806557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6820","nonce":885806557},{"type":"v1","addr":"10.20.193.138:6821","nonce":885806557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6824","nonce":885806557},{"type":"v1","addr":"10.20.193.138:6825","nonce":885806557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6822","nonce":885806557},{"type":"v1","addr":"10.20.193.138:6823","nonce":885806557}]},"public_addr":"10.20.193.138:6819/885806557","cluster_addr":"10.20.193.138:6821/885806557","heartbeat_back_addr":"10.20.193.138:6825/885806557","heartbeat_front_addr":"10.20.193.138:6823/885806557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T10:58:17.590 DEBUG:teuthology.orchestra.run.trial138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T10:58:17.591 DEBUG:teuthology.orchestra.run.trial138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T10:58:17.592 DEBUG:teuthology.orchestra.run.trial138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T10:58:17.678 INFO:teuthology.orchestra.run.trial138.stdout:34359738372 2026-02-17T10:58:17.678 DEBUG:teuthology.orchestra.run.trial138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T10:58:17.680 INFO:teuthology.orchestra.run.trial138.stdout:34359738372 2026-02-17T10:58:17.681 DEBUG:teuthology.orchestra.run.trial138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T10:58:17.682 INFO:teuthology.orchestra.run.trial138.stdout:34359738373 2026-02-17T10:58:17.682 DEBUG:teuthology.orchestra.run.trial138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T10:58:17.880 INFO:teuthology.orchestra.run.trial138.stdout:34359738371 2026-02-17T10:58:17.882 INFO:teuthology.orchestra.run.trial138.stdout:34359738371 2026-02-17T10:58:17.888 INFO:teuthology.orchestra.run.trial138.stdout:34359738372 2026-02-17T10:58:17.889 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738371 for osd.0 2026-02-17T10:58:17.892 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738371 for osd.2 2026-02-17T10:58:17.898 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738372 for osd.1 2026-02-17T10:58:18.890 DEBUG:teuthology.orchestra.run.trial138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T10:58:18.892 DEBUG:teuthology.orchestra.run.trial138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T10:58:18.898 DEBUG:teuthology.orchestra.run.trial138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T10:58:19.052 INFO:teuthology.orchestra.run.trial138.stdout:34359738371 2026-02-17T10:58:19.055 INFO:teuthology.orchestra.run.trial138.stdout:34359738371 2026-02-17T10:58:19.062 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738371 for osd.2 2026-02-17T10:58:19.065 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738371 for osd.0 2026-02-17T10:58:19.094 INFO:teuthology.orchestra.run.trial138.stdout:34359738374 2026-02-17T10:58:19.104 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738374 for osd.1 2026-02-17T10:58:19.105 DEBUG:teuthology.parallel:result is None 2026-02-17T10:58:20.062 DEBUG:teuthology.orchestra.run.trial138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T10:58:20.066 DEBUG:teuthology.orchestra.run.trial138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T10:58:20.221 INFO:teuthology.orchestra.run.trial138.stdout:34359738373 2026-02-17T10:58:20.231 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738373 for osd.2 2026-02-17T10:58:20.231 DEBUG:teuthology.parallel:result is None 2026-02-17T10:58:20.268 INFO:teuthology.orchestra.run.trial138.stdout:34359738373 2026-02-17T10:58:20.278 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738373 for osd.0 2026-02-17T10:58:20.278 DEBUG:teuthology.parallel:result is None 2026-02-17T10:58:20.278 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-17T10:58:20.278 DEBUG:teuthology.orchestra.run.trial138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T10:58:20.473 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:58:20.474 INFO:teuthology.orchestra.run.trial138.stderr:dumped all 2026-02-17T10:58:20.481 INFO:teuthology.orchestra.run.trial138.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2026-02-17T10:58:19.041382+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":81212,"kb_used_data":320,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":314491588,"statfs":{"total":322122547200,"available":322039386112,"internally_reserved":0,"allocated":327680,"data_stored":81620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4781,"internal_metadata":82767187},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T10:58:17.066596+0000","last_change":"2026-02-17T10:58:17.066596+0000","last_active":"2026-02-17T10:58:17.066596+0000","last_peered":"2026-02-17T10:58:17.066596+0000","last_clean":"2026-02-17T10:58:17.066596+0000","last_became_active":"2026-02-17T10:58:15.063792+0000","last_became_peered":"2026-02-17T10:58:15.063792+0000","last_unstale":"2026-02-17T10:58:17.066596+0000","last_undegraded":"2026-02-17T10:58:17.066596+0000","last_fullsized":"2026-02-17T10:58:17.066596+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:36:47.905105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036630700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T10:58:17.066497+0000","last_change":"2026-02-17T10:58:17.066497+0000","last_active":"2026-02-17T10:58:17.066497+0000","last_peered":"2026-02-17T10:58:17.066497+0000","last_clean":"2026-02-17T10:58:17.066497+0000","last_became_active":"2026-02-17T10:58:15.064292+0000","last_became_peered":"2026-02-17T10:58:15.064292+0000","last_unstale":"2026-02-17T10:58:17.066497+0000","last_undegraded":"2026-02-17T10:58:17.066497+0000","last_fullsized":"2026-02-17T10:58:17.066497+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:05:54.317111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029424399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T10:58:17.064493+0000","last_change":"2026-02-17T10:58:17.064493+0000","last_active":"2026-02-17T10:58:17.064493+0000","last_peered":"2026-02-17T10:58:17.064493+0000","last_clean":"2026-02-17T10:58:17.064493+0000","last_became_active":"2026-02-17T10:58:15.063970+0000","last_became_peered":"2026-02-17T10:58:15.063970+0000","last_unstale":"2026-02-17T10:58:17.064493+0000","last_undegraded":"2026-02-17T10:58:17.064493+0000","last_fullsized":"2026-02-17T10:58:17.064493+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:58:30.074704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000175174,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T10:58:17.066401+0000","last_change":"2026-02-17T10:58:17.066401+0000","last_active":"2026-02-17T10:58:17.066401+0000","last_peered":"2026-02-17T10:58:17.066401+0000","last_clean":"2026-02-17T10:58:17.066401+0000","last_became_active":"2026-02-17T10:58:15.064024+0000","last_became_peered":"2026-02-17T10:58:15.064024+0000","last_unstale":"2026-02-17T10:58:17.066401+0000","last_undegraded":"2026-02-17T10:58:17.066401+0000","last_fullsized":"2026-02-17T10:58:17.066401+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:24:50.691188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000197605,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.3","version":"10'1","reported_seq":20,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T10:58:17.066533+0000","last_change":"2026-02-17T10:58:17.066533+0000","last_active":"2026-02-17T10:58:17.066533+0000","last_peered":"2026-02-17T10:58:17.066533+0000","last_clean":"2026-02-17T10:58:17.066533+0000","last_became_active":"2026-02-17T10:58:15.063770+0000","last_became_peered":"2026-02-17T10:58:15.063770+0000","last_unstale":"2026-02-17T10:58:17.066533+0000","last_undegraded":"2026-02-17T10:58:17.066533+0000","last_fullsized":"2026-02-17T10:58:17.066533+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:24:21.343084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033193300000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.2","version":"12'2","reported_seq":21,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T10:58:17.065968+0000","last_change":"2026-02-17T10:58:17.065530+0000","last_active":"2026-02-17T10:58:17.065968+0000","last_peered":"2026-02-17T10:58:17.065968+0000","last_clean":"2026-02-17T10:58:17.065968+0000","last_became_active":"2026-02-17T10:58:15.063551+0000","last_became_peered":"2026-02-17T10:58:15.063551+0000","last_unstale":"2026-02-17T10:58:17.065968+0000","last_undegraded":"2026-02-17T10:58:17.065968+0000","last_fullsized":"2026-02-17T10:58:17.065968+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:46:08.530261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034513799999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T10:58:17.064478+0000","last_change":"2026-02-17T10:58:17.064478+0000","last_active":"2026-02-17T10:58:17.064478+0000","last_peered":"2026-02-17T10:58:17.064478+0000","last_clean":"2026-02-17T10:58:17.064478+0000","last_became_active":"2026-02-17T10:58:15.063794+0000","last_became_peered":"2026-02-17T10:58:15.063794+0000","last_unstale":"2026-02-17T10:58:17.064478+0000","last_undegraded":"2026-02-17T10:58:17.064478+0000","last_fullsized":"2026-02-17T10:58:17.064478+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:28:04.777048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00018169599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T10:58:17.066401+0000","last_change":"2026-02-17T10:58:17.066401+0000","last_active":"2026-02-17T10:58:17.066401+0000","last_peered":"2026-02-17T10:58:17.066401+0000","last_clean":"2026-02-17T10:58:17.066401+0000","last_became_active":"2026-02-17T10:58:15.064000+0000","last_became_peered":"2026-02-17T10:58:15.064000+0000","last_unstale":"2026-02-17T10:58:17.066401+0000","last_undegraded":"2026-02-17T10:58:17.066401+0000","last_fullsized":"2026-02-17T10:58:17.066401+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:40:19.034197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000226419,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27068,"kb_used_data":104,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830532,"statfs":{"total":107374182400,"available":107346464768,"internally_reserved":0,"allocated":106496,"data_stored":27194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27072,"kb_used_data":108,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830528,"statfs":{"total":107374182400,"available":107346460672,"internally_reserved":0,"allocated":110592,"data_stored":27213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27072,"kb_used_data":108,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830528,"statfs":{"total":107374182400,"available":107346460672,"internally_reserved":0,"allocated":110592,"data_stored":27213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T10:58:20.481 DEBUG:teuthology.orchestra.run.trial138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T10:58:20.636 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:58:20.637 INFO:teuthology.orchestra.run.trial138.stderr:dumped all 2026-02-17T10:58:20.644 INFO:teuthology.orchestra.run.trial138.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2026-02-17T10:58:19.041382+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":81212,"kb_used_data":320,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":314491588,"statfs":{"total":322122547200,"available":322039386112,"internally_reserved":0,"allocated":327680,"data_stored":81620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4781,"internal_metadata":82767187},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T10:58:17.066596+0000","last_change":"2026-02-17T10:58:17.066596+0000","last_active":"2026-02-17T10:58:17.066596+0000","last_peered":"2026-02-17T10:58:17.066596+0000","last_clean":"2026-02-17T10:58:17.066596+0000","last_became_active":"2026-02-17T10:58:15.063792+0000","last_became_peered":"2026-02-17T10:58:15.063792+0000","last_unstale":"2026-02-17T10:58:17.066596+0000","last_undegraded":"2026-02-17T10:58:17.066596+0000","last_fullsized":"2026-02-17T10:58:17.066596+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:36:47.905105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036630700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T10:58:17.066497+0000","last_change":"2026-02-17T10:58:17.066497+0000","last_active":"2026-02-17T10:58:17.066497+0000","last_peered":"2026-02-17T10:58:17.066497+0000","last_clean":"2026-02-17T10:58:17.066497+0000","last_became_active":"2026-02-17T10:58:15.064292+0000","last_became_peered":"2026-02-17T10:58:15.064292+0000","last_unstale":"2026-02-17T10:58:17.066497+0000","last_undegraded":"2026-02-17T10:58:17.066497+0000","last_fullsized":"2026-02-17T10:58:17.066497+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:05:54.317111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029424399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T10:58:17.064493+0000","last_change":"2026-02-17T10:58:17.064493+0000","last_active":"2026-02-17T10:58:17.064493+0000","last_peered":"2026-02-17T10:58:17.064493+0000","last_clean":"2026-02-17T10:58:17.064493+0000","last_became_active":"2026-02-17T10:58:15.063970+0000","last_became_peered":"2026-02-17T10:58:15.063970+0000","last_unstale":"2026-02-17T10:58:17.064493+0000","last_undegraded":"2026-02-17T10:58:17.064493+0000","last_fullsized":"2026-02-17T10:58:17.064493+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:58:30.074704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000175174,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T10:58:17.066401+0000","last_change":"2026-02-17T10:58:17.066401+0000","last_active":"2026-02-17T10:58:17.066401+0000","last_peered":"2026-02-17T10:58:17.066401+0000","last_clean":"2026-02-17T10:58:17.066401+0000","last_became_active":"2026-02-17T10:58:15.064024+0000","last_became_peered":"2026-02-17T10:58:15.064024+0000","last_unstale":"2026-02-17T10:58:17.066401+0000","last_undegraded":"2026-02-17T10:58:17.066401+0000","last_fullsized":"2026-02-17T10:58:17.066401+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:24:50.691188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000197605,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.3","version":"10'1","reported_seq":20,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T10:58:17.066533+0000","last_change":"2026-02-17T10:58:17.066533+0000","last_active":"2026-02-17T10:58:17.066533+0000","last_peered":"2026-02-17T10:58:17.066533+0000","last_clean":"2026-02-17T10:58:17.066533+0000","last_became_active":"2026-02-17T10:58:15.063770+0000","last_became_peered":"2026-02-17T10:58:15.063770+0000","last_unstale":"2026-02-17T10:58:17.066533+0000","last_undegraded":"2026-02-17T10:58:17.066533+0000","last_fullsized":"2026-02-17T10:58:17.066533+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:24:21.343084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033193300000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.2","version":"12'2","reported_seq":21,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T10:58:17.065968+0000","last_change":"2026-02-17T10:58:17.065530+0000","last_active":"2026-02-17T10:58:17.065968+0000","last_peered":"2026-02-17T10:58:17.065968+0000","last_clean":"2026-02-17T10:58:17.065968+0000","last_became_active":"2026-02-17T10:58:15.063551+0000","last_became_peered":"2026-02-17T10:58:15.063551+0000","last_unstale":"2026-02-17T10:58:17.065968+0000","last_undegraded":"2026-02-17T10:58:17.065968+0000","last_fullsized":"2026-02-17T10:58:17.065968+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:46:08.530261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034513799999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T10:58:17.064478+0000","last_change":"2026-02-17T10:58:17.064478+0000","last_active":"2026-02-17T10:58:17.064478+0000","last_peered":"2026-02-17T10:58:17.064478+0000","last_clean":"2026-02-17T10:58:17.064478+0000","last_became_active":"2026-02-17T10:58:15.063794+0000","last_became_peered":"2026-02-17T10:58:15.063794+0000","last_unstale":"2026-02-17T10:58:17.064478+0000","last_undegraded":"2026-02-17T10:58:17.064478+0000","last_fullsized":"2026-02-17T10:58:17.064478+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:28:04.777048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00018169599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T10:58:17.066401+0000","last_change":"2026-02-17T10:58:17.066401+0000","last_active":"2026-02-17T10:58:17.066401+0000","last_peered":"2026-02-17T10:58:17.066401+0000","last_clean":"2026-02-17T10:58:17.066401+0000","last_became_active":"2026-02-17T10:58:15.064000+0000","last_became_peered":"2026-02-17T10:58:15.064000+0000","last_unstale":"2026-02-17T10:58:17.066401+0000","last_undegraded":"2026-02-17T10:58:17.066401+0000","last_fullsized":"2026-02-17T10:58:17.066401+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:40:19.034197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000226419,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27068,"kb_used_data":104,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830532,"statfs":{"total":107374182400,"available":107346464768,"internally_reserved":0,"allocated":106496,"data_stored":27194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27072,"kb_used_data":108,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830528,"statfs":{"total":107374182400,"available":107346460672,"internally_reserved":0,"allocated":110592,"data_stored":27213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27072,"kb_used_data":108,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830528,"statfs":{"total":107374182400,"available":107346460672,"internally_reserved":0,"allocated":110592,"data_stored":27213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T10:58:20.645 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-17T10:58:20.645 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-17T10:58:20.646 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-17T10:58:20.646 DEBUG:teuthology.orchestra.run.trial138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T10:58:20.819 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:58:20.819 INFO:teuthology.orchestra.run.trial138.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-17T10:58:20.828 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-17T10:58:20.828 INFO:teuthology.run_tasks:Running task exec... 2026-02-17T10:58:20.845 INFO:teuthology.task.exec:Executing custom commands... 2026-02-17T10:58:20.845 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@trial138.front.sepia.ceph.com 2026-02-17T10:58:20.845 DEBUG:teuthology.orchestra.run.trial138:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_snap_mapper 2026-02-17T10:58:20.881 INFO:teuthology.orchestra.run.trial138.stdout:[==========] Running 12 tests from 3 test suites. 2026-02-17T10:58:20.881 INFO:teuthology.orchestra.run.trial138.stdout:[----------] Global test environment set-up. 2026-02-17T10:58:20.881 INFO:teuthology.orchestra.run.trial138.stdout:[----------] 2 tests from MapCacherTest 2026-02-17T10:58:20.881 INFO:teuthology.orchestra.run.trial138.stdout:[ RUN ] MapCacherTest.Simple 2026-02-17T10:58:21.881 INFO:teuthology.orchestra.run.trial138.stdout:[ OK ] MapCacherTest.Simple (1000 ms) 2026-02-17T10:58:21.882 INFO:teuthology.orchestra.run.trial138.stdout:[ RUN ] MapCacherTest.Random 2026-02-17T10:58:21.882 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 0 2026-02-17T10:58:21.882 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 50 2026-02-17T10:58:21.884 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 100 2026-02-17T10:58:21.890 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 150 2026-02-17T10:58:21.891 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 200 2026-02-17T10:58:21.968 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 250 2026-02-17T10:58:21.968 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 300 2026-02-17T10:58:22.050 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 350 2026-02-17T10:58:22.051 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 400 2026-02-17T10:58:22.141 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 450 2026-02-17T10:58:22.142 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 500 2026-02-17T10:58:22.236 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 550 2026-02-17T10:58:22.237 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 600 2026-02-17T10:58:22.313 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 650 2026-02-17T10:58:22.314 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 700 2026-02-17T10:58:22.400 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 750 2026-02-17T10:58:22.401 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 800 2026-02-17T10:58:22.469 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 850 2026-02-17T10:58:22.470 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 900 2026-02-17T10:58:22.573 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 950 2026-02-17T10:58:22.573 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 1000 2026-02-17T10:58:22.634 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 1050 2026-02-17T10:58:22.635 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 1100 2026-02-17T10:58:22.713 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 1150 2026-02-17T10:58:22.713 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 1200 2026-02-17T10:58:22.813 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 1250 2026-02-17T10:58:22.813 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 1300 2026-02-17T10:58:22.889 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 1350 2026-02-17T10:58:22.890 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 1400 2026-02-17T10:58:22.955 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 1450 2026-02-17T10:58:22.956 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 1500 2026-02-17T10:58:23.018 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 1550 2026-02-17T10:58:23.020 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 1600 2026-02-17T10:58:23.106 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 1650 2026-02-17T10:58:23.207 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 1700 2026-02-17T10:58:23.208 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 1750 2026-02-17T10:58:23.209 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 1800 2026-02-17T10:58:23.299 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 1850 2026-02-17T10:58:23.300 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 1900 2026-02-17T10:58:23.398 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 1950 2026-02-17T10:58:23.398 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 2000 2026-02-17T10:58:23.468 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 2050 2026-02-17T10:58:23.469 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 2100 2026-02-17T10:58:23.546 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 2150 2026-02-17T10:58:23.547 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 2200 2026-02-17T10:58:23.663 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 2250 2026-02-17T10:58:23.664 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 2300 2026-02-17T10:58:23.750 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 2350 2026-02-17T10:58:23.751 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 2400 2026-02-17T10:58:23.854 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 2450 2026-02-17T10:58:23.855 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 2500 2026-02-17T10:58:23.909 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 2550 2026-02-17T10:58:23.910 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 2600 2026-02-17T10:58:23.982 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 2650 2026-02-17T10:58:23.983 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 2700 2026-02-17T10:58:24.057 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 2750 2026-02-17T10:58:24.058 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 2800 2026-02-17T10:58:24.145 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 2850 2026-02-17T10:58:24.216 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 2900 2026-02-17T10:58:24.217 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 2950 2026-02-17T10:58:24.288 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 3000 2026-02-17T10:58:24.288 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 3050 2026-02-17T10:58:24.392 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 3100 2026-02-17T10:58:24.392 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 3150 2026-02-17T10:58:24.466 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 3200 2026-02-17T10:58:24.467 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 3250 2026-02-17T10:58:24.547 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 3300 2026-02-17T10:58:24.548 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 3350 2026-02-17T10:58:24.550 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 3400 2026-02-17T10:58:24.630 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 3450 2026-02-17T10:58:24.631 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 3500 2026-02-17T10:58:24.729 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 3550 2026-02-17T10:58:24.730 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 3600 2026-02-17T10:58:24.823 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 3650 2026-02-17T10:58:24.824 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 3700 2026-02-17T10:58:24.910 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 3750 2026-02-17T10:58:24.911 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 3800 2026-02-17T10:58:25.010 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 3850 2026-02-17T10:58:25.010 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 3900 2026-02-17T10:58:25.096 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 3950 2026-02-17T10:58:25.097 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 4000 2026-02-17T10:58:25.184 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 4050 2026-02-17T10:58:25.185 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 4100 2026-02-17T10:58:25.251 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 4150 2026-02-17T10:58:25.252 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 4200 2026-02-17T10:58:25.319 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 4250 2026-02-17T10:58:25.320 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 4300 2026-02-17T10:58:25.413 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 4350 2026-02-17T10:58:25.414 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 4400 2026-02-17T10:58:25.517 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 4450 2026-02-17T10:58:25.518 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 4500 2026-02-17T10:58:25.579 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 4550 2026-02-17T10:58:25.580 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 4600 2026-02-17T10:58:25.660 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 4650 2026-02-17T10:58:25.661 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 4700 2026-02-17T10:58:25.662 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 4750 2026-02-17T10:58:25.762 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 4800 2026-02-17T10:58:25.855 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 4850 2026-02-17T10:58:25.856 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 4900 2026-02-17T10:58:25.857 INFO:teuthology.orchestra.run.trial138.stdout:On iteration 4950 2026-02-17T10:58:26.101 INFO:teuthology.orchestra.run.trial138.stdout:[ OK ] MapCacherTest.Random (4220 ms) 2026-02-17T10:58:26.101 INFO:teuthology.orchestra.run.trial138.stdout:[----------] 2 tests from MapCacherTest (5220 ms total) 2026-02-17T10:58:26.101 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:58:26.101 INFO:teuthology.orchestra.run.trial138.stdout:[----------] 8 tests from SnapMapperTest 2026-02-17T10:58:26.101 INFO:teuthology.orchestra.run.trial138.stdout:[ RUN ] SnapMapperTest.prefix_itr 2026-02-17T10:58:26.101 INFO:teuthology.orchestra.run.trial138.stdout:osd_debug_trim_objects = 0 2026-02-17T10:58:26.101 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T10:58:26.100+0000 7f27285ce300 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 0 after trimming was started 2026-02-17T10:58:27.685 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T10:58:27.684+0000 7f27285ce300 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 0 after trimming was started 2026-02-17T10:58:28.426 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T10:58:28.425+0000 7f27285ce300 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 0 after trimming was started 2026-02-17T10:58:28.554 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T10:58:28.552+0000 7f27285ce300 -1 snap_mapper.get_next_objects_to_trim::New Clone-Objects were added to Snap 0 after trimming was started 2026-02-17T10:58:28.745 INFO:teuthology.orchestra.run.trial138.stdout:[ OK ] SnapMapperTest.prefix_itr (2644 ms) 2026-02-17T10:58:28.745 INFO:teuthology.orchestra.run.trial138.stdout:[ RUN ] SnapMapperTest.Simple 2026-02-17T10:58:28.755 INFO:teuthology.orchestra.run.trial138.stdout:[ OK ] SnapMapperTest.Simple (10 ms) 2026-02-17T10:58:28.755 INFO:teuthology.orchestra.run.trial138.stdout:[ RUN ] SnapMapperTest.More 2026-02-17T10:58:28.755 INFO:teuthology.orchestra.run.trial138.stdout:0 2026-02-17T10:58:28.755 INFO:teuthology.orchestra.run.trial138.stdout:50 2026-02-17T10:58:28.862 INFO:teuthology.orchestra.run.trial138.stdout:100 2026-02-17T10:58:28.950 INFO:teuthology.orchestra.run.trial138.stdout:150 2026-02-17T10:58:29.035 INFO:teuthology.orchestra.run.trial138.stdout:200 2026-02-17T10:58:29.141 INFO:teuthology.orchestra.run.trial138.stdout:250 2026-02-17T10:58:29.227 INFO:teuthology.orchestra.run.trial138.stdout:300 2026-02-17T10:58:29.309 INFO:teuthology.orchestra.run.trial138.stdout:350 2026-02-17T10:58:29.400 INFO:teuthology.orchestra.run.trial138.stdout:400 2026-02-17T10:58:29.472 INFO:teuthology.orchestra.run.trial138.stdout:450 2026-02-17T10:58:29.557 INFO:teuthology.orchestra.run.trial138.stdout:500 2026-02-17T10:58:29.667 INFO:teuthology.orchestra.run.trial138.stdout:550 2026-02-17T10:58:29.780 INFO:teuthology.orchestra.run.trial138.stdout:600 2026-02-17T10:58:29.855 INFO:teuthology.orchestra.run.trial138.stdout:650 2026-02-17T10:58:30.074 INFO:teuthology.orchestra.run.trial138.stdout:700 2026-02-17T10:58:30.191 INFO:teuthology.orchestra.run.trial138.stdout:750 2026-02-17T10:58:30.358 INFO:teuthology.orchestra.run.trial138.stdout:800 2026-02-17T10:58:30.434 INFO:teuthology.orchestra.run.trial138.stdout:850 2026-02-17T10:58:30.618 INFO:teuthology.orchestra.run.trial138.stdout:900 2026-02-17T10:58:30.683 INFO:teuthology.orchestra.run.trial138.stdout:950 2026-02-17T10:58:30.744 INFO:teuthology.orchestra.run.trial138.stdout:1000 2026-02-17T10:58:30.998 INFO:teuthology.orchestra.run.trial138.stdout:1050 2026-02-17T10:58:31.183 INFO:teuthology.orchestra.run.trial138.stdout:1100 2026-02-17T10:58:31.364 INFO:teuthology.orchestra.run.trial138.stdout:1150 2026-02-17T10:58:31.531 INFO:teuthology.orchestra.run.trial138.stdout:1200 2026-02-17T10:58:31.611 INFO:teuthology.orchestra.run.trial138.stdout:1250 2026-02-17T10:58:31.684 INFO:teuthology.orchestra.run.trial138.stdout:1300 2026-02-17T10:58:31.823 INFO:teuthology.orchestra.run.trial138.stdout:1350 2026-02-17T10:58:31.993 INFO:teuthology.orchestra.run.trial138.stdout:1400 2026-02-17T10:58:32.173 INFO:teuthology.orchestra.run.trial138.stdout:1450 2026-02-17T10:58:32.261 INFO:teuthology.orchestra.run.trial138.stdout:1500 2026-02-17T10:58:32.416 INFO:teuthology.orchestra.run.trial138.stdout:1550 2026-02-17T10:58:32.510 INFO:teuthology.orchestra.run.trial138.stdout:1600 2026-02-17T10:58:32.511 INFO:teuthology.orchestra.run.trial138.stdout:1650 2026-02-17T10:58:32.616 INFO:teuthology.orchestra.run.trial138.stdout:1700 2026-02-17T10:58:32.726 INFO:teuthology.orchestra.run.trial138.stdout:1750 2026-02-17T10:58:32.875 INFO:teuthology.orchestra.run.trial138.stdout:1800 2026-02-17T10:58:32.876 INFO:teuthology.orchestra.run.trial138.stdout:1850 2026-02-17T10:58:33.021 INFO:teuthology.orchestra.run.trial138.stdout:1900 2026-02-17T10:58:33.122 INFO:teuthology.orchestra.run.trial138.stdout:1950 2026-02-17T10:58:33.274 INFO:teuthology.orchestra.run.trial138.stdout:2000 2026-02-17T10:58:33.354 INFO:teuthology.orchestra.run.trial138.stdout:2050 2026-02-17T10:58:33.513 INFO:teuthology.orchestra.run.trial138.stdout:2100 2026-02-17T10:58:33.598 INFO:teuthology.orchestra.run.trial138.stdout:2150 2026-02-17T10:58:33.685 INFO:teuthology.orchestra.run.trial138.stdout:2200 2026-02-17T10:58:33.762 INFO:teuthology.orchestra.run.trial138.stdout:2250 2026-02-17T10:58:33.846 INFO:teuthology.orchestra.run.trial138.stdout:2300 2026-02-17T10:58:33.996 INFO:teuthology.orchestra.run.trial138.stdout:2350 2026-02-17T10:58:34.154 INFO:teuthology.orchestra.run.trial138.stdout:2400 2026-02-17T10:58:34.221 INFO:teuthology.orchestra.run.trial138.stdout:2450 2026-02-17T10:58:34.354 INFO:teuthology.orchestra.run.trial138.stdout:2500 2026-02-17T10:58:34.517 INFO:teuthology.orchestra.run.trial138.stdout:2550 2026-02-17T10:58:34.726 INFO:teuthology.orchestra.run.trial138.stdout:2600 2026-02-17T10:58:34.822 INFO:teuthology.orchestra.run.trial138.stdout:2650 2026-02-17T10:58:34.914 INFO:teuthology.orchestra.run.trial138.stdout:2700 2026-02-17T10:58:35.176 INFO:teuthology.orchestra.run.trial138.stdout:2750 2026-02-17T10:58:35.338 INFO:teuthology.orchestra.run.trial138.stdout:2800 2026-02-17T10:58:35.575 INFO:teuthology.orchestra.run.trial138.stdout:2850 2026-02-17T10:58:35.801 INFO:teuthology.orchestra.run.trial138.stdout:2900 2026-02-17T10:58:35.993 INFO:teuthology.orchestra.run.trial138.stdout:2950 2026-02-17T10:58:36.070 INFO:teuthology.orchestra.run.trial138.stdout:3000 2026-02-17T10:58:36.234 INFO:teuthology.orchestra.run.trial138.stdout:3050 2026-02-17T10:58:36.311 INFO:teuthology.orchestra.run.trial138.stdout:3100 2026-02-17T10:58:36.481 INFO:teuthology.orchestra.run.trial138.stdout:3150 2026-02-17T10:58:36.571 INFO:teuthology.orchestra.run.trial138.stdout:3200 2026-02-17T10:58:36.674 INFO:teuthology.orchestra.run.trial138.stdout:3250 2026-02-17T10:58:36.757 INFO:teuthology.orchestra.run.trial138.stdout:3300 2026-02-17T10:58:36.831 INFO:teuthology.orchestra.run.trial138.stdout:3350 2026-02-17T10:58:36.905 INFO:teuthology.orchestra.run.trial138.stdout:3400 2026-02-17T10:58:36.905 INFO:teuthology.orchestra.run.trial138.stdout:3450 2026-02-17T10:58:37.082 INFO:teuthology.orchestra.run.trial138.stdout:3500 2026-02-17T10:58:37.230 INFO:teuthology.orchestra.run.trial138.stdout:3550 2026-02-17T10:58:37.335 INFO:teuthology.orchestra.run.trial138.stdout:3600 2026-02-17T10:58:37.497 INFO:teuthology.orchestra.run.trial138.stdout:3650 2026-02-17T10:58:37.591 INFO:teuthology.orchestra.run.trial138.stdout:3700 2026-02-17T10:58:37.783 INFO:teuthology.orchestra.run.trial138.stdout:3750 2026-02-17T10:58:37.858 INFO:teuthology.orchestra.run.trial138.stdout:3800 2026-02-17T10:58:37.940 INFO:teuthology.orchestra.run.trial138.stdout:3850 2026-02-17T10:58:38.139 INFO:teuthology.orchestra.run.trial138.stdout:3900 2026-02-17T10:58:38.225 INFO:teuthology.orchestra.run.trial138.stdout:3950 2026-02-17T10:58:38.300 INFO:teuthology.orchestra.run.trial138.stdout:4000 2026-02-17T10:58:38.401 INFO:teuthology.orchestra.run.trial138.stdout:4050 2026-02-17T10:58:38.500 INFO:teuthology.orchestra.run.trial138.stdout:4100 2026-02-17T10:58:38.501 INFO:teuthology.orchestra.run.trial138.stdout:4150 2026-02-17T10:58:38.605 INFO:teuthology.orchestra.run.trial138.stdout:4200 2026-02-17T10:58:38.605 INFO:teuthology.orchestra.run.trial138.stdout:4250 2026-02-17T10:58:38.680 INFO:teuthology.orchestra.run.trial138.stdout:4300 2026-02-17T10:58:38.790 INFO:teuthology.orchestra.run.trial138.stdout:4350 2026-02-17T10:58:38.950 INFO:teuthology.orchestra.run.trial138.stdout:4400 2026-02-17T10:58:39.155 INFO:teuthology.orchestra.run.trial138.stdout:4450 2026-02-17T10:58:39.318 INFO:teuthology.orchestra.run.trial138.stdout:4500 2026-02-17T10:58:39.488 INFO:teuthology.orchestra.run.trial138.stdout:4550 2026-02-17T10:58:39.635 INFO:teuthology.orchestra.run.trial138.stdout:4600 2026-02-17T10:58:39.748 INFO:teuthology.orchestra.run.trial138.stdout:4650 2026-02-17T10:58:39.925 INFO:teuthology.orchestra.run.trial138.stdout:4700 2026-02-17T10:58:40.111 INFO:teuthology.orchestra.run.trial138.stdout:4750 2026-02-17T10:58:40.212 INFO:teuthology.orchestra.run.trial138.stdout:4800 2026-02-17T10:58:40.285 INFO:teuthology.orchestra.run.trial138.stdout:4850 2026-02-17T10:58:40.285 INFO:teuthology.orchestra.run.trial138.stdout:4900 2026-02-17T10:58:40.392 INFO:teuthology.orchestra.run.trial138.stdout:4950 2026-02-17T10:58:40.566 INFO:teuthology.orchestra.run.trial138.stdout:[ OK ] SnapMapperTest.More (11810 ms) 2026-02-17T10:58:40.566 INFO:teuthology.orchestra.run.trial138.stdout:[ RUN ] SnapMapperTest.MultiPG 2026-02-17T10:58:40.566 INFO:teuthology.orchestra.run.trial138.stdout:0 2026-02-17T10:58:40.567 INFO:teuthology.orchestra.run.trial138.stdout:50 2026-02-17T10:58:40.567 INFO:teuthology.orchestra.run.trial138.stdout:100 2026-02-17T10:58:40.567 INFO:teuthology.orchestra.run.trial138.stdout:150 2026-02-17T10:58:40.567 INFO:teuthology.orchestra.run.trial138.stdout:200 2026-02-17T10:58:40.567 INFO:teuthology.orchestra.run.trial138.stdout:250 2026-02-17T10:58:40.568 INFO:teuthology.orchestra.run.trial138.stdout:300 2026-02-17T10:58:40.568 INFO:teuthology.orchestra.run.trial138.stdout:350 2026-02-17T10:58:40.657 INFO:teuthology.orchestra.run.trial138.stdout:400 2026-02-17T10:58:40.658 INFO:teuthology.orchestra.run.trial138.stdout:450 2026-02-17T10:58:40.761 INFO:teuthology.orchestra.run.trial138.stdout:500 2026-02-17T10:58:40.761 INFO:teuthology.orchestra.run.trial138.stdout:550 2026-02-17T10:58:40.845 INFO:teuthology.orchestra.run.trial138.stdout:600 2026-02-17T10:58:40.846 INFO:teuthology.orchestra.run.trial138.stdout:650 2026-02-17T10:58:40.919 INFO:teuthology.orchestra.run.trial138.stdout:700 2026-02-17T10:58:40.920 INFO:teuthology.orchestra.run.trial138.stdout:750 2026-02-17T10:58:41.023 INFO:teuthology.orchestra.run.trial138.stdout:800 2026-02-17T10:58:41.023 INFO:teuthology.orchestra.run.trial138.stdout:850 2026-02-17T10:58:41.096 INFO:teuthology.orchestra.run.trial138.stdout:900 2026-02-17T10:58:41.096 INFO:teuthology.orchestra.run.trial138.stdout:950 2026-02-17T10:58:41.184 INFO:teuthology.orchestra.run.trial138.stdout:1000 2026-02-17T10:58:41.184 INFO:teuthology.orchestra.run.trial138.stdout:1050 2026-02-17T10:58:41.254 INFO:teuthology.orchestra.run.trial138.stdout:1100 2026-02-17T10:58:41.315 INFO:teuthology.orchestra.run.trial138.stdout:1150 2026-02-17T10:58:41.315 INFO:teuthology.orchestra.run.trial138.stdout:1200 2026-02-17T10:58:41.408 INFO:teuthology.orchestra.run.trial138.stdout:1250 2026-02-17T10:58:41.408 INFO:teuthology.orchestra.run.trial138.stdout:1300 2026-02-17T10:58:41.475 INFO:teuthology.orchestra.run.trial138.stdout:1350 2026-02-17T10:58:41.567 INFO:teuthology.orchestra.run.trial138.stdout:1400 2026-02-17T10:58:41.643 INFO:teuthology.orchestra.run.trial138.stdout:1450 2026-02-17T10:58:41.644 INFO:teuthology.orchestra.run.trial138.stdout:1500 2026-02-17T10:58:41.710 INFO:teuthology.orchestra.run.trial138.stdout:1550 2026-02-17T10:58:41.778 INFO:teuthology.orchestra.run.trial138.stdout:1600 2026-02-17T10:58:41.778 INFO:teuthology.orchestra.run.trial138.stdout:1650 2026-02-17T10:58:41.864 INFO:teuthology.orchestra.run.trial138.stdout:1700 2026-02-17T10:58:41.946 INFO:teuthology.orchestra.run.trial138.stdout:1750 2026-02-17T10:58:42.048 INFO:teuthology.orchestra.run.trial138.stdout:1800 2026-02-17T10:58:42.136 INFO:teuthology.orchestra.run.trial138.stdout:1850 2026-02-17T10:58:42.203 INFO:teuthology.orchestra.run.trial138.stdout:1900 2026-02-17T10:58:42.203 INFO:teuthology.orchestra.run.trial138.stdout:1950 2026-02-17T10:58:42.265 INFO:teuthology.orchestra.run.trial138.stdout:2000 2026-02-17T10:58:42.356 INFO:teuthology.orchestra.run.trial138.stdout:2050 2026-02-17T10:58:42.357 INFO:teuthology.orchestra.run.trial138.stdout:2100 2026-02-17T10:58:42.429 INFO:teuthology.orchestra.run.trial138.stdout:2150 2026-02-17T10:58:42.506 INFO:teuthology.orchestra.run.trial138.stdout:2200 2026-02-17T10:58:42.573 INFO:teuthology.orchestra.run.trial138.stdout:2250 2026-02-17T10:58:42.657 INFO:teuthology.orchestra.run.trial138.stdout:2300 2026-02-17T10:58:42.657 INFO:teuthology.orchestra.run.trial138.stdout:2350 2026-02-17T10:58:42.755 INFO:teuthology.orchestra.run.trial138.stdout:2400 2026-02-17T10:58:42.817 INFO:teuthology.orchestra.run.trial138.stdout:2450 2026-02-17T10:58:42.901 INFO:teuthology.orchestra.run.trial138.stdout:2500 2026-02-17T10:58:43.007 INFO:teuthology.orchestra.run.trial138.stdout:2550 2026-02-17T10:58:43.074 INFO:teuthology.orchestra.run.trial138.stdout:2600 2026-02-17T10:58:43.174 INFO:teuthology.orchestra.run.trial138.stdout:2650 2026-02-17T10:58:43.249 INFO:teuthology.orchestra.run.trial138.stdout:2700 2026-02-17T10:58:43.319 INFO:teuthology.orchestra.run.trial138.stdout:2750 2026-02-17T10:58:43.403 INFO:teuthology.orchestra.run.trial138.stdout:2800 2026-02-17T10:58:43.495 INFO:teuthology.orchestra.run.trial138.stdout:2850 2026-02-17T10:58:43.580 INFO:teuthology.orchestra.run.trial138.stdout:2900 2026-02-17T10:58:43.653 INFO:teuthology.orchestra.run.trial138.stdout:2950 2026-02-17T10:58:43.757 INFO:teuthology.orchestra.run.trial138.stdout:3000 2026-02-17T10:58:43.831 INFO:teuthology.orchestra.run.trial138.stdout:3050 2026-02-17T10:58:43.924 INFO:teuthology.orchestra.run.trial138.stdout:3100 2026-02-17T10:58:44.024 INFO:teuthology.orchestra.run.trial138.stdout:3150 2026-02-17T10:58:44.116 INFO:teuthology.orchestra.run.trial138.stdout:3200 2026-02-17T10:58:44.187 INFO:teuthology.orchestra.run.trial138.stdout:3250 2026-02-17T10:58:44.276 INFO:teuthology.orchestra.run.trial138.stdout:3300 2026-02-17T10:58:44.340 INFO:teuthology.orchestra.run.trial138.stdout:3350 2026-02-17T10:58:44.434 INFO:teuthology.orchestra.run.trial138.stdout:3400 2026-02-17T10:58:44.524 INFO:teuthology.orchestra.run.trial138.stdout:3450 2026-02-17T10:58:44.609 INFO:teuthology.orchestra.run.trial138.stdout:3500 2026-02-17T10:58:44.738 INFO:teuthology.orchestra.run.trial138.stdout:3550 2026-02-17T10:58:44.834 INFO:teuthology.orchestra.run.trial138.stdout:3600 2026-02-17T10:58:44.907 INFO:teuthology.orchestra.run.trial138.stdout:3650 2026-02-17T10:58:45.017 INFO:teuthology.orchestra.run.trial138.stdout:3700 2026-02-17T10:58:45.111 INFO:teuthology.orchestra.run.trial138.stdout:3750 2026-02-17T10:58:45.111 INFO:teuthology.orchestra.run.trial138.stdout:3800 2026-02-17T10:58:45.179 INFO:teuthology.orchestra.run.trial138.stdout:3850 2026-02-17T10:58:45.263 INFO:teuthology.orchestra.run.trial138.stdout:3900 2026-02-17T10:58:45.351 INFO:teuthology.orchestra.run.trial138.stdout:3950 2026-02-17T10:58:45.447 INFO:teuthology.orchestra.run.trial138.stdout:4000 2026-02-17T10:58:45.607 INFO:teuthology.orchestra.run.trial138.stdout:4050 2026-02-17T10:58:45.683 INFO:teuthology.orchestra.run.trial138.stdout:4100 2026-02-17T10:58:45.857 INFO:teuthology.orchestra.run.trial138.stdout:4150 2026-02-17T10:58:45.945 INFO:teuthology.orchestra.run.trial138.stdout:4200 2026-02-17T10:58:46.053 INFO:teuthology.orchestra.run.trial138.stdout:4250 2026-02-17T10:58:46.153 INFO:teuthology.orchestra.run.trial138.stdout:4300 2026-02-17T10:58:46.241 INFO:teuthology.orchestra.run.trial138.stdout:4350 2026-02-17T10:58:46.313 INFO:teuthology.orchestra.run.trial138.stdout:4400 2026-02-17T10:58:46.385 INFO:teuthology.orchestra.run.trial138.stdout:4450 2026-02-17T10:58:46.385 INFO:teuthology.orchestra.run.trial138.stdout:4500 2026-02-17T10:58:46.507 INFO:teuthology.orchestra.run.trial138.stdout:4550 2026-02-17T10:58:46.703 INFO:teuthology.orchestra.run.trial138.stdout:4600 2026-02-17T10:58:46.813 INFO:teuthology.orchestra.run.trial138.stdout:4650 2026-02-17T10:58:46.903 INFO:teuthology.orchestra.run.trial138.stdout:4700 2026-02-17T10:58:46.998 INFO:teuthology.orchestra.run.trial138.stdout:4750 2026-02-17T10:58:47.078 INFO:teuthology.orchestra.run.trial138.stdout:4800 2026-02-17T10:58:47.172 INFO:teuthology.orchestra.run.trial138.stdout:4850 2026-02-17T10:58:47.296 INFO:teuthology.orchestra.run.trial138.stdout:4900 2026-02-17T10:58:47.356 INFO:teuthology.orchestra.run.trial138.stdout:4950 2026-02-17T10:58:47.619 INFO:teuthology.orchestra.run.trial138.stdout:[ OK ] SnapMapperTest.MultiPG (7054 ms) 2026-02-17T10:58:47.620 INFO:teuthology.orchestra.run.trial138.stdout:[ RUN ] SnapMapperTest.CheckObjectKeyFormat 2026-02-17T10:58:47.620 INFO:teuthology.orchestra.run.trial138.stdout:[ OK ] SnapMapperTest.CheckObjectKeyFormat (0 ms) 2026-02-17T10:58:47.620 INFO:teuthology.orchestra.run.trial138.stdout:[ RUN ] SnapMapperTest.CheckRawKeyFormat 2026-02-17T10:58:47.620 INFO:teuthology.orchestra.run.trial138.stdout:[ OK ] SnapMapperTest.CheckRawKeyFormat (0 ms) 2026-02-17T10:58:47.620 INFO:teuthology.orchestra.run.trial138.stdout:[ RUN ] SnapMapperTest.CheckMakePurgedSnapKeyFormat 2026-02-17T10:58:47.620 INFO:teuthology.orchestra.run.trial138.stdout:[ OK ] SnapMapperTest.CheckMakePurgedSnapKeyFormat (0 ms) 2026-02-17T10:58:47.620 INFO:teuthology.orchestra.run.trial138.stdout:[ RUN ] SnapMapperTest.LegacyKeyConvertion 2026-02-17T10:58:47.620 INFO:teuthology.orchestra.run.trial138.stdout:[ OK ] SnapMapperTest.LegacyKeyConvertion (0 ms) 2026-02-17T10:58:47.620 INFO:teuthology.orchestra.run.trial138.stdout:[----------] 8 tests from SnapMapperTest (21518 ms total) 2026-02-17T10:58:47.620 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:58:47.620 INFO:teuthology.orchestra.run.trial138.stdout:[----------] 2 tests from DirectMapperTest 2026-02-17T10:58:47.621 INFO:teuthology.orchestra.run.trial138.stdout:[ RUN ] DirectMapperTest.BasciObject 2026-02-17T10:58:47.623 INFO:teuthology.orchestra.run.trial138.stdout:[ OK ] DirectMapperTest.BasciObject (5 ms) 2026-02-17T10:58:47.624 INFO:teuthology.orchestra.run.trial138.stdout:[ RUN ] DirectMapperTest.CorruptedSnaRecord 2026-02-17T10:58:47.641 INFO:teuthology.orchestra.run.trial138.stdout:[ OK ] DirectMapperTest.CorruptedSnaRecord (17 ms) 2026-02-17T10:58:47.641 INFO:teuthology.orchestra.run.trial138.stdout:[----------] 2 tests from DirectMapperTest (22 ms total) 2026-02-17T10:58:47.641 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:58:47.641 INFO:teuthology.orchestra.run.trial138.stdout:[----------] Global test environment tear-down 2026-02-17T10:58:47.641 INFO:teuthology.orchestra.run.trial138.stdout:[==========] 12 tests from 3 test suites ran. (26760 ms total) 2026-02-17T10:58:47.641 INFO:teuthology.orchestra.run.trial138.stdout:[ PASSED ] 12 tests. 2026-02-17T10:58:47.644 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-17T10:58:47.654 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-17T10:58:47.654 DEBUG:teuthology.orchestra.run.trial138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T10:58:47.844 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:58:47.845 INFO:teuthology.orchestra.run.trial138.stderr:dumped all 2026-02-17T10:58:47.853 INFO:teuthology.orchestra.run.trial138.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2026-02-17T10:58:47.043531+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":81264,"kb_used_data":368,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":314491536,"statfs":{"total":322122547200,"available":322039332864,"internally_reserved":0,"allocated":376832,"data_stored":98834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4781,"internal_metadata":82767187},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.000734"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":23,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T10:58:23.842291+0000","last_change":"2026-02-17T10:58:17.066596+0000","last_active":"2026-02-17T10:58:23.842291+0000","last_peered":"2026-02-17T10:58:23.842291+0000","last_clean":"2026-02-17T10:58:23.842291+0000","last_became_active":"2026-02-17T10:58:15.063792+0000","last_became_peered":"2026-02-17T10:58:15.063792+0000","last_unstale":"2026-02-17T10:58:23.842291+0000","last_undegraded":"2026-02-17T10:58:23.842291+0000","last_fullsized":"2026-02-17T10:58:23.842291+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:36:47.905105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036630700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":23,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T10:58:23.842251+0000","last_change":"2026-02-17T10:58:17.066497+0000","last_active":"2026-02-17T10:58:23.842251+0000","last_peered":"2026-02-17T10:58:23.842251+0000","last_clean":"2026-02-17T10:58:23.842251+0000","last_became_active":"2026-02-17T10:58:15.064292+0000","last_became_peered":"2026-02-17T10:58:15.064292+0000","last_unstale":"2026-02-17T10:58:23.842251+0000","last_undegraded":"2026-02-17T10:58:23.842251+0000","last_fullsized":"2026-02-17T10:58:23.842251+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:05:54.317111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029424399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":23,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T10:58:24.646078+0000","last_change":"2026-02-17T10:58:17.064493+0000","last_active":"2026-02-17T10:58:24.646078+0000","last_peered":"2026-02-17T10:58:24.646078+0000","last_clean":"2026-02-17T10:58:24.646078+0000","last_became_active":"2026-02-17T10:58:15.063970+0000","last_became_peered":"2026-02-17T10:58:15.063970+0000","last_unstale":"2026-02-17T10:58:24.646078+0000","last_undegraded":"2026-02-17T10:58:24.646078+0000","last_fullsized":"2026-02-17T10:58:24.646078+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:58:30.074704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000175174,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":23,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T10:58:23.842281+0000","last_change":"2026-02-17T10:58:17.066401+0000","last_active":"2026-02-17T10:58:23.842281+0000","last_peered":"2026-02-17T10:58:23.842281+0000","last_clean":"2026-02-17T10:58:23.842281+0000","last_became_active":"2026-02-17T10:58:15.064024+0000","last_became_peered":"2026-02-17T10:58:15.064024+0000","last_unstale":"2026-02-17T10:58:23.842281+0000","last_undegraded":"2026-02-17T10:58:23.842281+0000","last_fullsized":"2026-02-17T10:58:23.842281+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:24:50.691188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000197605,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"10'1","reported_seq":24,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T10:58:23.842304+0000","last_change":"2026-02-17T10:58:17.066533+0000","last_active":"2026-02-17T10:58:23.842304+0000","last_peered":"2026-02-17T10:58:23.842304+0000","last_clean":"2026-02-17T10:58:23.842304+0000","last_became_active":"2026-02-17T10:58:15.063770+0000","last_became_peered":"2026-02-17T10:58:15.063770+0000","last_unstale":"2026-02-17T10:58:23.842304+0000","last_undegraded":"2026-02-17T10:58:23.842304+0000","last_fullsized":"2026-02-17T10:58:23.842304+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:24:21.343084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033193300000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"12'2","reported_seq":25,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T10:58:24.519573+0000","last_change":"2026-02-17T10:58:17.065530+0000","last_active":"2026-02-17T10:58:24.519573+0000","last_peered":"2026-02-17T10:58:24.519573+0000","last_clean":"2026-02-17T10:58:24.519573+0000","last_became_active":"2026-02-17T10:58:15.063551+0000","last_became_peered":"2026-02-17T10:58:15.063551+0000","last_unstale":"2026-02-17T10:58:24.519573+0000","last_undegraded":"2026-02-17T10:58:24.519573+0000","last_fullsized":"2026-02-17T10:58:24.519573+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:46:08.530261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034513799999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":23,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T10:58:24.646035+0000","last_change":"2026-02-17T10:58:17.064478+0000","last_active":"2026-02-17T10:58:24.646035+0000","last_peered":"2026-02-17T10:58:24.646035+0000","last_clean":"2026-02-17T10:58:24.646035+0000","last_became_active":"2026-02-17T10:58:15.063794+0000","last_became_peered":"2026-02-17T10:58:15.063794+0000","last_unstale":"2026-02-17T10:58:24.646035+0000","last_undegraded":"2026-02-17T10:58:24.646035+0000","last_fullsized":"2026-02-17T10:58:24.646035+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:28:04.777048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00018169599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":23,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T10:58:23.842193+0000","last_change":"2026-02-17T10:58:17.066401+0000","last_active":"2026-02-17T10:58:23.842193+0000","last_peered":"2026-02-17T10:58:23.842193+0000","last_clean":"2026-02-17T10:58:23.842193+0000","last_became_active":"2026-02-17T10:58:15.064000+0000","last_became_peered":"2026-02-17T10:58:15.064000+0000","last_unstale":"2026-02-17T10:58:23.842193+0000","last_undegraded":"2026-02-17T10:58:23.842193+0000","last_fullsized":"2026-02-17T10:58:23.842193+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:40:19.034197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000226419,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738378,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27088,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830512,"statfs":{"total":107374182400,"available":107346444288,"internally_reserved":0,"allocated":122880,"data_stored":32932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738379,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27088,"kb_used_data":124,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830512,"statfs":{"total":107374182400,"available":107346444288,"internally_reserved":0,"allocated":126976,"data_stored":32951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738378,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27088,"kb_used_data":124,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830512,"statfs":{"total":107374182400,"available":107346444288,"internally_reserved":0,"allocated":126976,"data_stored":32951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T10:58:47.854 DEBUG:teuthology.orchestra.run.trial138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T10:58:48.012 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:58:48.012 INFO:teuthology.orchestra.run.trial138.stderr:dumped all 2026-02-17T10:58:48.020 INFO:teuthology.orchestra.run.trial138.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2026-02-17T10:58:47.043531+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":81264,"kb_used_data":368,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":314491536,"statfs":{"total":322122547200,"available":322039332864,"internally_reserved":0,"allocated":376832,"data_stored":98834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4781,"internal_metadata":82767187},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.000734"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":23,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T10:58:23.842291+0000","last_change":"2026-02-17T10:58:17.066596+0000","last_active":"2026-02-17T10:58:23.842291+0000","last_peered":"2026-02-17T10:58:23.842291+0000","last_clean":"2026-02-17T10:58:23.842291+0000","last_became_active":"2026-02-17T10:58:15.063792+0000","last_became_peered":"2026-02-17T10:58:15.063792+0000","last_unstale":"2026-02-17T10:58:23.842291+0000","last_undegraded":"2026-02-17T10:58:23.842291+0000","last_fullsized":"2026-02-17T10:58:23.842291+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:36:47.905105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036630700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":23,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T10:58:23.842251+0000","last_change":"2026-02-17T10:58:17.066497+0000","last_active":"2026-02-17T10:58:23.842251+0000","last_peered":"2026-02-17T10:58:23.842251+0000","last_clean":"2026-02-17T10:58:23.842251+0000","last_became_active":"2026-02-17T10:58:15.064292+0000","last_became_peered":"2026-02-17T10:58:15.064292+0000","last_unstale":"2026-02-17T10:58:23.842251+0000","last_undegraded":"2026-02-17T10:58:23.842251+0000","last_fullsized":"2026-02-17T10:58:23.842251+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:05:54.317111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029424399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":23,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T10:58:24.646078+0000","last_change":"2026-02-17T10:58:17.064493+0000","last_active":"2026-02-17T10:58:24.646078+0000","last_peered":"2026-02-17T10:58:24.646078+0000","last_clean":"2026-02-17T10:58:24.646078+0000","last_became_active":"2026-02-17T10:58:15.063970+0000","last_became_peered":"2026-02-17T10:58:15.063970+0000","last_unstale":"2026-02-17T10:58:24.646078+0000","last_undegraded":"2026-02-17T10:58:24.646078+0000","last_fullsized":"2026-02-17T10:58:24.646078+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:58:30.074704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000175174,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":23,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T10:58:23.842281+0000","last_change":"2026-02-17T10:58:17.066401+0000","last_active":"2026-02-17T10:58:23.842281+0000","last_peered":"2026-02-17T10:58:23.842281+0000","last_clean":"2026-02-17T10:58:23.842281+0000","last_became_active":"2026-02-17T10:58:15.064024+0000","last_became_peered":"2026-02-17T10:58:15.064024+0000","last_unstale":"2026-02-17T10:58:23.842281+0000","last_undegraded":"2026-02-17T10:58:23.842281+0000","last_fullsized":"2026-02-17T10:58:23.842281+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:24:50.691188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000197605,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"10'1","reported_seq":24,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T10:58:23.842304+0000","last_change":"2026-02-17T10:58:17.066533+0000","last_active":"2026-02-17T10:58:23.842304+0000","last_peered":"2026-02-17T10:58:23.842304+0000","last_clean":"2026-02-17T10:58:23.842304+0000","last_became_active":"2026-02-17T10:58:15.063770+0000","last_became_peered":"2026-02-17T10:58:15.063770+0000","last_unstale":"2026-02-17T10:58:23.842304+0000","last_undegraded":"2026-02-17T10:58:23.842304+0000","last_fullsized":"2026-02-17T10:58:23.842304+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:24:21.343084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033193300000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"12'2","reported_seq":25,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T10:58:24.519573+0000","last_change":"2026-02-17T10:58:17.065530+0000","last_active":"2026-02-17T10:58:24.519573+0000","last_peered":"2026-02-17T10:58:24.519573+0000","last_clean":"2026-02-17T10:58:24.519573+0000","last_became_active":"2026-02-17T10:58:15.063551+0000","last_became_peered":"2026-02-17T10:58:15.063551+0000","last_unstale":"2026-02-17T10:58:24.519573+0000","last_undegraded":"2026-02-17T10:58:24.519573+0000","last_fullsized":"2026-02-17T10:58:24.519573+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:46:08.530261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034513799999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":23,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T10:58:24.646035+0000","last_change":"2026-02-17T10:58:17.064478+0000","last_active":"2026-02-17T10:58:24.646035+0000","last_peered":"2026-02-17T10:58:24.646035+0000","last_clean":"2026-02-17T10:58:24.646035+0000","last_became_active":"2026-02-17T10:58:15.063794+0000","last_became_peered":"2026-02-17T10:58:15.063794+0000","last_unstale":"2026-02-17T10:58:24.646035+0000","last_undegraded":"2026-02-17T10:58:24.646035+0000","last_fullsized":"2026-02-17T10:58:24.646035+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:28:04.777048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00018169599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":23,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T10:58:23.842193+0000","last_change":"2026-02-17T10:58:17.066401+0000","last_active":"2026-02-17T10:58:23.842193+0000","last_peered":"2026-02-17T10:58:23.842193+0000","last_clean":"2026-02-17T10:58:23.842193+0000","last_became_active":"2026-02-17T10:58:15.064000+0000","last_became_peered":"2026-02-17T10:58:15.064000+0000","last_unstale":"2026-02-17T10:58:23.842193+0000","last_undegraded":"2026-02-17T10:58:23.842193+0000","last_fullsized":"2026-02-17T10:58:23.842193+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:40:19.034197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000226419,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738378,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27088,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830512,"statfs":{"total":107374182400,"available":107346444288,"internally_reserved":0,"allocated":122880,"data_stored":32932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738379,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27088,"kb_used_data":124,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830512,"statfs":{"total":107374182400,"available":107346444288,"internally_reserved":0,"allocated":126976,"data_stored":32951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738378,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27088,"kb_used_data":124,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830512,"statfs":{"total":107374182400,"available":107346444288,"internally_reserved":0,"allocated":126976,"data_stored":32951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T10:58:48.021 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-17T10:58:48.021 DEBUG:teuthology.orchestra.run.trial138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T10:58:48.177 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:58:48.177 INFO:teuthology.orchestra.run.trial138.stderr:dumped all 2026-02-17T10:58:48.185 INFO:teuthology.orchestra.run.trial138.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2026-02-17T10:58:47.043531+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":81264,"kb_used_data":368,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":314491536,"statfs":{"total":322122547200,"available":322039332864,"internally_reserved":0,"allocated":376832,"data_stored":98834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4781,"internal_metadata":82767187},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.000734"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":23,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T10:58:23.842291+0000","last_change":"2026-02-17T10:58:17.066596+0000","last_active":"2026-02-17T10:58:23.842291+0000","last_peered":"2026-02-17T10:58:23.842291+0000","last_clean":"2026-02-17T10:58:23.842291+0000","last_became_active":"2026-02-17T10:58:15.063792+0000","last_became_peered":"2026-02-17T10:58:15.063792+0000","last_unstale":"2026-02-17T10:58:23.842291+0000","last_undegraded":"2026-02-17T10:58:23.842291+0000","last_fullsized":"2026-02-17T10:58:23.842291+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:36:47.905105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036630700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":23,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T10:58:23.842251+0000","last_change":"2026-02-17T10:58:17.066497+0000","last_active":"2026-02-17T10:58:23.842251+0000","last_peered":"2026-02-17T10:58:23.842251+0000","last_clean":"2026-02-17T10:58:23.842251+0000","last_became_active":"2026-02-17T10:58:15.064292+0000","last_became_peered":"2026-02-17T10:58:15.064292+0000","last_unstale":"2026-02-17T10:58:23.842251+0000","last_undegraded":"2026-02-17T10:58:23.842251+0000","last_fullsized":"2026-02-17T10:58:23.842251+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:05:54.317111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029424399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":23,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T10:58:24.646078+0000","last_change":"2026-02-17T10:58:17.064493+0000","last_active":"2026-02-17T10:58:24.646078+0000","last_peered":"2026-02-17T10:58:24.646078+0000","last_clean":"2026-02-17T10:58:24.646078+0000","last_became_active":"2026-02-17T10:58:15.063970+0000","last_became_peered":"2026-02-17T10:58:15.063970+0000","last_unstale":"2026-02-17T10:58:24.646078+0000","last_undegraded":"2026-02-17T10:58:24.646078+0000","last_fullsized":"2026-02-17T10:58:24.646078+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:58:30.074704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000175174,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":23,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T10:58:23.842281+0000","last_change":"2026-02-17T10:58:17.066401+0000","last_active":"2026-02-17T10:58:23.842281+0000","last_peered":"2026-02-17T10:58:23.842281+0000","last_clean":"2026-02-17T10:58:23.842281+0000","last_became_active":"2026-02-17T10:58:15.064024+0000","last_became_peered":"2026-02-17T10:58:15.064024+0000","last_unstale":"2026-02-17T10:58:23.842281+0000","last_undegraded":"2026-02-17T10:58:23.842281+0000","last_fullsized":"2026-02-17T10:58:23.842281+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:24:50.691188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000197605,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"10'1","reported_seq":24,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T10:58:23.842304+0000","last_change":"2026-02-17T10:58:17.066533+0000","last_active":"2026-02-17T10:58:23.842304+0000","last_peered":"2026-02-17T10:58:23.842304+0000","last_clean":"2026-02-17T10:58:23.842304+0000","last_became_active":"2026-02-17T10:58:15.063770+0000","last_became_peered":"2026-02-17T10:58:15.063770+0000","last_unstale":"2026-02-17T10:58:23.842304+0000","last_undegraded":"2026-02-17T10:58:23.842304+0000","last_fullsized":"2026-02-17T10:58:23.842304+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:24:21.343084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033193300000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"12'2","reported_seq":25,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T10:58:24.519573+0000","last_change":"2026-02-17T10:58:17.065530+0000","last_active":"2026-02-17T10:58:24.519573+0000","last_peered":"2026-02-17T10:58:24.519573+0000","last_clean":"2026-02-17T10:58:24.519573+0000","last_became_active":"2026-02-17T10:58:15.063551+0000","last_became_peered":"2026-02-17T10:58:15.063551+0000","last_unstale":"2026-02-17T10:58:24.519573+0000","last_undegraded":"2026-02-17T10:58:24.519573+0000","last_fullsized":"2026-02-17T10:58:24.519573+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:46:08.530261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034513799999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":23,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T10:58:24.646035+0000","last_change":"2026-02-17T10:58:17.064478+0000","last_active":"2026-02-17T10:58:24.646035+0000","last_peered":"2026-02-17T10:58:24.646035+0000","last_clean":"2026-02-17T10:58:24.646035+0000","last_became_active":"2026-02-17T10:58:15.063794+0000","last_became_peered":"2026-02-17T10:58:15.063794+0000","last_unstale":"2026-02-17T10:58:24.646035+0000","last_undegraded":"2026-02-17T10:58:24.646035+0000","last_fullsized":"2026-02-17T10:58:24.646035+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:28:04.777048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00018169599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":23,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T10:58:23.842193+0000","last_change":"2026-02-17T10:58:17.066401+0000","last_active":"2026-02-17T10:58:23.842193+0000","last_peered":"2026-02-17T10:58:23.842193+0000","last_clean":"2026-02-17T10:58:23.842193+0000","last_became_active":"2026-02-17T10:58:15.064000+0000","last_became_peered":"2026-02-17T10:58:15.064000+0000","last_unstale":"2026-02-17T10:58:23.842193+0000","last_undegraded":"2026-02-17T10:58:23.842193+0000","last_fullsized":"2026-02-17T10:58:23.842193+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:40:19.034197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000226419,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738378,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27088,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830512,"statfs":{"total":107374182400,"available":107346444288,"internally_reserved":0,"allocated":122880,"data_stored":32932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738379,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27088,"kb_used_data":124,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830512,"statfs":{"total":107374182400,"available":107346444288,"internally_reserved":0,"allocated":126976,"data_stored":32951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738378,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27088,"kb_used_data":124,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830512,"statfs":{"total":107374182400,"available":107346444288,"internally_reserved":0,"allocated":126976,"data_stored":32951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T10:58:48.187 DEBUG:teuthology.orchestra.run.trial138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T10:58:48.348 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:58:48.348 INFO:teuthology.orchestra.run.trial138.stdout:{"epoch":14,"fsid":"b27dff50-edc3-4714-9f29-33172002e940","created":"2026-02-17T10:57:58.842998+0000","modified":"2026-02-17T10:58:23.840818+0000","last_up_change":"2026-02-17T10:58:07.046197+0000","last_in_change":"2026-02-17T10:57:59.521336+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-17T10:58:13.169256+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":12,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"269f882f-b38e-48df-bb86-c57d977c8b9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6810","nonce":1335950096},{"type":"v1","addr":"10.20.193.138:6811","nonce":1335950096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6812","nonce":1335950096},{"type":"v1","addr":"10.20.193.138:6813","nonce":1335950096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6816","nonce":1335950096},{"type":"v1","addr":"10.20.193.138:6817","nonce":1335950096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6814","nonce":1335950096},{"type":"v1","addr":"10.20.193.138:6815","nonce":1335950096}]},"public_addr":"10.20.193.138:6811/1335950096","cluster_addr":"10.20.193.138:6813/1335950096","heartbeat_back_addr":"10.20.193.138:6817/1335950096","heartbeat_front_addr":"10.20.193.138:6815/1335950096","state":["exists","up"]},{"osd":1,"uuid":"46864e5c-d4fc-44a3-b4f3-aa66dd95a209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6802","nonce":1008918870},{"type":"v1","addr":"10.20.193.138:6803","nonce":1008918870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6804","nonce":1008918870},{"type":"v1","addr":"10.20.193.138:6805","nonce":1008918870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6808","nonce":1008918870},{"type":"v1","addr":"10.20.193.138:6809","nonce":1008918870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6806","nonce":1008918870},{"type":"v1","addr":"10.20.193.138:6807","nonce":1008918870}]},"public_addr":"10.20.193.138:6803/1008918870","cluster_addr":"10.20.193.138:6805/1008918870","heartbeat_back_addr":"10.20.193.138:6809/1008918870","heartbeat_front_addr":"10.20.193.138:6807/1008918870","state":["exists","up"]},{"osd":2,"uuid":"5149acb8-cb3a-40e0-b3ae-66d70ba42873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6818","nonce":885806557},{"type":"v1","addr":"10.20.193.138:6819","nonce":885806557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6820","nonce":885806557},{"type":"v1","addr":"10.20.193.138:6821","nonce":885806557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6824","nonce":885806557},{"type":"v1","addr":"10.20.193.138:6825","nonce":885806557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6822","nonce":885806557},{"type":"v1","addr":"10.20.193.138:6823","nonce":885806557}]},"public_addr":"10.20.193.138:6819/885806557","cluster_addr":"10.20.193.138:6821/885806557","heartbeat_back_addr":"10.20.193.138:6825/885806557","heartbeat_front_addr":"10.20.193.138:6823/885806557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T10:58:05.464754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T10:58:05.488214+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T10:58:05.568942+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T10:58:49.358 INFO:tasks.ceph:Scrubbing osd.0 2026-02-17T10:58:49.358 DEBUG:teuthology.orchestra.run.trial138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-17T10:58:49.440 INFO:teuthology.orchestra.run.trial138.stdout:{ 2026-02-17T10:58:49.440 INFO:teuthology.orchestra.run.trial138.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T10:58:49.440 INFO:teuthology.orchestra.run.trial138.stdout:} 2026-02-17T10:58:49.446 DEBUG:teuthology.orchestra.run.trial138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-17T10:58:49.605 INFO:teuthology.orchestra.run.trial138.stderr:instructed osd(s) 0 to deep-scrub 2026-02-17T10:58:49.614 INFO:tasks.ceph:Scrubbing osd.1 2026-02-17T10:58:49.614 DEBUG:teuthology.orchestra.run.trial138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-17T10:58:49.693 INFO:teuthology.orchestra.run.trial138.stdout:{ 2026-02-17T10:58:49.694 INFO:teuthology.orchestra.run.trial138.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T10:58:49.694 INFO:teuthology.orchestra.run.trial138.stdout:} 2026-02-17T10:58:49.700 DEBUG:teuthology.orchestra.run.trial138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-17T10:58:49.856 INFO:teuthology.orchestra.run.trial138.stderr:instructed osd(s) 1 to deep-scrub 2026-02-17T10:58:49.865 INFO:tasks.ceph:Scrubbing osd.2 2026-02-17T10:58:49.865 DEBUG:teuthology.orchestra.run.trial138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-17T10:58:49.945 INFO:teuthology.orchestra.run.trial138.stdout:{ 2026-02-17T10:58:49.946 INFO:teuthology.orchestra.run.trial138.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T10:58:49.946 INFO:teuthology.orchestra.run.trial138.stdout:} 2026-02-17T10:58:49.951 DEBUG:teuthology.orchestra.run.trial138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-17T10:58:50.108 INFO:teuthology.orchestra.run.trial138.stderr:instructed osd(s) 2 to deep-scrub 2026-02-17T10:58:50.117 DEBUG:teuthology.orchestra.run.trial138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T10:58:50.272 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:58:50.272 INFO:teuthology.orchestra.run.trial138.stderr:dumped all 2026-02-17T10:58:50.280 INFO:teuthology.orchestra.run.trial138.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2026-02-17T10:58:49.043704+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":81264,"kb_used_data":368,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":314491536,"statfs":{"total":322122547200,"available":322039332864,"internally_reserved":0,"allocated":376832,"data_stored":98834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4781,"internal_metadata":82767187},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.000759"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":23,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T10:58:23.842291+0000","last_change":"2026-02-17T10:58:17.066596+0000","last_active":"2026-02-17T10:58:23.842291+0000","last_peered":"2026-02-17T10:58:23.842291+0000","last_clean":"2026-02-17T10:58:23.842291+0000","last_became_active":"2026-02-17T10:58:15.063792+0000","last_became_peered":"2026-02-17T10:58:15.063792+0000","last_unstale":"2026-02-17T10:58:23.842291+0000","last_undegraded":"2026-02-17T10:58:23.842291+0000","last_fullsized":"2026-02-17T10:58:23.842291+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:36:47.905105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036630700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":23,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T10:58:23.842251+0000","last_change":"2026-02-17T10:58:17.066497+0000","last_active":"2026-02-17T10:58:23.842251+0000","last_peered":"2026-02-17T10:58:23.842251+0000","last_clean":"2026-02-17T10:58:23.842251+0000","last_became_active":"2026-02-17T10:58:15.064292+0000","last_became_peered":"2026-02-17T10:58:15.064292+0000","last_unstale":"2026-02-17T10:58:23.842251+0000","last_undegraded":"2026-02-17T10:58:23.842251+0000","last_fullsized":"2026-02-17T10:58:23.842251+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:05:54.317111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029424399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":23,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T10:58:24.646078+0000","last_change":"2026-02-17T10:58:17.064493+0000","last_active":"2026-02-17T10:58:24.646078+0000","last_peered":"2026-02-17T10:58:24.646078+0000","last_clean":"2026-02-17T10:58:24.646078+0000","last_became_active":"2026-02-17T10:58:15.063970+0000","last_became_peered":"2026-02-17T10:58:15.063970+0000","last_unstale":"2026-02-17T10:58:24.646078+0000","last_undegraded":"2026-02-17T10:58:24.646078+0000","last_fullsized":"2026-02-17T10:58:24.646078+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:58:30.074704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000175174,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":23,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T10:58:23.842281+0000","last_change":"2026-02-17T10:58:17.066401+0000","last_active":"2026-02-17T10:58:23.842281+0000","last_peered":"2026-02-17T10:58:23.842281+0000","last_clean":"2026-02-17T10:58:23.842281+0000","last_became_active":"2026-02-17T10:58:15.064024+0000","last_became_peered":"2026-02-17T10:58:15.064024+0000","last_unstale":"2026-02-17T10:58:23.842281+0000","last_undegraded":"2026-02-17T10:58:23.842281+0000","last_fullsized":"2026-02-17T10:58:23.842281+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:24:50.691188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000197605,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"10'1","reported_seq":24,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T10:58:23.842304+0000","last_change":"2026-02-17T10:58:17.066533+0000","last_active":"2026-02-17T10:58:23.842304+0000","last_peered":"2026-02-17T10:58:23.842304+0000","last_clean":"2026-02-17T10:58:23.842304+0000","last_became_active":"2026-02-17T10:58:15.063770+0000","last_became_peered":"2026-02-17T10:58:15.063770+0000","last_unstale":"2026-02-17T10:58:23.842304+0000","last_undegraded":"2026-02-17T10:58:23.842304+0000","last_fullsized":"2026-02-17T10:58:23.842304+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:24:21.343084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033193300000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"12'2","reported_seq":25,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T10:58:24.519573+0000","last_change":"2026-02-17T10:58:17.065530+0000","last_active":"2026-02-17T10:58:24.519573+0000","last_peered":"2026-02-17T10:58:24.519573+0000","last_clean":"2026-02-17T10:58:24.519573+0000","last_became_active":"2026-02-17T10:58:15.063551+0000","last_became_peered":"2026-02-17T10:58:15.063551+0000","last_unstale":"2026-02-17T10:58:24.519573+0000","last_undegraded":"2026-02-17T10:58:24.519573+0000","last_fullsized":"2026-02-17T10:58:24.519573+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:46:08.530261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034513799999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":23,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T10:58:24.646035+0000","last_change":"2026-02-17T10:58:17.064478+0000","last_active":"2026-02-17T10:58:24.646035+0000","last_peered":"2026-02-17T10:58:24.646035+0000","last_clean":"2026-02-17T10:58:24.646035+0000","last_became_active":"2026-02-17T10:58:15.063794+0000","last_became_peered":"2026-02-17T10:58:15.063794+0000","last_unstale":"2026-02-17T10:58:24.646035+0000","last_undegraded":"2026-02-17T10:58:24.646035+0000","last_fullsized":"2026-02-17T10:58:24.646035+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:28:04.777048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00018169599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":23,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T10:58:23.842193+0000","last_change":"2026-02-17T10:58:17.066401+0000","last_active":"2026-02-17T10:58:23.842193+0000","last_peered":"2026-02-17T10:58:23.842193+0000","last_clean":"2026-02-17T10:58:23.842193+0000","last_became_active":"2026-02-17T10:58:15.064000+0000","last_became_peered":"2026-02-17T10:58:15.064000+0000","last_unstale":"2026-02-17T10:58:23.842193+0000","last_undegraded":"2026-02-17T10:58:23.842193+0000","last_fullsized":"2026-02-17T10:58:23.842193+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:14.054547+0000","last_clean_scrub_stamp":"2026-02-17T10:58:14.054547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:40:19.034197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000226419,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738379,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27088,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830512,"statfs":{"total":107374182400,"available":107346444288,"internally_reserved":0,"allocated":122880,"data_stored":32932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738380,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27088,"kb_used_data":124,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830512,"statfs":{"total":107374182400,"available":107346444288,"internally_reserved":0,"allocated":126976,"data_stored":32951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738379,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27088,"kb_used_data":124,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830512,"statfs":{"total":107374182400,"available":107346444288,"internally_reserved":0,"allocated":126976,"data_stored":32951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T10:58:50.282 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2026-02-17T10:58:14.054547+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=10, tm_min=58, tm_sec=14, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=10, tm_min=58, tm_sec=48, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T10:58:50.282 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2026-02-17T10:58:14.054547+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=10, tm_min=58, tm_sec=14, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=10, tm_min=58, tm_sec=48, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T10:58:50.282 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2026-02-17T10:58:14.054547+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=10, tm_min=58, tm_sec=14, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=10, tm_min=58, tm_sec=48, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T10:58:50.282 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2026-02-17T10:58:14.054547+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=10, tm_min=58, tm_sec=14, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=10, tm_min=58, tm_sec=48, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T10:58:50.282 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2026-02-17T10:58:14.054547+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=10, tm_min=58, tm_sec=14, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=10, tm_min=58, tm_sec=48, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T10:58:50.282 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2026-02-17T10:58:14.054547+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=10, tm_min=58, tm_sec=14, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=10, tm_min=58, tm_sec=48, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T10:58:50.282 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2026-02-17T10:58:14.054547+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=10, tm_min=58, tm_sec=14, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=10, tm_min=58, tm_sec=48, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T10:58:50.282 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-17T10:58:14.054547+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=10, tm_min=58, tm_sec=14, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=10, tm_min=58, tm_sec=48, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T10:58:50.282 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-17T10:59:10.283 DEBUG:teuthology.orchestra.run.trial138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T10:59:10.444 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T10:59:10.444 INFO:teuthology.orchestra.run.trial138.stderr:dumped all 2026-02-17T10:59:10.452 INFO:teuthology.orchestra.run.trial138.stdout:{"pg_ready":true,"pg_map":{"version":43,"stamp":"2026-02-17T10:59:09.045309+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":81248,"kb_used_data":368,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":314491552,"statfs":{"total":322122547200,"available":322039349248,"internally_reserved":0,"allocated":376832,"data_stored":98834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4781,"internal_metadata":82767187},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.000736"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":32,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T10:58:50.614874+0000","last_change":"2026-02-17T10:58:50.614884+0000","last_active":"2026-02-17T10:58:50.614874+0000","last_peered":"2026-02-17T10:58:50.614874+0000","last_clean":"2026-02-17T10:58:50.614874+0000","last_became_active":"2026-02-17T10:58:15.063792+0000","last_became_peered":"2026-02-17T10:58:15.063792+0000","last_unstale":"2026-02-17T10:58:50.614874+0000","last_undegraded":"2026-02-17T10:58:50.614874+0000","last_fullsized":"2026-02-17T10:58:50.614874+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:50.614832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:50.614832+0000","last_clean_scrub_stamp":"2026-02-17T10:58:50.614832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:16:37.985218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036630700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":32,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T10:58:54.601559+0000","last_change":"2026-02-17T10:58:54.601573+0000","last_active":"2026-02-17T10:58:54.601559+0000","last_peered":"2026-02-17T10:58:54.601559+0000","last_clean":"2026-02-17T10:58:54.601559+0000","last_became_active":"2026-02-17T10:58:15.064292+0000","last_became_peered":"2026-02-17T10:58:15.064292+0000","last_unstale":"2026-02-17T10:58:54.601559+0000","last_undegraded":"2026-02-17T10:58:54.601559+0000","last_fullsized":"2026-02-17T10:58:54.601559+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:54.601531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:54.601531+0000","last_clean_scrub_stamp":"2026-02-17T10:58:54.601531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:31:29.147914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029424399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":32,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T10:58:51.797327+0000","last_change":"2026-02-17T10:58:51.797337+0000","last_active":"2026-02-17T10:58:51.797327+0000","last_peered":"2026-02-17T10:58:51.797327+0000","last_clean":"2026-02-17T10:58:51.797327+0000","last_became_active":"2026-02-17T10:58:15.063970+0000","last_became_peered":"2026-02-17T10:58:15.063970+0000","last_unstale":"2026-02-17T10:58:51.797327+0000","last_undegraded":"2026-02-17T10:58:51.797327+0000","last_fullsized":"2026-02-17T10:58:51.797327+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:51.797292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:51.797292+0000","last_clean_scrub_stamp":"2026-02-17T10:58:51.797292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T17:46:39.351273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000175174,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":32,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T10:58:52.629897+0000","last_change":"2026-02-17T10:58:52.629909+0000","last_active":"2026-02-17T10:58:52.629897+0000","last_peered":"2026-02-17T10:58:52.629897+0000","last_clean":"2026-02-17T10:58:52.629897+0000","last_became_active":"2026-02-17T10:58:15.064024+0000","last_became_peered":"2026-02-17T10:58:15.064024+0000","last_unstale":"2026-02-17T10:58:52.629897+0000","last_undegraded":"2026-02-17T10:58:52.629897+0000","last_fullsized":"2026-02-17T10:58:52.629897+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:52.629849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:52.629849+0000","last_clean_scrub_stamp":"2026-02-17T10:58:52.629849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:50:59.620804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000197605,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"14'2","reported_seq":34,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T10:58:53.592944+0000","last_change":"2026-02-17T10:58:53.592957+0000","last_active":"2026-02-17T10:58:53.592944+0000","last_peered":"2026-02-17T10:58:53.592944+0000","last_clean":"2026-02-17T10:58:53.592944+0000","last_became_active":"2026-02-17T10:58:15.063770+0000","last_became_peered":"2026-02-17T10:58:15.063770+0000","last_unstale":"2026-02-17T10:58:53.592944+0000","last_undegraded":"2026-02-17T10:58:53.592944+0000","last_fullsized":"2026-02-17T10:58:53.592944+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'2","last_scrub_stamp":"2026-02-17T10:58:53.592920+0000","last_deep_scrub":"14'2","last_deep_scrub_stamp":"2026-02-17T10:58:53.592920+0000","last_clean_scrub_stamp":"2026-02-17T10:58:53.592920+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T17:43:33.663589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033193300000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"14'3","reported_seq":35,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T10:58:50.465261+0000","last_change":"2026-02-17T10:58:50.465274+0000","last_active":"2026-02-17T10:58:50.465261+0000","last_peered":"2026-02-17T10:58:50.465261+0000","last_clean":"2026-02-17T10:58:50.465261+0000","last_became_active":"2026-02-17T10:58:15.063551+0000","last_became_peered":"2026-02-17T10:58:15.063551+0000","last_unstale":"2026-02-17T10:58:50.465261+0000","last_undegraded":"2026-02-17T10:58:50.465261+0000","last_fullsized":"2026-02-17T10:58:50.465261+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'3","last_scrub_stamp":"2026-02-17T10:58:50.465222+0000","last_deep_scrub":"14'3","last_deep_scrub_stamp":"2026-02-17T10:58:50.465222+0000","last_clean_scrub_stamp":"2026-02-17T10:58:50.465222+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:46:10.918802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034513799999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":32,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T10:58:50.787066+0000","last_change":"2026-02-17T10:58:50.787079+0000","last_active":"2026-02-17T10:58:50.787066+0000","last_peered":"2026-02-17T10:58:50.787066+0000","last_clean":"2026-02-17T10:58:50.787066+0000","last_became_active":"2026-02-17T10:58:15.063794+0000","last_became_peered":"2026-02-17T10:58:15.063794+0000","last_unstale":"2026-02-17T10:58:50.787066+0000","last_undegraded":"2026-02-17T10:58:50.787066+0000","last_fullsized":"2026-02-17T10:58:50.787066+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:50.787033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:50.787033+0000","last_clean_scrub_stamp":"2026-02-17T10:58:50.787033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:49:55.135378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00018169599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":32,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T10:58:51.612317+0000","last_change":"2026-02-17T10:58:51.612330+0000","last_active":"2026-02-17T10:58:51.612317+0000","last_peered":"2026-02-17T10:58:51.612317+0000","last_clean":"2026-02-17T10:58:51.612317+0000","last_became_active":"2026-02-17T10:58:15.064000+0000","last_became_peered":"2026-02-17T10:58:15.064000+0000","last_unstale":"2026-02-17T10:58:51.612317+0000","last_undegraded":"2026-02-17T10:58:51.612317+0000","last_fullsized":"2026-02-17T10:58:51.612317+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:58:51.612276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:58:51.612276+0000","last_clean_scrub_stamp":"2026-02-17T10:58:51.612276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:42:42.543721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000226419,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738383,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27080,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830520,"statfs":{"total":107374182400,"available":107346452480,"internally_reserved":0,"allocated":122880,"data_stored":32932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738384,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27084,"kb_used_data":124,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830516,"statfs":{"total":107374182400,"available":107346448384,"internally_reserved":0,"allocated":126976,"data_stored":32951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738383,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27084,"kb_used_data":124,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830516,"statfs":{"total":107374182400,"available":107346448384,"internally_reserved":0,"allocated":126976,"data_stored":32951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T10:59:10.453 DEBUG:teuthology.orchestra.run.trial138:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-17T10:59:10.623 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-17T10:59:10.624 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-17T10:59:10.624 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-17T10:59:10.624 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T10:59:10.661 INFO:tasks.ceph.osd.0:Stopped 2026-02-17T10:59:10.661 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-17T10:59:10.661 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T10:59:10.729 INFO:tasks.ceph.osd.1:Stopped 2026-02-17T10:59:10.730 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-17T10:59:10.730 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T10:59:10.799 INFO:tasks.ceph.osd.2:Stopped 2026-02-17T10:59:10.799 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-17T10:59:10.800 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-17T10:59:10.800 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T10:59:10.872 INFO:tasks.ceph.mgr.x:Stopped 2026-02-17T10:59:10.872 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-17T10:59:10.872 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-17T10:59:10.872 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T10:59:10.924 INFO:tasks.ceph.mon.a:Stopped 2026-02-17T10:59:10.925 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-17T10:59:10.925 DEBUG:teuthology.orchestra.run.trial138:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | head -n 1 2026-02-17T10:59:10.993 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial138.front.sepia.ceph.com 2026-02-17T10:59:10.993 DEBUG:teuthology.orchestra.run.trial138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-17T10:59:11.062 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial138.front.sepia.ceph.com 2026-02-17T10:59:11.062 DEBUG:teuthology.orchestra.run.trial138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-17T10:59:11.133 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial138.front.sepia.ceph.com 2026-02-17T10:59:11.134 DEBUG:teuthology.orchestra.run.trial138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-17T10:59:11.202 INFO:tasks.ceph:Archiving mon data... 2026-02-17T10:59:11.204 DEBUG:teuthology.misc:Transferring archived files from trial138:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51222/data/mon.a.tgz 2026-02-17T10:59:11.204 DEBUG:teuthology.orchestra.run.trial138:> mktemp 2026-02-17T10:59:11.260 INFO:teuthology.orchestra.run.trial138.stdout:/tmp/tmp.yxdXzEIZtt 2026-02-17T10:59:11.260 DEBUG:teuthology.orchestra.run.trial138:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.yxdXzEIZtt 2026-02-17T10:59:11.340 DEBUG:teuthology.orchestra.run.trial138:> sudo chmod 0666 /tmp/tmp.yxdXzEIZtt 2026-02-17T10:59:11.464 DEBUG:teuthology.orchestra.remote:trial138:/tmp/tmp.yxdXzEIZtt is 130KB 2026-02-17T10:59:11.514 DEBUG:teuthology.orchestra.run.trial138:> rm -fr /tmp/tmp.yxdXzEIZtt 2026-02-17T10:59:11.529 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-17T10:59:11.530 DEBUG:teuthology.orchestra.run.trial138:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-17T10:59:11.647 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-17T10:59:11.647 INFO:tasks.ceph:Archiving crash dumps... 2026-02-17T10:59:11.649 DEBUG:teuthology.misc:Transferring archived files from trial138:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51222/remote/trial138/crash 2026-02-17T10:59:11.650 DEBUG:teuthology.orchestra.run.trial138:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-17T10:59:11.711 INFO:tasks.ceph:Compressing logs... 2026-02-17T10:59:11.712 DEBUG:teuthology.orchestra.run.trial138:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T10:59:11.777 INFO:teuthology.orchestra.run.trial138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-17T10:59:11.793 INFO:teuthology.orchestra.run.trial138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-17T10:59:11.793 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44541.log 2026-02-17T10:59:11.794 INFO:teuthology.orchestra.run.trial138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43374.log 2026-02-17T10:59:11.794 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.44541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44590.log 2026-02-17T10:59:11.794 INFO:teuthology.orchestra.run.trial138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44541.log.gz 2026-02-17T10:59:11.794 INFO:teuthology.orchestra.run.trial138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-17T10:59:11.794 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.43374.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43374.log.gz 2026-02-17T10:59:11.794 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.44590.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44590.log.gz 2026-02-17T10:59:11.794 INFO:teuthology.orchestra.run.trial138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44060.log 2026-02-17T10:59:11.794 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44492.log 2026-02-17T10:59:11.794 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.44060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41616.log 2026-02-17T10:59:11.794 INFO:teuthology.orchestra.run.trial138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44060.log.gz 2026-02-17T10:59:11.794 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.44492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43070.log 2026-02-17T10:59:11.795 INFO:teuthology.orchestra.run.trial138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44492.log.gz 2026-02-17T10:59:11.795 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.41616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41190.log 2026-02-17T10:59:11.795 INFO:teuthology.orchestra.run.trial138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41616.log.gz 2026-02-17T10:59:11.795 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.43070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43962.log 2026-02-17T10:59:11.795 INFO:teuthology.orchestra.run.trial138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43070.log.gz 2026-02-17T10:59:11.795 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.41190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43477.log 2026-02-17T10:59:11.795 INFO:teuthology.orchestra.run.trial138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41190.log.gz 2026-02-17T10:59:11.795 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.43962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44198.log 2026-02-17T10:59:11.795 INFO:teuthology.orchestra.run.trial138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43962.log.gz 2026-02-17T10:59:11.795 INFO:teuthology.orchestra.run.trial138.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.43477.log: -- /var/log/ceph/ceph-client.admin.44247.log 2026-02-17T10:59:11.795 INFO:teuthology.orchestra.run.trial138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43477.log.gz 2026-02-17T10:59:11.795 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.44198.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44198.log.gz 2026-02-17T10:59:11.796 INFO:teuthology.orchestra.run.trial138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44107.log 2026-02-17T10:59:11.796 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.44247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43893.log 2026-02-17T10:59:11.796 INFO:teuthology.orchestra.run.trial138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44247.log.gz 2026-02-17T10:59:11.796 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.44107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43276.log 2026-02-17T10:59:11.796 INFO:teuthology.orchestra.run.trial138.stderr: 74.7% -- replaced with /var/log/ceph/ceph-client.admin.44107.log.gz 2026-02-17T10:59:11.796 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.43893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41078.log 2026-02-17T10:59:11.796 INFO:teuthology.orchestra.run.trial138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43893.log.gz 2026-02-17T10:59:11.796 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.43276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41554.log 2026-02-17T10:59:11.796 INFO:teuthology.orchestra.run.trial138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43276.log.gz 2026-02-17T10:59:11.796 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.41078.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41078.log.gz 2026-02-17T10:59:11.796 INFO:teuthology.orchestra.run.trial138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43743.log 2026-02-17T10:59:11.796 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.41554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44345.log 2026-02-17T10:59:11.796 INFO:teuthology.orchestra.run.trial138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41554.log.gz 2026-02-17T10:59:11.797 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.43743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44394.log 2026-02-17T10:59:11.797 INFO:teuthology.orchestra.run.trial138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43743.log.gz 2026-02-17T10:59:11.797 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.44345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43475.log 2026-02-17T10:59:11.797 INFO:teuthology.orchestra.run.trial138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44345.log.gz 2026-02-17T10:59:11.797 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.44394.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44394.log.gz 2026-02-17T10:59:11.797 INFO:teuthology.orchestra.run.trial138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41333.log 2026-02-17T10:59:11.797 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.43475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44011.log 2026-02-17T10:59:11.797 INFO:teuthology.orchestra.run.trial138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43475.log.gz 2026-02-17T10:59:11.797 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.41333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43325.log 2026-02-17T10:59:11.797 INFO:teuthology.orchestra.run.trial138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41333.log.gz 2026-02-17T10:59:11.797 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.44011.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44011.log.gz 2026-02-17T10:59:11.797 INFO:teuthology.orchestra.run.trial138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44296.log 2026-02-17T10:59:11.798 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.43325.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43325.log.gz 2026-02-17T10:59:11.798 INFO:teuthology.orchestra.run.trial138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-17T10:59:11.798 INFO:teuthology.orchestra.run.trial138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43211.log 2026-02-17T10:59:11.798 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.44296.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44296.log.gz 2026-02-17T10:59:11.798 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44639.log 2026-02-17T10:59:11.798 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.43211.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-17T10:59:11.798 INFO:teuthology.orchestra.run.trial138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43211.log.gz 2026-02-17T10:59:11.798 INFO:teuthology.orchestra.run.trial138.stderr: 87.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-17T10:59:11.798 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.44639.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44639.log.gz 2026-02-17T10:59:11.798 INFO:teuthology.orchestra.run.trial138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.37566.log 2026-02-17T10:59:11.798 INFO:teuthology.orchestra.run.trial138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41380.log 2026-02-17T10:59:11.798 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph.tmp-client.admin.37566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44149.log 2026-02-17T10:59:11.798 INFO:teuthology.orchestra.run.trial138.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.37566.log.gz 2026-02-17T10:59:11.799 INFO:teuthology.orchestra.run.trial138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43186.log 2026-02-17T10:59:11.799 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.41380.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41380.log.gz 2026-02-17T10:59:11.799 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.44149.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44149.log.gz 2026-02-17T10:59:11.799 INFO:teuthology.orchestra.run.trial138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44689.log 2026-02-17T10:59:11.799 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.43186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43623.log 2026-02-17T10:59:11.799 INFO:teuthology.orchestra.run.trial138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43186.log.gz 2026-02-17T10:59:11.799 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.44689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43624.log 2026-02-17T10:59:11.799 INFO:teuthology.orchestra.run.trial138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44689.log.gz 2026-02-17T10:59:11.799 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.43623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43622.log 2026-02-17T10:59:11.799 INFO:teuthology.orchestra.run.trial138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43623.log.gz 2026-02-17T10:59:11.799 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.43624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43476.log 2026-02-17T10:59:11.799 INFO:teuthology.orchestra.run.trial138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43624.log.gz 2026-02-17T10:59:11.799 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.43622.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43622.log.gz 2026-02-17T10:59:11.800 INFO:teuthology.orchestra.run.trial138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44736.log 2026-02-17T10:59:11.800 INFO:teuthology.orchestra.run.trial138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44443.log 2026-02-17T10:59:11.800 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.43476.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43476.log.gz 2026-02-17T10:59:11.800 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.44736.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-17T10:59:11.800 INFO:teuthology.orchestra.run.trial138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44736.log.gz 2026-02-17T10:59:11.800 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.44443.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.44443.log.gz --verbose 2026-02-17T10:59:11.800 INFO:teuthology.orchestra.run.trial138.stderr: -- /var/log/ceph/ceph-client.admin.43116.log 2026-02-17T10:59:11.800 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41427.log 2026-02-17T10:59:11.800 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.43116.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43116.log.gz 2026-02-17T10:59:11.800 INFO:teuthology.orchestra.run.trial138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-17T10:59:11.800 INFO:teuthology.orchestra.run.trial138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43864.log 2026-02-17T10:59:11.800 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.41427.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41427.log.gz 2026-02-17T10:59:11.800 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43777.log 2026-02-17T10:59:11.801 INFO:teuthology.orchestra.run.trial138.stderr: 83.1% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-17T10:59:11.801 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.43864.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43864.log.gz 2026-02-17T10:59:11.801 INFO:teuthology.orchestra.run.trial138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43744.log 2026-02-17T10:59:11.801 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.43777.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43777.log.gz 2026-02-17T10:59:11.801 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.43744.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43744.log.gz 2026-02-17T10:59:11.801 INFO:teuthology.orchestra.run.trial138.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-17T10:59:11.801 INFO:teuthology.orchestra.run.trial138.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-17T10:59:11.802 INFO:teuthology.orchestra.run.trial138.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-17T10:59:11.803 INFO:teuthology.orchestra.run.trial138.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-17T10:59:11.803 INFO:teuthology.orchestra.run.trial138.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-17T10:59:11.803 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T10:59:11.803 INFO:teuthology.orchestra.run.trial138.stderr:real 0m0.032s 2026-02-17T10:59:11.803 INFO:teuthology.orchestra.run.trial138.stderr:user 0m0.081s 2026-02-17T10:59:11.803 INFO:teuthology.orchestra.run.trial138.stderr:sys 0m0.032s 2026-02-17T10:59:11.803 INFO:tasks.ceph:Archiving logs... 2026-02-17T10:59:11.804 DEBUG:teuthology.misc:Transferring archived files from trial138:/var/log/ceph to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51222/remote/trial138/log 2026-02-17T10:59:11.805 DEBUG:teuthology.orchestra.run.trial138:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-17T10:59:11.916 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-17T10:59:11.934 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-17T10:59:11.934 DEBUG:teuthology.orchestra.run.trial138:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T10:59:12.056 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-17T10:59:12.068 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-17T10:59:12.068 DEBUG:teuthology.orchestra.run.trial138:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T10:59:12.085 INFO:teuthology.orchestra.run.trial138.stderr:bash: line 1: ntpq: command not found 2026-02-17T10:59:12.100 INFO:teuthology.orchestra.run.trial138.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T10:59:12.100 INFO:teuthology.orchestra.run.trial138.stdout:=============================================================================== 2026-02-17T10:59:12.100 INFO:teuthology.orchestra.run.trial138.stdout:^- 23.186.168.129 2 6 77 17 -125us[ +209us] +/- 56ms 2026-02-17T10:59:12.100 INFO:teuthology.orchestra.run.trial138.stdout:^+ time.richie.net 2 6 77 17 -556us[ -221us] +/- 35ms 2026-02-17T10:59:12.100 INFO:teuthology.orchestra.run.trial138.stdout:^- B1-66ER.matrix.gs 2 6 135 14 +1123us[+1123us] +/- 35ms 2026-02-17T10:59:12.100 INFO:teuthology.orchestra.run.trial138.stdout:^* 216-144-228-179-host.col> 2 6 77 16 +109us[ +445us] +/- 12ms 2026-02-17T10:59:12.101 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-17T10:59:12.112 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-17T10:59:12.112 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-17T10:59:12.125 DEBUG:teuthology.orchestra.run.trial138:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-17T10:59:12.195 DEBUG:teuthology.orchestra.run.trial138:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T10:59:12.222 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T10:59:12.222 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-17T10:59:12.240 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-17T10:59:12.255 INFO:teuthology.task.internal:Duration was 317.150084 seconds 2026-02-17T10:59:12.255 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-17T10:59:12.270 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-17T10:59:12.270 DEBUG:teuthology.orchestra.run.trial138:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T10:59:12.306 INFO:teuthology.orchestra.run.trial138.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T10:59:12.585 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-17T10:59:12.585 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial138.front.sepia.ceph.com 2026-02-17T10:59:12.586 DEBUG:teuthology.orchestra.run.trial138:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T10:59:12.646 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-17T10:59:12.646 DEBUG:teuthology.orchestra.run.trial138:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T10:59:12.746 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-17T10:59:12.746 DEBUG:teuthology.orchestra.run.trial138:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T10:59:12.768 INFO:teuthology.orchestra.run.trial138.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T10:59:12.768 INFO:teuthology.orchestra.run.trial138.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T10:59:12.768 INFO:teuthology.orchestra.run.trial138.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T10:59:12.769 INFO:teuthology.orchestra.run.trial138.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T10:59:12.769 INFO:teuthology.orchestra.run.trial138.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T10:59:12.778 INFO:teuthology.orchestra.run.trial138.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 81.4% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T10:59:12.780 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-17T10:59:12.796 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-17T10:59:12.797 DEBUG:teuthology.orchestra.run.trial138:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T10:59:12.846 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-17T10:59:12.866 DEBUG:teuthology.orchestra.run.trial138:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T10:59:12.911 INFO:teuthology.orchestra.run.trial138.stdout:kernel.core_pattern = core 2026-02-17T10:59:12.941 DEBUG:teuthology.orchestra.run.trial138:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T10:59:12.997 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T10:59:12.997 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-17T10:59:13.014 INFO:teuthology.task.internal:Transferring archived files... 2026-02-17T10:59:13.015 DEBUG:teuthology.misc:Transferring archived files from trial138:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51222/remote/trial138 2026-02-17T10:59:13.016 DEBUG:teuthology.orchestra.run.trial138:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T10:59:13.077 INFO:teuthology.task.internal:Removing archive directory... 2026-02-17T10:59:13.077 DEBUG:teuthology.orchestra.run.trial138:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T10:59:13.122 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-17T10:59:13.140 INFO:teuthology.task.internal:Not uploading archives. 2026-02-17T10:59:13.140 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-17T10:59:13.157 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-17T10:59:13.157 DEBUG:teuthology.orchestra.run.trial138:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T10:59:13.179 INFO:teuthology.orchestra.run.trial138.stdout: 791885 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 10:59 /home/ubuntu/cephtest 2026-02-17T10:59:13.180 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-17T10:59:13.198 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-17T10:59:13.237 INFO:teuthology.run:Summary data: description: rados/singleton-nomsgr/{all/ceph-snapmapper mon_election/connectivity rados supported-random-distro$/{centos_latest}} duration: 317.15008425712585 flavor: default owner: scheduled_skanta@soko04.front.sepia.ceph.com success: true 2026-02-17T10:59:13.237 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T10:59:13.359 INFO:teuthology.run:pass